Jul 28 20:06:33.388377 ip-10-0-136-137 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 20:06:33.388386 ip-10-0-136-137 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 20:06:33.388393 ip-10-0-136-137 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 20:06:33.388599 ip-10-0-136-137 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 20:06:43.477199 ip-10-0-136-137 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 20:06:43.477214 ip-10-0-136-137 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot af5b7b6eb4a2476891877cb7e3be831d --
Jul 28 20:08:17.483593 ip-10-0-136-137 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 20:08:17.885093 ip-10-0-136-137 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:08:17.885093 ip-10-0-136-137 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 20:08:17.885093 ip-10-0-136-137 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:08:17.885093 ip-10-0-136-137 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 20:08:17.885093 ip-10-0-136-137 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:08:17.886265 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.886151    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 20:08:17.892091 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892066    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:08:17.892091 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892087    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:08:17.892091 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892091    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:08:17.892091 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892094    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:08:17.892091 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892098    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892102    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892106    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892108    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892111    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892114    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892117    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892119    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892122    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892125    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892127    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892130    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892133    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892136    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892138    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892141    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892144    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892147    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892149    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892152    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:08:17.892310 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892154    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892157    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892160    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892163    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892165    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892168    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892171    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892173    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892179    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892182    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892184    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892187    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892190    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892193    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892196    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892198    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892201    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892203    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892207    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:08:17.892829 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892209    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892212    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892214    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892217    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892219    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892222    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892225    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892227    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892230    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892246    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892249    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892251    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892254    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892257    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892259    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892262    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892264    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892267    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892271    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892275    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:08:17.893306 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892278    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892281    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892283    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892286    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892289    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892292    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892295    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892298    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892300    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892303    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892306    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892309    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892312    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892315    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892317    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892320    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892323    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892326    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892329    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892331    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:08:17.893784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892341    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892344    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892346    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892350    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892360    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892363    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892366    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892369    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892371    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892374    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892378    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892381    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892384    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892387    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892389    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.892392    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893179    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893188    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893191    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:08:17.894285 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893195    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893198    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893201    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893204    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893206    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893211    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893215    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893218    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893220    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893223    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893225    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893228    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893246    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893251    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893265    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893270    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893273    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893276    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893279    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:08:17.894757 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893282    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893285    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893288    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893291    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893294    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893297    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893300    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893303    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893306    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893309    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893312    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893314    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893317    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893320    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893323    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893325    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893328    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893330    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893333    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893335    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:08:17.895227 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893338    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893340    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893343    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893346    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893349    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893351    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893353    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893356    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893364    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893367    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893370    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893372    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893375    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893377    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893380    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893383    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893386    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893389    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893391    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893394    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:08:17.895813 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893397    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893399    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893402    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893404    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893407    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893409    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893412    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893414    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893417    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893420    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893422    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893425    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893429    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893433    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893436    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893438    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893441    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893443    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893446    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:08:17.896338 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893448    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893451    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893459    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893467    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893470    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893472    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893475    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893478    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893481    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893484    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893487    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893489    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893492    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893495    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893497    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893499    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893502    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893505    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893946    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893951    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:08:17.896812 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893953    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893956    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893958    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893961    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893964    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893966    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893969    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893971    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893974    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893977    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893979    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893981    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893984    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893986    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893995    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.893997    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894000    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894002    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894011    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894016    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:08:17.897314 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894019    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894022    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894025    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894027    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894030    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894032    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894035    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894037    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894040    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894042    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894045    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894047    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894049    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894052    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894054    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894057    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894059    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894062    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894065    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894067    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:08:17.897839 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894070    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894075    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894077    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894080    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894082    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894085    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894088    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894096    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894098    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894101    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894103    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894108    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894111    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894114    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894117    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894120    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894122    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894125    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894127    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894130    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:08:17.898345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894133    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894135    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894138    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894140    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894143    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894145    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894150    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894154    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894157    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894161    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894164    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894167    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894170    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894173    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894176    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894179    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894181    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894184    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:08:17.898833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894187    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894190    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894194    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894197    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894200    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894204    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894206    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894209    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894212    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894215    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894217    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894220    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894222    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894225    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894227    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894244    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894247    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894249    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894252    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894320    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894328    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 20:08:17.899329 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894334    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894338    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894342    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894345    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894350    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894354    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894357    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894360    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894363    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894367    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894370    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894373    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894375    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894378    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894381    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894385    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894390    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894393    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894396    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894399    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894403    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894407    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894410    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 20:08:17.899826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894413    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894416    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894419    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894422    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894425    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894428    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894431    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894435    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894438    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894441    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894444    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894448    2561 flags.go:64] FLAG: --enable-server="true"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894451    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894456    2561 flags.go:64] FLAG: --event-burst="100"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894459    2561 flags.go:64] FLAG: --event-qps="50"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894462    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894465    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894468    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894472    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894475    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894478    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894481    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894483    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894486    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894490    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 20:08:17.900387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894494    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894497    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894500    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894503    2561 flags.go:64] FLAG: --feature-gates=""
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894507    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894510    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894513    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894516    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894519    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894522    2561 flags.go:64] FLAG: --help="false"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894525    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-136-137.ec2.internal"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894528    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894531    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894534    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894537    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894540    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894543    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894546    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894550    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894553    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894556    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894559    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894562    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894564    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 20:08:17.901138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894567    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894570    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894573    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894575    2561 flags.go:64] FLAG: --lock-file=""
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894578    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894581    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894584    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894589    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894594    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894597    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894600    2561 flags.go:64] FLAG: --logging-format="text"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894603    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894606    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894609    2561 flags.go:64] FLAG: --manifest-url=""
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894612    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894616    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894619    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894623    2561 flags.go:64] FLAG: --max-pods="110"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894626    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894629    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894632    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894635    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894637    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894640    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894643    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 20:08:17.902182 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894651    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894655    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894658    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894661    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894664    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894669    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894672    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894675    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894678    2561 flags.go:64] FLAG: --port="10250"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894681    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894684    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-082f288d1dd8a6ac1"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894687    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894690    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894693    2561 flags.go:64] FLAG: --register-node="true"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894696    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894700    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894704    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894707    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894710    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894714    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894717    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894720    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894722    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894725    2561 flags.go:64] FLAG: --runonce="false"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894728    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 20:08:17.903283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894731    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894734    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894737    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894739    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894742    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894745    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894748    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894751    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894755    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894758    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894761    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894764    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894767    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894770    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894775    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894778    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894781    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894785    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894787    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894790    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894793    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894796    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894799    2561 flags.go:64] FLAG: --v="2"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894804    2561 flags.go:64] FLAG: --version="false"
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894811    2561 flags.go:64] FLAG: --vmodule=""
Jul 28 20:08:17.904108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894814    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.894818    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894940    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894944    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894948    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894952    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894955    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894958    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894961    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894965    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894969    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894972    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894974    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894977    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894980    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894984    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894987    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894990    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894993    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:08:17.905001 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894996    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.894999    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895001    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895004    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895007    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895009    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895012    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895015    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895017    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895020    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895023    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895026    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895029    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895032    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895035    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895037    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895040    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895043    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895045    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895048    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:08:17.905838 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895050    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895053    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895055    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895058    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895060    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895063    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895066    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895068    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895072    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895074    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895077    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895080    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895082    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895086    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895089    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895092    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895095    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895098    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895101    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:08:17.906637 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895103    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895106    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895109    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895111    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895115    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895118    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895120    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895124    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895126    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895129    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895131    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895134    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895136    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895139    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895141    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895145    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895149    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895152    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895155    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895157    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:08:17.907434 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895159    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895163    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895166    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895169    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895172    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895175    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895177    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895180    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895182    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895185    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895187    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895190    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895192    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895195    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895198    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895201    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895204    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895207    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895210    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895213    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:08:17.908197 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895216    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895218    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.895221    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.895967    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.903642    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.903666    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.904470    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.904485    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904585    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904594    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904601    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904617    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904622    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904627    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904633    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:08:17.908822 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904638    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904643    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904648    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904652    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904656    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904660    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904664    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904669    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904673    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904679    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904685    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904690    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904695    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904699    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904704    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904709    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904714    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904718    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904722    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904726    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:08:17.909225 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904731    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904735    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904749    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904754    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904759    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904763    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904768    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904772    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904776    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904780    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904785    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904789    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904792    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904797    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904801    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904805    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904810    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904814    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904818    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904822    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:08:17.909741 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904826    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904830    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904834    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904839    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904845    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904850    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904855    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904860    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904865    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904869    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904874    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904879    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904884    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904889    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904893    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904905    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904909    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904913    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904917    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:08:17.910300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904921    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904925    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904929    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904933    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904938    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904942    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904946    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904950    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904954    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904958    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904962    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904967    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904971    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904975    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904980    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904984    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904989    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904993    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.904997    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:08:17.910773 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905002    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905006    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905010    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905014    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905017    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905022    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905026    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905030    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905034    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905038    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905056    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905060    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905064    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905068    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.905077    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:08:17.911322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905313    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905323    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905328    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905333    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905337    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905341    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905345    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905350    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905354    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905358    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905362    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905367    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905371    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905375    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905380    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905384    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905388    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905393    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905397    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905401    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:08:17.911723 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905405    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905410    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905414    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905418    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905422    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905426    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905430    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905434    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905449    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905453    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905457    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905461    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905465    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905469    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905473    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905478    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905482    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905486    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905490    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:08:17.912345 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905495    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905499    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905503    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905507    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905511    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905515    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905520    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905526    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905533    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905538    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905542    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905547    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905552    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905556    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905560    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905564    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905571    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905576    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905580    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:08:17.913135 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905585    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905589    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905594    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905606    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905610    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905615    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905619    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905623    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905627    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905631    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905635    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905639    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905644    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905647    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905652    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905656    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905661    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905665    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905669    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905674    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905677    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:08:17.913936 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905682    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905686    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905690    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905695    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905699    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905703    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905707    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905711    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905715    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905719    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905723    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905729    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905734    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905738    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905743    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905754    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905758    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905763    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905767    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:08:17.914532 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:17.905771    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:08:17.915410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.905779    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:08:17.915410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.905976    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 20:08:17.915410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.908647    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 20:08:17.915410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.910157    2561 server.go:1019] "Starting client certificate rotation"
Jul 28 20:08:17.915410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.910308    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 20:08:17.915410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.910340    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 20:08:17.915410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.912875    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 20:08:17.920370 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.920350    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 20:08:17.929478 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.929458    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 28 20:08:17.931436 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.931420    2561 log.go:25] "Validated CRI v1 image API"
Jul 28 20:08:17.932907 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.932892    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 20:08:17.935293 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.935273    2561 fs.go:135] Filesystem UUIDs: map[2199ab72-e326-4d4b-bd69-15439bc5b8fb:/dev/nvme0n1p4 39234ee4-3e36-466d-b9c8-fb79f127ae3e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 28 20:08:17.935362 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.935292    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 20:08:17.940794 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.940652    2561 manager.go:216] Machine: {Timestamp:2026-07-28 20:08:17.939180878 +0000 UTC m=+0.335884028 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096289 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24619d426b104d3c86a00394a7a52b SystemUUID:ec24619d-426b-104d-3c86-a00394a7a52b BootID:af5b7b6e-b4a2-4768-9187-7cb7e3be831d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:eb:14:f9:29:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:eb:14:f9:29:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:d0:cf:87:d0:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 20:08:17.940794 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.940782    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 20:08:17.940974 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.940894    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 20:08:17.944104 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.944072    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 20:08:17.944261 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.944108    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-137.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 20:08:17.945436 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.945424    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 20:08:17.945485 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.945439    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 20:08:17.945485 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.945447    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 20:08:17.946119 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.946109    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 20:08:17.946851 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.946841    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 20:08:17.947156 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.947141    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 20:08:17.949435 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.949423    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 20:08:17.949573 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.949563    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 20:08:17.949604 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.949594    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 20:08:17.949631 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.949608    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 20:08:17.949631 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.949627    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 20:08:17.949684 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.949640    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 28 20:08:17.949684 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.949649    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 20:08:17.950179 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.950161    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 20:08:17.950179 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.950181    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 20:08:17.953270 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.953256    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 20:08:17.955199 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.955180    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 20:08:17.955300 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.955221    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 20:08:17.956635 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956621    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 20:08:17.956708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956641    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 20:08:17.956708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956652    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 20:08:17.956708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956660    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 20:08:17.956708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956673    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 20:08:17.956708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956700    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 20:08:17.956896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956714    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 20:08:17.956896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956722    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 20:08:17.956896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956732    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 20:08:17.956896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956740    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 20:08:17.956896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956753    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 20:08:17.956896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.956773    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 20:08:17.957811 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.957799    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 20:08:17.957861 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.957814    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 20:08:17.959636 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.959611    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-137.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 20:08:17.959740 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:17.959714    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 20:08:17.959802 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:17.959714    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 20:08:17.961213 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.961197    2561 server.go:1268] "Started kubelet"
Jul 28 20:08:17.961331 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.961271    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 20:08:17.961331 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.961306    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 20:08:17.965164 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.965034    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 20:08:17.965704 ip-10-0-136-137 systemd[1]: Started Kubernetes Kubelet.
Jul 28 20:08:17.968350 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.967510    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 20:08:17.968459 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.968441    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 20:08:17.971162 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:17.971140    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 20:08:17.976804 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.976787    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 20:08:17.976877 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.976805    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 20:08:17.976957 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:17.976910    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:17.977355 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977331    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 20:08:17.977505 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977490    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 20:08:17.977562 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977509    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 20:08:17.977617 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977576    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 20:08:17.977617 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977585    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 20:08:17.977709 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977682    2561 factory.go:55] Registering systemd factory
Jul 28 20:08:17.977709 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977697    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 28 20:08:17.977933 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977916    2561 factory.go:153] Registering CRI-O factory
Jul 28 20:08:17.977933 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977932    2561 factory.go:223] Registration of the crio container factory successfully
Jul 28 20:08:17.978078 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977975    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 20:08:17.978078 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.977998    2561 factory.go:103] Registering Raw factory
Jul 28 20:08:17.978078 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.978012    2561 manager.go:1196] Started watching for new ooms in manager
Jul 28 20:08:17.978491 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.978470    2561 manager.go:349] Starting recovery of all containers
Jul 28 20:08:17.980362 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:17.980330    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 20:08:17.980624 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:17.980576    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 20:08:17.981429 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:17.980416    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-137.ec2.internal.18c68cf7bd5f7fd6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-137.ec2.internal,UID:ip-10-0-136-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-137.ec2.internal,},FirstTimestamp:2026-07-28 20:08:17.960943574 +0000 UTC m=+0.357646722,LastTimestamp:2026-07-28 20:08:17.960943574 +0000 UTC m=+0.357646722,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-137.ec2.internal,}"
Jul 28 20:08:17.989683 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.989431    2561 manager.go:354] Recovery completed
Jul 28 20:08:17.991749 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:17.990969    2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 28 20:08:17.994681 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.994669    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:08:17.995524 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.995506    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-46rlm"
Jul 28 20:08:17.996550 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.996534    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:08:17.996612 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.996566    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:08:17.996612 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.996579    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:08:17.997130 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.997117    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 20:08:17.997183 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.997130    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 20:08:17.997183 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.997137    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:08:17.997183 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.997147    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 20:08:17.997866 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.997850    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:08:17.997937 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.997880    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:08:17.997937 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.997896    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:08:17.998650 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:17.998558    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-137.ec2.internal.18c68cf7bf7ecfdf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-137.ec2.internal,UID:ip-10-0-136-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-137.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-137.ec2.internal,},FirstTimestamp:2026-07-28 20:08:17.996550111 +0000 UTC m=+0.393253261,LastTimestamp:2026-07-28 20:08:17.996550111 +0000 UTC m=+0.393253261,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-137.ec2.internal,}"
Jul 28 20:08:17.999638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.999621    2561 policy_none.go:49] "None policy: Start"
Jul 28 20:08:17.999638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.999637    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 20:08:17.999767 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:17.999647    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 20:08:18.001472 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.001458    2561 policy_none.go:47] "Start"
Jul 28 20:08:18.004682 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.004663    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-46rlm"
Jul 28 20:08:18.006415 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.006333    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-137.ec2.internal.18c68cf7bf7f28a9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-137.ec2.internal,UID:ip-10-0-136-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-137.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-137.ec2.internal,},FirstTimestamp:2026-07-28 20:08:17.996572841 +0000 UTC m=+0.393275995,LastTimestamp:2026-07-28 20:08:17.996572841 +0000 UTC m=+0.393275995,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-137.ec2.internal,}"
Jul 28 20:08:18.008513 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.008420    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-137.ec2.internal.18c68cf7bf7f57d6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-137.ec2.internal,UID:ip-10-0-136-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-137.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-137.ec2.internal,},FirstTimestamp:2026-07-28 20:08:17.996584918 +0000 UTC m=+0.393288073,LastTimestamp:2026-07-28 20:08:17.996584918 +0000 UTC m=+0.393288073,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-137.ec2.internal,}"
Jul 28 20:08:18.050718 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.040768    2561 manager.go:337] "Starting Device Plugin manager"
Jul 28 20:08:18.050718 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.040975    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 20:08:18.050718 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.040992    2561 server.go:87] "Starting device plugin registration server"
Jul 28 20:08:18.050718 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.041256    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 20:08:18.050718 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.041277    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 20:08:18.050718 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.041362    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 20:08:18.050718 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.041450    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 20:08:18.050718 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.041459    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 20:08:18.050718 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.041973    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 20:08:18.050718 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.042015    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:18.068834 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.068798    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 20:08:18.069998 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.069980    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 20:08:18.070100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.070013    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 20:08:18.070100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.070035    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 20:08:18.070100 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.070077    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 20:08:18.072616 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.072589    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:08:18.142096 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.142006    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:08:18.143052 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.143036    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:08:18.143140 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.143065    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:08:18.143140 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.143076    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:08:18.143140 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.143100    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.149898 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.149882    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.149945 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.149906    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-137.ec2.internal\": node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:18.170200 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.170174    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal"]
Jul 28 20:08:18.170336 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.170272    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:08:18.171142 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.171127    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:08:18.171211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.171156    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:08:18.171211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.171170    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:08:18.171682 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.171665    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:18.173552 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.173539    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:08:18.173711 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.173697    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.173759 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.173726    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:08:18.174283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.174267    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:08:18.174346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.174288    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:08:18.174346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.174313    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:08:18.174346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.174322    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:08:18.174492 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.174294    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:08:18.174492 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.174371    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:08:18.176511 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.176492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.176618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.176523    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:08:18.177198 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.177182    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:08:18.177312 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.177203    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:08:18.177312 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.177216    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:08:18.178866 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.178851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df0fbbd3933b738de00eb30c62a7ab12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"df0fbbd3933b738de00eb30c62a7ab12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.178949 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.178879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df0fbbd3933b738de00eb30c62a7ab12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"df0fbbd3933b738de00eb30c62a7ab12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.178949 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.178903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ed1757eda998924f39fee4dd8c636f2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-137.ec2.internal\" (UID: \"0ed1757eda998924f39fee4dd8c636f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.190803 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.190786    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-137.ec2.internal\" not found" node="ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.194712 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.194698    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-137.ec2.internal\" not found" node="ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.272598 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.272575    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:18.279919 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.279892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df0fbbd3933b738de00eb30c62a7ab12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"df0fbbd3933b738de00eb30c62a7ab12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.280011 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.279921    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ed1757eda998924f39fee4dd8c636f2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-137.ec2.internal\" (UID: \"0ed1757eda998924f39fee4dd8c636f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.280011 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.279939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df0fbbd3933b738de00eb30c62a7ab12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"df0fbbd3933b738de00eb30c62a7ab12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.280011 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.279979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df0fbbd3933b738de00eb30c62a7ab12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"df0fbbd3933b738de00eb30c62a7ab12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.280128 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.279992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df0fbbd3933b738de00eb30c62a7ab12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"df0fbbd3933b738de00eb30c62a7ab12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.280128 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.280014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ed1757eda998924f39fee4dd8c636f2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-137.ec2.internal\" (UID: \"0ed1757eda998924f39fee4dd8c636f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.373119 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.373073    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:18.474062 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.473975    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:18.493542 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.493515    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.497289 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.497269    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:18.574352 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.574297    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:18.674896 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.674851    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:18.775428 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.775355    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:18.831628 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.831605    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:08:18.875839 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.875803    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:18.909789 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.909764    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 20:08:18.910136 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.909925    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 20:08:18.910136 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:18.909954    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 20:08:18.976396 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:18.976363    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:19.013129 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.013080    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 20:03:18 +0000 UTC" deadline="2028-04-06 20:52:48.154108358 +0000 UTC"
Jul 28 20:08:19.013129 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.013126    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14832h44m29.140986025s"
Jul 28 20:08:19.049113 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.049030    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:08:19.077075 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:19.077049    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found"
Jul 28 20:08:19.144801 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.144761    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:08:19.145881 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.145865    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:08:19.145948 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.145899    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:08:19.145948 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.145913    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:08:19.174372 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.174349    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:08:19.177213 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.177199    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:19.187968 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.187941    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 20:08:19.190028 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.190013    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal"
Jul 28 20:08:19.203911 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.203887    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 20:08:19.358826 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:19.358782    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0fbbd3933b738de00eb30c62a7ab12.slice/crio-c7e1ee111c3d707fb6e1da7476b69f84d994a596ce4537a5cac821fade8db0cd WatchSource:0}: Error finding container c7e1ee111c3d707fb6e1da7476b69f84d994a596ce4537a5cac821fade8db0cd: Status 404 returned error can't find the container with id c7e1ee111c3d707fb6e1da7476b69f84d994a596ce4537a5cac821fade8db0cd
Jul 28 20:08:19.363321 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.363306    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:08:19.605874 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:19.605843    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed1757eda998924f39fee4dd8c636f2.slice/crio-4a181a4e2ef9f307056272fbdba9c2cc17b66bb7431096cc3f33f26fb2ff5aba WatchSource:0}: Error finding container 4a181a4e2ef9f307056272fbdba9c2cc17b66bb7431096cc3f33f26fb2ff5aba: Status 404 returned error can't find the container with id 4a181a4e2ef9f307056272fbdba9c2cc17b66bb7431096cc3f33f26fb2ff5aba
Jul 28 20:08:19.952592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.952497    2561 apiserver.go:52] "Watching apiserver"
Jul 28 20:08:19.960982 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.960954    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 20:08:19.961354 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.961332    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-z45h6","kube-system/global-pull-secret-syncer-8nzjj","kube-system/konnectivity-agent-p858f","kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ljl59","openshift-dns/node-resolver-8w5cw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal","openshift-multus/multus-additional-cni-plugins-k7frw","openshift-multus/network-metrics-daemon-jgs7w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv","openshift-image-registry/node-ca-dkw2x","openshift-multus/multus-q9d8g","openshift-network-diagnostics/network-check-target-lh75w","openshift-network-operator/iptables-alerter-d6hth"]
Jul 28 20:08:19.964293 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.964279    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:19.964367 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:19.964349    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:19.966479 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.966463    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:19.966530 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:19.966514    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:19.968659 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.968641    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:19.971067 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.971033    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.971216 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.971193    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 20:08:19.971383 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.971197    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5s7cb\""
Jul 28 20:08:19.971458 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.971188    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 20:08:19.973009 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.972988    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 20:08:19.973113 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.973097    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 20:08:19.973579 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.973556    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.974492 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.974472    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8fwkt\""
Jul 28 20:08:19.974595 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.974540    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 20:08:19.974595 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.974567    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 20:08:19.974804 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.974788    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 20:08:19.974869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.974814    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 20:08:19.975989 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.975971    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:19.976426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.976215    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hpzgr\""
Jul 28 20:08:19.976426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.976222    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:08:19.976426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.976353    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 20:08:19.977618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.977602    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 20:08:19.978304 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.978287    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 20:08:19.978304 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.978294    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cr9z2\""
Jul 28 20:08:19.978463 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.978379    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:19.978609 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.978589    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 20:08:19.980672 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.980645    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:08:19.980672 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.980656    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 20:08:19.980835 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.980722    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j226p\""
Jul 28 20:08:19.980835 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.980751    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 20:08:19.980949 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.980935    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:19.983446 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.983429    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 20:08:19.983446 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.983444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:19.983595 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:19.983517    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:19.984176 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.984161    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 20:08:19.984221 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.984183    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 20:08:19.984955 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.984941    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7l6gm\""
Jul 28 20:08:19.985020 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.984972    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 20:08:19.985020 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.984973    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 20:08:19.986038 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.986025    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:19.988416 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988397    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 20:08:19.988505 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988437    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 20:08:19.988567 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988540    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:19.988567 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988547    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 20:08:19.988671 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988651    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rrvs7\""
Jul 28 20:08:19.988790 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.988862 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988807    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-var-lib-kubelet\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.988862 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988835    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c46d24d-41b9-4198-816c-1432051989e5-tmp\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.988966 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/600e31fe-6857-4497-8fc5-376fa127489f-kubelet-config\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:19.988966 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988917    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-run-netns\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.988966 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-run-systemd\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.988966 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-cni-netd\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.989146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.988981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0db88144-8d8b-4314-913c-5493b15e41a3-iptables-alerter-script\") pod \"iptables-alerter-d6hth\" (UID: \"0db88144-8d8b-4314-913c-5493b15e41a3\") " pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:19.989146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.989025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npfqg\" (UniqueName: \"kubernetes.io/projected/0db88144-8d8b-4314-913c-5493b15e41a3-kube-api-access-npfqg\") pod \"iptables-alerter-d6hth\" (UID: \"0db88144-8d8b-4314-913c-5493b15e41a3\") " pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:19.989146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.989065    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-kubelet\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.989146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.989086    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-var-lib-openvswitch\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.989146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.989109    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-etc-openvswitch\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.989146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.989135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82jxw\" (UniqueName: \"kubernetes.io/projected/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-kube-api-access-82jxw\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-sys\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990103    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-lib-modules\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c46d24d-41b9-4198-816c-1432051989e5-etc-tuned\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990178    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ac67f8d-9601-4ea3-b073-2acf0ab559be-hosts-file\") pod \"node-resolver-8w5cw\" (UID: \"6ac67f8d-9601-4ea3-b073-2acf0ab559be\") " pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990209    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-env-overrides\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-sysconfig\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-run\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac67f8d-9601-4ea3-b073-2acf0ab559be-tmp-dir\") pod \"node-resolver-8w5cw\" (UID: \"6ac67f8d-9601-4ea3-b073-2acf0ab559be\") " pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990408    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/600e31fe-6857-4497-8fc5-376fa127489f-dbus\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990448    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-run-openvswitch\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.991006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.990919    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-kubernetes\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-sysctl-conf\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4163e0d8-9bf6-4df2-8d9a-35a75d8414c3-agent-certs\") pod \"konnectivity-agent-p858f\" (UID: \"4163e0d8-9bf6-4df2-8d9a-35a75d8414c3\") " pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-sysctl-d\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991195    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-run-ovn\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-node-log\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-ovn-node-metrics-cert\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991426    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-host\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7hph\" (UniqueName: \"kubernetes.io/projected/9c46d24d-41b9-4198-816c-1432051989e5-kube-api-access-l7hph\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcsbg\" (UniqueName: \"kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg\") pod \"network-check-target-lh75w\" (UID: \"01feb305-3c2b-4e29-a68c-ec74c2947625\") " pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-systemd-units\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.991654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-slash\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991663    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-log-socket\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-cni-bin\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-ovnkube-config\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991765    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-ovnkube-script-lib\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-systemd\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991828    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8r9s\" (UniqueName: \"kubernetes.io/projected/6ac67f8d-9601-4ea3-b073-2acf0ab559be-kube-api-access-f8r9s\") pod \"node-resolver-8w5cw\" (UID: \"6ac67f8d-9601-4ea3-b073-2acf0ab559be\") " pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-modprobe-d\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0db88144-8d8b-4314-913c-5493b15e41a3-host-slash\") pod \"iptables-alerter-d6hth\" (UID: \"0db88144-8d8b-4314-913c-5493b15e41a3\") " pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.991987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4163e0d8-9bf6-4df2-8d9a-35a75d8414c3-konnectivity-ca\") pod \"konnectivity-agent-p858f\" (UID: \"4163e0d8-9bf6-4df2-8d9a-35a75d8414c3\") " pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.992020    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:19.992188 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.992055    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:19.992738 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.992438    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 20:08:19.992738 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.992566    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 20:08:19.992900 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.992887    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2zdx\""
Jul 28 20:08:19.992965 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.992944    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 20:08:19.994904 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.994882    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 20:08:19.995011 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.994890    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dhxpz\""
Jul 28 20:08:19.995395 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:19.995371    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 20:08:20.022014 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.021995    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-drtbj"
Jul 28 20:08:20.032306 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.032281    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-drtbj"
Jul 28 20:08:20.074472 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.074423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" event={"ID":"df0fbbd3933b738de00eb30c62a7ab12","Type":"ContainerStarted","Data":"c7e1ee111c3d707fb6e1da7476b69f84d994a596ce4537a5cac821fade8db0cd"}
Jul 28 20:08:20.075422 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.075399    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" event={"ID":"0ed1757eda998924f39fee4dd8c636f2","Type":"ContainerStarted","Data":"4a181a4e2ef9f307056272fbdba9c2cc17b66bb7431096cc3f33f26fb2ff5aba"}
Jul 28 20:08:20.079120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.079103    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 20:08:20.092486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-modprobe-d\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.092640 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092494    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.092640 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad6e3524-1485-4c8c-a362-e07e9592f705-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.092640 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j74hc\" (UniqueName: \"kubernetes.io/projected/ad6e3524-1485-4c8c-a362-e07e9592f705-kube-api-access-j74hc\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.092640 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wddjg\" (UniqueName: \"kubernetes.io/projected/d2581e4e-d2dd-4022-bf6a-669145444f0f-kube-api-access-wddjg\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:20.092640 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092613    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.092640 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04b71894-3481-4701-b281-895f305778ed-host\") pod \"node-ca-dkw2x\" (UID: \"04b71894-3481-4701-b281-895f305778ed\") " pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092663    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmsgx\" (UniqueName: \"kubernetes.io/projected/04b71894-3481-4701-b281-895f305778ed-kube-api-access-qmsgx\") pod \"node-ca-dkw2x\" (UID: \"04b71894-3481-4701-b281-895f305778ed\") " pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-cni-netd\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092688    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-modprobe-d\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad6e3524-1485-4c8c-a362-e07e9592f705-cni-binary-copy\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-cni-netd\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092800    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-device-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-kubelet\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-kubelet\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-var-lib-openvswitch\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.092980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.092967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c46d24d-41b9-4198-816c-1432051989e5-etc-tuned\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093035    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-var-lib-openvswitch\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ac67f8d-9601-4ea3-b073-2acf0ab559be-hosts-file\") pod \"node-resolver-8w5cw\" (UID: \"6ac67f8d-9601-4ea3-b073-2acf0ab559be\") " pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093116    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-run-multus-certs\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-sysconfig\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093207    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-run\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093212    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ac67f8d-9601-4ea3-b073-2acf0ab559be-hosts-file\") pod \"node-resolver-8w5cw\" (UID: \"6ac67f8d-9601-4ea3-b073-2acf0ab559be\") " pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-socket-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-cnibin\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093351    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-sysconfig\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093368    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-run\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-run-netns\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093361    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093412    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-var-lib-cni-bin\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.093541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-etc-kubernetes\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-run-openvswitch\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-kubernetes\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-sysctl-conf\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4163e0d8-9bf6-4df2-8d9a-35a75d8414c3-agent-certs\") pod \"konnectivity-agent-p858f\" (UID: \"4163e0d8-9bf6-4df2-8d9a-35a75d8414c3\") " pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-kubernetes\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz56z\" (UniqueName: \"kubernetes.io/projected/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-kube-api-access-dz56z\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093621    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-var-lib-cni-multus\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093631    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-run-openvswitch\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-node-log\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7hph\" (UniqueName: \"kubernetes.io/projected/9c46d24d-41b9-4198-816c-1432051989e5-kube-api-access-l7hph\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-node-log\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/600e31fe-6857-4497-8fc5-376fa127489f-kubelet-config\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04b71894-3481-4701-b281-895f305778ed-serviceca\") pod \"node-ca-dkw2x\" (UID: \"04b71894-3481-4701-b281-895f305778ed\") " pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093776    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-systemd-units\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-slash\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.094296 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-log-socket\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-cni-bin\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-ovnkube-config\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-systemd\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8r9s\" (UniqueName: \"kubernetes.io/projected/6ac67f8d-9601-4ea3-b073-2acf0ab559be-kube-api-access-f8r9s\") pod \"node-resolver-8w5cw\" (UID: \"6ac67f8d-9601-4ea3-b073-2acf0ab559be\") " pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.093972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4163e0d8-9bf6-4df2-8d9a-35a75d8414c3-konnectivity-ca\") pod \"konnectivity-agent-p858f\" (UID: \"4163e0d8-9bf6-4df2-8d9a-35a75d8414c3\") " pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-system-cni-dir\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-cnibin\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/600e31fe-6857-4497-8fc5-376fa127489f-kubelet-config\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-system-cni-dir\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094091    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-sysctl-conf\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-var-lib-kubelet\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-systemd-units\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpkrh\" (UniqueName: \"kubernetes.io/projected/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-kube-api-access-hpkrh\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-log-socket\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-var-lib-kubelet\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-cni-bin\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.095112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c46d24d-41b9-4198-816c-1432051989e5-tmp\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-registration-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-run-netns\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-run-systemd\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094344    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0db88144-8d8b-4314-913c-5493b15e41a3-iptables-alerter-script\") pod \"iptables-alerter-d6hth\" (UID: \"0db88144-8d8b-4314-913c-5493b15e41a3\") " pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npfqg\" (UniqueName: \"kubernetes.io/projected/0db88144-8d8b-4314-913c-5493b15e41a3-kube-api-access-npfqg\") pod \"iptables-alerter-d6hth\" (UID: \"0db88144-8d8b-4314-913c-5493b15e41a3\") " pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094400    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-run-k8s-cni-cncf-io\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094402    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-slash\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-conf-dir\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094466    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-etc-openvswitch\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82jxw\" (UniqueName: \"kubernetes.io/projected/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-kube-api-access-82jxw\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094499    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-var-lib-kubelet\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-sys\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-lib-modules\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-ovnkube-config\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094840    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-systemd\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094877    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-run-systemd\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.096676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.094919    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-sys\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095009    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-host-run-netns\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095264    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-env-overrides\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095300    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac67f8d-9601-4ea3-b073-2acf0ab559be-tmp-dir\") pod \"node-resolver-8w5cw\" (UID: \"6ac67f8d-9601-4ea3-b073-2acf0ab559be\") " pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095349    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-etc-openvswitch\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095376    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0db88144-8d8b-4314-913c-5493b15e41a3-iptables-alerter-script\") pod \"iptables-alerter-d6hth\" (UID: \"0db88144-8d8b-4314-913c-5493b15e41a3\") " pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/600e31fe-6857-4497-8fc5-376fa127489f-dbus\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad6e3524-1485-4c8c-a362-e07e9592f705-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095480    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-lib-modules\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-socket-dir-parent\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-cni-binary-copy\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095565    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/600e31fe-6857-4497-8fc5-376fa127489f-dbus\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-sysctl-d\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095622    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ac67f8d-9601-4ea3-b073-2acf0ab559be-tmp-dir\") pod \"node-resolver-8w5cw\" (UID: \"6ac67f8d-9601-4ea3-b073-2acf0ab559be\") " pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4163e0d8-9bf6-4df2-8d9a-35a75d8414c3-konnectivity-ca\") pod \"konnectivity-agent-p858f\" (UID: \"4163e0d8-9bf6-4df2-8d9a-35a75d8414c3\") " pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-run-ovn\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095682    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-etc-sysctl-d\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.097619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-ovn-node-metrics-cert\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-env-overrides\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095726    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-run-ovn\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-host\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.095820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcsbg\" (UniqueName: \"kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg\") pod \"network-check-target-lh75w\" (UID: \"01feb305-3c2b-4e29-a68c-ec74c2947625\") " pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096032    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-os-release\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096077    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-cni-dir\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-ovnkube-script-lib\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0db88144-8d8b-4314-913c-5493b15e41a3-host-slash\") pod \"iptables-alerter-d6hth\" (UID: \"0db88144-8d8b-4314-913c-5493b15e41a3\") " pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0db88144-8d8b-4314-913c-5493b15e41a3-host-slash\") pod \"iptables-alerter-d6hth\" (UID: \"0db88144-8d8b-4314-913c-5493b15e41a3\") " pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.096338    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.096418    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret podName:600e31fe-6857-4497-8fc5-376fa127489f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:20.596387384 +0000 UTC m=+2.993090545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret") pod "global-pull-secret-syncer-8nzjj" (UID: "600e31fe-6857-4497-8fc5-376fa127489f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096594    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-sys-fs\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096621    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-os-release\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-hostroot\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-daemon-config\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.098512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096728    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-ovnkube-script-lib\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.099199 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.096817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c46d24d-41b9-4198-816c-1432051989e5-host\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.099199 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.097929    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c46d24d-41b9-4198-816c-1432051989e5-tmp\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.099199 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.098052    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c46d24d-41b9-4198-816c-1432051989e5-etc-tuned\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.099199 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.098168    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4163e0d8-9bf6-4df2-8d9a-35a75d8414c3-agent-certs\") pod \"konnectivity-agent-p858f\" (UID: \"4163e0d8-9bf6-4df2-8d9a-35a75d8414c3\") " pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:20.099199 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.098389    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-ovn-node-metrics-cert\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.102334 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.102299    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:08:20.102334 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.102325    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:08:20.102334 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.102341    2561 projected.go:196] Error preparing data for projected volume kube-api-access-lcsbg for pod openshift-network-diagnostics/network-check-target-lh75w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:20.102562 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.102406    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg podName:01feb305-3c2b-4e29-a68c-ec74c2947625 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:20.602386467 +0000 UTC m=+2.999089625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lcsbg" (UniqueName: "kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg") pod "network-check-target-lh75w" (UID: "01feb305-3c2b-4e29-a68c-ec74c2947625") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:20.103621 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.103599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7hph\" (UniqueName: \"kubernetes.io/projected/9c46d24d-41b9-4198-816c-1432051989e5-kube-api-access-l7hph\") pod \"tuned-ljl59\" (UID: \"9c46d24d-41b9-4198-816c-1432051989e5\") " pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.104181 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.104014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npfqg\" (UniqueName: \"kubernetes.io/projected/0db88144-8d8b-4314-913c-5493b15e41a3-kube-api-access-npfqg\") pod \"iptables-alerter-d6hth\" (UID: \"0db88144-8d8b-4314-913c-5493b15e41a3\") " pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:20.104181 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.104067    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8r9s\" (UniqueName: \"kubernetes.io/projected/6ac67f8d-9601-4ea3-b073-2acf0ab559be-kube-api-access-f8r9s\") pod \"node-resolver-8w5cw\" (UID: \"6ac67f8d-9601-4ea3-b073-2acf0ab559be\") " pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:20.104609 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.104593    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82jxw\" (UniqueName: \"kubernetes.io/projected/c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea-kube-api-access-82jxw\") pod \"ovnkube-node-z45h6\" (UID: \"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.197221 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04b71894-3481-4701-b281-895f305778ed-serviceca\") pod \"node-ca-dkw2x\" (UID: \"04b71894-3481-4701-b281-895f305778ed\") " pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:20.197424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-system-cni-dir\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.197424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-cnibin\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.197424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197305    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-system-cni-dir\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-var-lib-kubelet\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpkrh\" (UniqueName: \"kubernetes.io/projected/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-kube-api-access-hpkrh\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-registration-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.197424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-run-k8s-cni-cncf-io\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-conf-dir\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad6e3524-1485-4c8c-a362-e07e9592f705-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-socket-dir-parent\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197512    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-cni-binary-copy\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-os-release\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197602    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-cni-dir\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-sys-fs\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-os-release\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-hostroot\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197704    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-run-k8s-cni-cncf-io\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-daemon-config\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197744    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-system-cni-dir\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad6e3524-1485-4c8c-a362-e07e9592f705-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197778    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-cnibin\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j74hc\" (UniqueName: \"kubernetes.io/projected/ad6e3524-1485-4c8c-a362-e07e9592f705-kube-api-access-j74hc\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wddjg\" (UniqueName: \"kubernetes.io/projected/d2581e4e-d2dd-4022-bf6a-669145444f0f-kube-api-access-wddjg\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-system-cni-dir\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.197858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197831    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04b71894-3481-4701-b281-895f305778ed-host\") pod \"node-ca-dkw2x\" (UID: \"04b71894-3481-4701-b281-895f305778ed\") " pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197837    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-var-lib-kubelet\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmsgx\" (UniqueName: \"kubernetes.io/projected/04b71894-3481-4701-b281-895f305778ed-kube-api-access-qmsgx\") pod \"node-ca-dkw2x\" (UID: \"04b71894-3481-4701-b281-895f305778ed\") " pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad6e3524-1485-4c8c-a362-e07e9592f705-cni-binary-copy\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-device-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-run-multus-certs\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198085    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-registration-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198100    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-socket-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-cnibin\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-run-netns\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-var-lib-cni-bin\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198207    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-etc-kubernetes\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz56z\" (UniqueName: \"kubernetes.io/projected/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-kube-api-access-dz56z\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.198721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-var-lib-cni-multus\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198421    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-os-release\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-var-lib-cni-multus\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198480    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-conf-dir\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198607    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-daemon-config\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-cni-dir\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-sys-fs\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198800    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-os-release\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.197662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04b71894-3481-4701-b281-895f305778ed-serviceca\") pod \"node-ca-dkw2x\" (UID: \"04b71894-3481-4701-b281-895f305778ed\") " pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-hostroot\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198914    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-multus-socket-dir-parent\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198933    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04b71894-3481-4701-b281-895f305778ed-host\") pod \"node-ca-dkw2x\" (UID: \"04b71894-3481-4701-b281-895f305778ed\") " pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198961    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-run-multus-certs\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.198986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad6e3524-1485-4c8c-a362-e07e9592f705-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199068    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-socket-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-cnibin\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-run-netns\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-host-var-lib-cni-bin\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.199699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-etc-kubernetes\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.200728 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad6e3524-1485-4c8c-a362-e07e9592f705-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.200728 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199489    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad6e3524-1485-4c8c-a362-e07e9592f705-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.200728 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad6e3524-1485-4c8c-a362-e07e9592f705-cni-binary-copy\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.200728 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.199694    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:20.200728 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.200728 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.199759    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs podName:d2581e4e-d2dd-4022-bf6a-669145444f0f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:20.699741215 +0000 UTC m=+3.096444351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs") pod "network-metrics-daemon-jgs7w" (UID: "d2581e4e-d2dd-4022-bf6a-669145444f0f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:20.200728 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199760    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.200728 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.199688    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-device-dir\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.200728 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.200610    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-cni-binary-copy\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.207209 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.207132    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpkrh\" (UniqueName: \"kubernetes.io/projected/ca6149a8-2b42-4ed4-a70d-f1dc111f9572-kube-api-access-hpkrh\") pod \"multus-q9d8g\" (UID: \"ca6149a8-2b42-4ed4-a70d-f1dc111f9572\") " pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.207389 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.207240    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j74hc\" (UniqueName: \"kubernetes.io/projected/ad6e3524-1485-4c8c-a362-e07e9592f705-kube-api-access-j74hc\") pod \"multus-additional-cni-plugins-k7frw\" (UID: \"ad6e3524-1485-4c8c-a362-e07e9592f705\") " pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.207389 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.207243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wddjg\" (UniqueName: \"kubernetes.io/projected/d2581e4e-d2dd-4022-bf6a-669145444f0f-kube-api-access-wddjg\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:20.212083 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.212054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz56z\" (UniqueName: \"kubernetes.io/projected/40273d5a-9cdf-437d-a9a9-1d060a4aba8b-kube-api-access-dz56z\") pod \"aws-ebs-csi-driver-node-mwktv\" (UID: \"40273d5a-9cdf-437d-a9a9-1d060a4aba8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.212229 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.212064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmsgx\" (UniqueName: \"kubernetes.io/projected/04b71894-3481-4701-b281-895f305778ed-kube-api-access-qmsgx\") pod \"node-ca-dkw2x\" (UID: \"04b71894-3481-4701-b281-895f305778ed\") " pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:20.280105 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.280065    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:20.286840 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.286811    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:20.296915 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.296845    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ljl59"
Jul 28 20:08:20.300373 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:20.300340    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f7f1c9_e0f7_44e4_bf7d_1166ff0df8ea.slice/crio-909c7344ec7df4ad6682a7a041d868aa3f49f352da67a1dbdf508a9b9af72b59 WatchSource:0}: Error finding container 909c7344ec7df4ad6682a7a041d868aa3f49f352da67a1dbdf508a9b9af72b59: Status 404 returned error can't find the container with id 909c7344ec7df4ad6682a7a041d868aa3f49f352da67a1dbdf508a9b9af72b59
Jul 28 20:08:20.301537 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.301465    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8w5cw"
Jul 28 20:08:20.307706 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.307667    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d6hth"
Jul 28 20:08:20.309119 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:20.309092    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c46d24d_41b9_4198_816c_1432051989e5.slice/crio-3e77bd146a97d957977fb2078483a804edea3868470febfb108fdaa0bf9aae77 WatchSource:0}: Error finding container 3e77bd146a97d957977fb2078483a804edea3868470febfb108fdaa0bf9aae77: Status 404 returned error can't find the container with id 3e77bd146a97d957977fb2078483a804edea3868470febfb108fdaa0bf9aae77
Jul 28 20:08:20.313006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.312797    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k7frw"
Jul 28 20:08:20.314044 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:20.314005    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac67f8d_9601_4ea3_b073_2acf0ab559be.slice/crio-8c34b98670c39c4904f73f668b0f954c360643469f8280bc595db9b0e071e456 WatchSource:0}: Error finding container 8c34b98670c39c4904f73f668b0f954c360643469f8280bc595db9b0e071e456: Status 404 returned error can't find the container with id 8c34b98670c39c4904f73f668b0f954c360643469f8280bc595db9b0e071e456
Jul 28 20:08:20.319107 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.319049    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv"
Jul 28 20:08:20.322201 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:20.322010    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db88144_8d8b_4314_913c_5493b15e41a3.slice/crio-1b41c7ced2304016033f28fe7eea9241328afc5ddaad03e8562a572418dd31b2 WatchSource:0}: Error finding container 1b41c7ced2304016033f28fe7eea9241328afc5ddaad03e8562a572418dd31b2: Status 404 returned error can't find the container with id 1b41c7ced2304016033f28fe7eea9241328afc5ddaad03e8562a572418dd31b2
Jul 28 20:08:20.323793 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.323770    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dkw2x"
Jul 28 20:08:20.325953 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:20.325929    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6e3524_1485_4c8c_a362_e07e9592f705.slice/crio-3016c32baeec020764ea51ccca1696c5e88b7efbbee8a071f15814e294dba07b WatchSource:0}: Error finding container 3016c32baeec020764ea51ccca1696c5e88b7efbbee8a071f15814e294dba07b: Status 404 returned error can't find the container with id 3016c32baeec020764ea51ccca1696c5e88b7efbbee8a071f15814e294dba07b
Jul 28 20:08:20.328229 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.328205    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q9d8g"
Jul 28 20:08:20.336319 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:20.336280    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40273d5a_9cdf_437d_a9a9_1d060a4aba8b.slice/crio-2fccbf6b89b3a9053a5e3c20533caadc5a01974df65ce7df145d9c4fb23fd489 WatchSource:0}: Error finding container 2fccbf6b89b3a9053a5e3c20533caadc5a01974df65ce7df145d9c4fb23fd489: Status 404 returned error can't find the container with id 2fccbf6b89b3a9053a5e3c20533caadc5a01974df65ce7df145d9c4fb23fd489
Jul 28 20:08:20.337398 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:20.337372    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b71894_3481_4701_b281_895f305778ed.slice/crio-6f29cdf9ddea96a181a2f6d4a619a9ed8a967928410d6acef7da23cc0bd2d228 WatchSource:0}: Error finding container 6f29cdf9ddea96a181a2f6d4a619a9ed8a967928410d6acef7da23cc0bd2d228: Status 404 returned error can't find the container with id 6f29cdf9ddea96a181a2f6d4a619a9ed8a967928410d6acef7da23cc0bd2d228
Jul 28 20:08:20.344603 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:20.344580    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6149a8_2b42_4ed4_a70d_f1dc111f9572.slice/crio-e1a01b15534f7bd093e88114d20ebd9180c9a4d31930e95594cc7a0740eb6da5 WatchSource:0}: Error finding container e1a01b15534f7bd093e88114d20ebd9180c9a4d31930e95594cc7a0740eb6da5: Status 404 returned error can't find the container with id e1a01b15534f7bd093e88114d20ebd9180c9a4d31930e95594cc7a0740eb6da5
Jul 28 20:08:20.411219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.411188    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:08:20.600460 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.600369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:20.600619 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.600572    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:20.600680 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.600660    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret podName:600e31fe-6857-4497-8fc5-376fa127489f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:21.60063795 +0000 UTC m=+3.997341103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret") pod "global-pull-secret-syncer-8nzjj" (UID: "600e31fe-6857-4497-8fc5-376fa127489f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:20.700765 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.700726    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcsbg\" (UniqueName: \"kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg\") pod \"network-check-target-lh75w\" (UID: \"01feb305-3c2b-4e29-a68c-ec74c2947625\") " pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:20.700947 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:20.700798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:20.701004 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.700944    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:20.701047 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.701005    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs podName:d2581e4e-d2dd-4022-bf6a-669145444f0f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:21.700987244 +0000 UTC m=+4.097690382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs") pod "network-metrics-daemon-jgs7w" (UID: "d2581e4e-d2dd-4022-bf6a-669145444f0f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:20.701364 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.701338    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:08:20.701467 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.701367    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:08:20.701467 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.701381    2561 projected.go:196] Error preparing data for projected volume kube-api-access-lcsbg for pod openshift-network-diagnostics/network-check-target-lh75w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:20.701467 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:20.701439    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg podName:01feb305-3c2b-4e29-a68c-ec74c2947625 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:21.701423608 +0000 UTC m=+4.098126759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcsbg" (UniqueName: "kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg") pod "network-check-target-lh75w" (UID: "01feb305-3c2b-4e29-a68c-ec74c2947625") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:21.036042 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.035943    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 20:03:20 +0000 UTC" deadline="2028-04-21 23:04:46.813261144 +0000 UTC"
Jul 28 20:08:21.036042 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.035984    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15194h56m25.777282272s"
Jul 28 20:08:21.079678 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.079642    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ljl59" event={"ID":"9c46d24d-41b9-4198-816c-1432051989e5","Type":"ContainerStarted","Data":"3e77bd146a97d957977fb2078483a804edea3868470febfb108fdaa0bf9aae77"}
Jul 28 20:08:21.081201 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.081174    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p858f" event={"ID":"4163e0d8-9bf6-4df2-8d9a-35a75d8414c3","Type":"ContainerStarted","Data":"b00556f8d0afe8816ac986e01bddaad3325d22765b98b0002503b03d6a8f0903"}
Jul 28 20:08:21.082525 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.082505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d6hth" event={"ID":"0db88144-8d8b-4314-913c-5493b15e41a3","Type":"ContainerStarted","Data":"1b41c7ced2304016033f28fe7eea9241328afc5ddaad03e8562a572418dd31b2"}
Jul 28 20:08:21.084334 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.084312    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6" event={"ID":"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea","Type":"ContainerStarted","Data":"909c7344ec7df4ad6682a7a041d868aa3f49f352da67a1dbdf508a9b9af72b59"}
Jul 28 20:08:21.086332 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.086300    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q9d8g" event={"ID":"ca6149a8-2b42-4ed4-a70d-f1dc111f9572","Type":"ContainerStarted","Data":"e1a01b15534f7bd093e88114d20ebd9180c9a4d31930e95594cc7a0740eb6da5"}
Jul 28 20:08:21.087675 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.087653    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dkw2x" event={"ID":"04b71894-3481-4701-b281-895f305778ed","Type":"ContainerStarted","Data":"6f29cdf9ddea96a181a2f6d4a619a9ed8a967928410d6acef7da23cc0bd2d228"}
Jul 28 20:08:21.089162 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.089138    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv" event={"ID":"40273d5a-9cdf-437d-a9a9-1d060a4aba8b","Type":"ContainerStarted","Data":"2fccbf6b89b3a9053a5e3c20533caadc5a01974df65ce7df145d9c4fb23fd489"}
Jul 28 20:08:21.090526 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.090502    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7frw" event={"ID":"ad6e3524-1485-4c8c-a362-e07e9592f705","Type":"ContainerStarted","Data":"3016c32baeec020764ea51ccca1696c5e88b7efbbee8a071f15814e294dba07b"}
Jul 28 20:08:21.091713 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.091694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8w5cw" event={"ID":"6ac67f8d-9601-4ea3-b073-2acf0ab559be","Type":"ContainerStarted","Data":"8c34b98670c39c4904f73f668b0f954c360643469f8280bc595db9b0e071e456"}
Jul 28 20:08:21.608504 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.608451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:21.608692 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:21.608615    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:21.608692 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:21.608685    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret podName:600e31fe-6857-4497-8fc5-376fa127489f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:23.608667043 +0000 UTC m=+6.005370178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret") pod "global-pull-secret-syncer-8nzjj" (UID: "600e31fe-6857-4497-8fc5-376fa127489f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:21.709602 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.709563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcsbg\" (UniqueName: \"kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg\") pod \"network-check-target-lh75w\" (UID: \"01feb305-3c2b-4e29-a68c-ec74c2947625\") " pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:21.709787 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.709645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:21.709787 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:21.709776    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:21.709903 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:21.709838    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs podName:d2581e4e-d2dd-4022-bf6a-669145444f0f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:23.709819357 +0000 UTC m=+6.106522543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs") pod "network-metrics-daemon-jgs7w" (UID: "d2581e4e-d2dd-4022-bf6a-669145444f0f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:21.710254 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:21.710220    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:08:21.710352 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:21.710312    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:08:21.710352 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:21.710328    2561 projected.go:196] Error preparing data for projected volume kube-api-access-lcsbg for pod openshift-network-diagnostics/network-check-target-lh75w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:21.710459 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:21.710383    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg podName:01feb305-3c2b-4e29-a68c-ec74c2947625 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:23.710366711 +0000 UTC m=+6.107069848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcsbg" (UniqueName: "kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg") pod "network-check-target-lh75w" (UID: "01feb305-3c2b-4e29-a68c-ec74c2947625") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:21.942130 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:21.942051    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:08:22.036726 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:22.036639    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 20:03:20 +0000 UTC" deadline="2028-01-13 02:25:52.403498015 +0000 UTC"
Jul 28 20:08:22.036726 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:22.036694    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12798h17m30.366808884s"
Jul 28 20:08:22.072738 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:22.072427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:22.072738 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:22.072559    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:22.073361 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:22.073032    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:22.073361 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:22.073138    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:22.073361 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:22.073213    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:22.073361 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:22.073321    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:23.628328 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:23.628290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:23.628865 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:23.628457    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:23.628865 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:23.628521    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret podName:600e31fe-6857-4497-8fc5-376fa127489f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:27.628503162 +0000 UTC m=+10.025206299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret") pod "global-pull-secret-syncer-8nzjj" (UID: "600e31fe-6857-4497-8fc5-376fa127489f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:23.728775 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:23.728736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:23.728964 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:23.728824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcsbg\" (UniqueName: \"kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg\") pod \"network-check-target-lh75w\" (UID: \"01feb305-3c2b-4e29-a68c-ec74c2947625\") " pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:23.729025 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:23.728973    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:08:23.729025 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:23.728991    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:08:23.729025 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:23.729006    2561 projected.go:196] Error preparing data for projected volume kube-api-access-lcsbg for pod openshift-network-diagnostics/network-check-target-lh75w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:23.729171 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:23.729062    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg podName:01feb305-3c2b-4e29-a68c-ec74c2947625 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:27.729044346 +0000 UTC m=+10.125747493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcsbg" (UniqueName: "kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg") pod "network-check-target-lh75w" (UID: "01feb305-3c2b-4e29-a68c-ec74c2947625") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:23.729171 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:23.729129    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:23.729171 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:23.729162    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs podName:d2581e4e-d2dd-4022-bf6a-669145444f0f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:27.729150244 +0000 UTC m=+10.125853379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs") pod "network-metrics-daemon-jgs7w" (UID: "d2581e4e-d2dd-4022-bf6a-669145444f0f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:24.071407 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:24.071331    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:24.071565 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:24.071454    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:24.071911 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:24.071891    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:24.072005 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:24.071978    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:24.072366 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:24.072149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:24.072366 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:24.072287    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:26.071594 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:26.071553    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:26.071992 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:26.071696    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:26.072070 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:26.072041    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:26.073572 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:26.072125    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:26.073572 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:26.073381    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:26.073572 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:26.073462    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:27.664849 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:27.664803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:27.665341 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:27.665058    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:27.665341 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:27.665132    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret podName:600e31fe-6857-4497-8fc5-376fa127489f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:35.665109363 +0000 UTC m=+18.061812514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret") pod "global-pull-secret-syncer-8nzjj" (UID: "600e31fe-6857-4497-8fc5-376fa127489f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:27.766019 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:27.765977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcsbg\" (UniqueName: \"kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg\") pod \"network-check-target-lh75w\" (UID: \"01feb305-3c2b-4e29-a68c-ec74c2947625\") " pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:27.766210 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:27.766052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:27.766210 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:27.766180    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:27.766342 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:27.766262    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs podName:d2581e4e-d2dd-4022-bf6a-669145444f0f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:35.766225072 +0000 UTC m=+18.162928210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs") pod "network-metrics-daemon-jgs7w" (UID: "d2581e4e-d2dd-4022-bf6a-669145444f0f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:27.766747 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:27.766684    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:08:27.766747 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:27.766708    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:08:27.766747 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:27.766721    2561 projected.go:196] Error preparing data for projected volume kube-api-access-lcsbg for pod openshift-network-diagnostics/network-check-target-lh75w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:27.766944 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:27.766778    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg podName:01feb305-3c2b-4e29-a68c-ec74c2947625 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:35.766761832 +0000 UTC m=+18.163464966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcsbg" (UniqueName: "kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg") pod "network-check-target-lh75w" (UID: "01feb305-3c2b-4e29-a68c-ec74c2947625") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:28.072227 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:28.072137    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:28.072227 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:28.072153    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:28.072422 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:28.072345    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:28.072422 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:28.072359    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:28.072501 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:28.072437    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:28.072566 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:28.072546    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:30.070570 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:30.070536    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:30.070974 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:30.070675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:30.070974 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:30.070782    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:30.070974 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:30.070671    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:30.070974 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:30.070550    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:30.070974 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:30.070902    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:32.070753 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:32.070717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:32.070753 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:32.070749    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:32.071272 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:32.070717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:32.071272 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:32.070847    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:32.071272 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:32.070945    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:32.071272 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:32.071060    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:34.070969 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:34.070939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:34.070969 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:34.070955    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:34.071464 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:34.070939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:34.071464 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:34.071070    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:34.071464 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:34.071188    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:34.071464 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:34.071286    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:35.724290 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:35.724259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:35.724776 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:35.724404    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:35.724776 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:35.724469    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret podName:600e31fe-6857-4497-8fc5-376fa127489f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:51.724452542 +0000 UTC m=+34.121155679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret") pod "global-pull-secret-syncer-8nzjj" (UID: "600e31fe-6857-4497-8fc5-376fa127489f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:35.824996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:35.824961    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcsbg\" (UniqueName: \"kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg\") pod \"network-check-target-lh75w\" (UID: \"01feb305-3c2b-4e29-a68c-ec74c2947625\") " pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:35.824996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:35.825015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:35.825221 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:35.825114    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:35.825221 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:35.825134    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:08:35.825221 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:35.825157    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:08:35.825221 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:35.825168    2561 projected.go:196] Error preparing data for projected volume kube-api-access-lcsbg for pod openshift-network-diagnostics/network-check-target-lh75w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:35.825221 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:35.825175    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs podName:d2581e4e-d2dd-4022-bf6a-669145444f0f nodeName:}" failed. No retries permitted until 2026-07-28 20:08:51.825156445 +0000 UTC m=+34.221859584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs") pod "network-metrics-daemon-jgs7w" (UID: "d2581e4e-d2dd-4022-bf6a-669145444f0f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:35.825221 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:35.825221    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg podName:01feb305-3c2b-4e29-a68c-ec74c2947625 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:51.825202193 +0000 UTC m=+34.221905328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcsbg" (UniqueName: "kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg") pod "network-check-target-lh75w" (UID: "01feb305-3c2b-4e29-a68c-ec74c2947625") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:36.071039 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:36.070947    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:36.071039 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:36.070990    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:36.071274 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:36.070946    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:36.071274 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:36.071076    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:36.071274 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:36.071170    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:36.071395 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:36.071280    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:38.071839 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:38.071577    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:38.072314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:38.071640    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:38.072314 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:38.071929    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:38.072314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:38.071675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:38.072314 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:38.072006    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:38.072314 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:38.072173    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:40.071164 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.070984    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:40.071873 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.070988    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:40.071873 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:40.071248    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:40.071873 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:40.071348    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:40.071873 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.071024    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:40.071873 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:40.071433    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:40.132172 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.132130    2561 generic.go:356] "Generic (PLEG): container finished" podID="df0fbbd3933b738de00eb30c62a7ab12" containerID="711ab25100c61ad4390cfa93052b721e086af114537294656f49f9449d9a26c4" exitCode=0
Jul 28 20:08:40.132349 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.132222    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" event={"ID":"df0fbbd3933b738de00eb30c62a7ab12","Type":"ContainerDied","Data":"711ab25100c61ad4390cfa93052b721e086af114537294656f49f9449d9a26c4"}
Jul 28 20:08:40.135982 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.135955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6" event={"ID":"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea","Type":"ContainerStarted","Data":"c1aade12eb760db9da0649a65bc6d293e2f182c753cf3802a8b76fc633b06f60"}
Jul 28 20:08:40.136081 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.136037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6" event={"ID":"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea","Type":"ContainerStarted","Data":"8c0cef237938d49c6b745a92d108af3308ba5ad1b1a4799538fefacfff8453cd"}
Jul 28 20:08:40.136146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.136083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6" event={"ID":"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea","Type":"ContainerStarted","Data":"e3681e5cba3ea4f00fb399858a180d8cff0586bce26fa8720cf4700c08bbe341"}
Jul 28 20:08:40.136146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.136128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6" event={"ID":"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea","Type":"ContainerStarted","Data":"1e92d772979d4d736a52d6d1067707717cf25548e284fc2a55e9c87e4dc390d9"}
Jul 28 20:08:40.137509 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.137488    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" event={"ID":"0ed1757eda998924f39fee4dd8c636f2","Type":"ContainerStarted","Data":"40c1e800614c5d64463e858202ddfdf982751bf3654d3d63927f0f1bb4cf9cf3"}
Jul 28 20:08:40.138772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.138755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q9d8g" event={"ID":"ca6149a8-2b42-4ed4-a70d-f1dc111f9572","Type":"ContainerStarted","Data":"b2a17bcbf2864f35dee5713958347be4dbda72791fb7de63f0e022da0f4c885b"}
Jul 28 20:08:40.140135 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.140116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dkw2x" event={"ID":"04b71894-3481-4701-b281-895f305778ed","Type":"ContainerStarted","Data":"8d1503f06f626207f9ce642800e284d8ddbfcf61d15f4989a574e5b241919b67"}
Jul 28 20:08:40.141337 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.141319    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv" event={"ID":"40273d5a-9cdf-437d-a9a9-1d060a4aba8b","Type":"ContainerStarted","Data":"e07087199135a842a4a9576103dd8c70afa5a2c905042c1147aa78c7ee8fca93"}
Jul 28 20:08:40.142631 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.142607    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad6e3524-1485-4c8c-a362-e07e9592f705" containerID="afb1e193c4b7be52f92069ed58199211bf36f55ef7c366ed65e132fd17166cef" exitCode=0
Jul 28 20:08:40.142729 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.142648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7frw" event={"ID":"ad6e3524-1485-4c8c-a362-e07e9592f705","Type":"ContainerDied","Data":"afb1e193c4b7be52f92069ed58199211bf36f55ef7c366ed65e132fd17166cef"}
Jul 28 20:08:40.144132 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.144069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8w5cw" event={"ID":"6ac67f8d-9601-4ea3-b073-2acf0ab559be","Type":"ContainerStarted","Data":"0463ef8643419942422d576514bd80e4fe0fd1a700541f7c4e4134bd5fab6d6e"}
Jul 28 20:08:40.145377 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.145356    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ljl59" event={"ID":"9c46d24d-41b9-4198-816c-1432051989e5","Type":"ContainerStarted","Data":"1a7214f3914275438dfc0d0625841457de3a6273b445efef0ec755c9f40a17af"}
Jul 28 20:08:40.146689 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.146671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p858f" event={"ID":"4163e0d8-9bf6-4df2-8d9a-35a75d8414c3","Type":"ContainerStarted","Data":"8eb055d07614092c2671ed8ed0ad7be4012a1d1fda558498ce571713ea7ed9ad"}
Jul 28 20:08:40.159384 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.159338    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" podStartSLOduration=21.159325083 podStartE2EDuration="21.159325083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:40.158800439 +0000 UTC m=+22.555503596" watchObservedRunningTime="2026-07-28 20:08:40.159325083 +0000 UTC m=+22.556028256"
Jul 28 20:08:40.174326 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.174290    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dkw2x" podStartSLOduration=11.524880655 podStartE2EDuration="22.174274449s" totalImagesPullingTime="10.649393794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:40.173878552 +0000 UTC m=+22.570581729" watchObservedRunningTime="2026-07-28 20:08:40.174274449 +0000 UTC m=+22.570977605"
Jul 28 20:08:40.204509 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.204466    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q9d8g" podStartSLOduration=3.230000509 podStartE2EDuration="22.20444775s" totalImagesPullingTime="18.974447241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:40.203833258 +0000 UTC m=+22.600536440" watchObservedRunningTime="2026-07-28 20:08:40.20444775 +0000 UTC m=+22.601150905"
Jul 28 20:08:40.237443 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.235680    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8w5cw" podStartSLOduration=3.258043883 podStartE2EDuration="22.235660174s" totalImagesPullingTime="18.977616291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:40.23478507 +0000 UTC m=+22.631488226" watchObservedRunningTime="2026-07-28 20:08:40.235660174 +0000 UTC m=+22.632363332"
Jul 28 20:08:40.271086 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.271043    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p858f" podStartSLOduration=3.272779656 podStartE2EDuration="22.271026672s" totalImagesPullingTime="18.998247016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:40.270598712 +0000 UTC m=+22.667301869" watchObservedRunningTime="2026-07-28 20:08:40.271026672 +0000 UTC m=+22.667729827"
Jul 28 20:08:40.293944 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:40.293900    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ljl59" podStartSLOduration=3.307662803 podStartE2EDuration="22.293885528s" totalImagesPullingTime="18.986222725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:40.293758945 +0000 UTC m=+22.690462118" watchObservedRunningTime="2026-07-28 20:08:40.293885528 +0000 UTC m=+22.690588685"
Jul 28 20:08:41.151198 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:41.151103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" event={"ID":"df0fbbd3933b738de00eb30c62a7ab12","Type":"ContainerStarted","Data":"4b99c977856c4609235e2e3deb600ca192e1bb44c71f0d5e98987af3702192bd"}
Jul 28 20:08:41.152886 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:41.152858    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d6hth" event={"ID":"0db88144-8d8b-4314-913c-5493b15e41a3","Type":"ContainerStarted","Data":"fe1ce611af5f64687fb3e04d0443cb85b3cd1e044d58e9d0622ac673cd631700"}
Jul 28 20:08:41.156136 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:41.156106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6" event={"ID":"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea","Type":"ContainerStarted","Data":"35c6135a9b82b6571298ed2f589e163757fd4ed20f8c7f301e4d0395f9b873c0"}
Jul 28 20:08:41.156299 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:41.156191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6" event={"ID":"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea","Type":"ContainerStarted","Data":"9870e6c73721e8c853a9331b5058d8271cf27bd10639a522bf45b18ce1f6c801"}
Jul 28 20:08:41.166301 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:41.166257    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" podStartSLOduration=22.166226239 podStartE2EDuration="22.166226239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:41.165928746 +0000 UTC m=+23.562631903" watchObservedRunningTime="2026-07-28 20:08:41.166226239 +0000 UTC m=+23.562929395"
Jul 28 20:08:41.180944 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:41.180879    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d6hth" podStartSLOduration=4.209978402 podStartE2EDuration="23.180858482s" totalImagesPullingTime="18.97088008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:41.180046583 +0000 UTC m=+23.576749758" watchObservedRunningTime="2026-07-28 20:08:41.180858482 +0000 UTC m=+23.577561639"
Jul 28 20:08:41.208026 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:41.208002    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 20:08:42.056939 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:42.056805    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T20:08:41.208020692Z","UUID":"bac1e51a-3262-4fa6-a8c5-ac47642c2f35","Handler":null,"Name":"","Endpoint":""}
Jul 28 20:08:42.058530 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:42.058505    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 20:08:42.058637 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:42.058551    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 20:08:42.071142 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:42.071116    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:42.071302 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:42.071124    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:42.071302 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:42.071259    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:42.071423 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:42.071379    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:42.071423 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:42.071411    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:42.071499 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:42.071463    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:42.160143 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:42.160105    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv" event={"ID":"40273d5a-9cdf-437d-a9a9-1d060a4aba8b","Type":"ContainerStarted","Data":"851b8f9ff948e83a5a5a983eea3ceeea1a197ae63eb1bc6b3e2eb51fd48b6efa"}
Jul 28 20:08:43.165491 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:43.165453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6" event={"ID":"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea","Type":"ContainerStarted","Data":"3b1da59f38d0c88f2c6612ad865b863f762cb8bceb545fd22415ea0338d34db9"}
Jul 28 20:08:43.167391 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:43.167369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv" event={"ID":"40273d5a-9cdf-437d-a9a9-1d060a4aba8b","Type":"ContainerStarted","Data":"27aa18e109cc75f004d37a4965c81d983b1631be34460b08cdc2ac1396dd9f5a"}
Jul 28 20:08:43.185838 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:43.185787    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwktv" podStartSLOduration=3.967777241 podStartE2EDuration="25.185770802s" totalImagesPullingTime="21.217993561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:43.185181745 +0000 UTC m=+25.581884893" watchObservedRunningTime="2026-07-28 20:08:43.185770802 +0000 UTC m=+25.582473958"
Jul 28 20:08:44.071158 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:44.071128    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:44.071408 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:44.071128    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:44.071408 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:44.071275    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:44.071408 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:44.071128    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:44.071408 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:44.071348    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:44.071592 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:44.071422    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:44.281938 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:44.281901    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:44.282605 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:44.282582    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:45.176574 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:45.176375    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad6e3524-1485-4c8c-a362-e07e9592f705" containerID="50e8ccdbeb53ee1c017a8339e87a96944c2c2033df6f72df9eb38e17a87b68cb" exitCode=0
Jul 28 20:08:45.176801 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:45.176454    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7frw" event={"ID":"ad6e3524-1485-4c8c-a362-e07e9592f705","Type":"ContainerDied","Data":"50e8ccdbeb53ee1c017a8339e87a96944c2c2033df6f72df9eb38e17a87b68cb"}
Jul 28 20:08:45.180262 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:45.180223    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6" event={"ID":"c2f7f1c9-e0f7-44e4-bf7d-1166ff0df8ea","Type":"ContainerStarted","Data":"213191a2471916cb2316249dc159c5d02ea974134de43bf810096c31b73f13a0"}
Jul 28 20:08:45.226636 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:45.226542    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6" podStartSLOduration=7.990700341 podStartE2EDuration="27.226525788s" totalImagesPullingTime="19.235825447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:45.225493494 +0000 UTC m=+27.622196672" watchObservedRunningTime="2026-07-28 20:08:45.226525788 +0000 UTC m=+27.623228944"
Jul 28 20:08:46.072888 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.072850    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:46.073805 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:46.072993    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:46.073805 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.073382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:46.073805 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:46.073472    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:46.073805 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.073520    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:46.073805 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:46.073576    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:46.183610 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.183527    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad6e3524-1485-4c8c-a362-e07e9592f705" containerID="e507380f56cc9c8233ef09c2be4d4e8a53e64ecebd6a249e0f9ba0e9d21b4626" exitCode=0
Jul 28 20:08:46.183754 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.183611    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7frw" event={"ID":"ad6e3524-1485-4c8c-a362-e07e9592f705","Type":"ContainerDied","Data":"e507380f56cc9c8233ef09c2be4d4e8a53e64ecebd6a249e0f9ba0e9d21b4626"}
Jul 28 20:08:46.184339 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.184076    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:46.184339 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.184143    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:46.184339 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.184198    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:46.199120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.199095    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:46.199347 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.199202    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:08:46.753380 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.753340    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:46.753553 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.753539    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 20:08:46.754117 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:46.754091    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p858f"
Jul 28 20:08:47.081085 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:47.080853    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8nzjj"]
Jul 28 20:08:47.081462 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:47.081183    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:47.081462 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:47.081288    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:47.084196 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:47.084171    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lh75w"]
Jul 28 20:08:47.084347 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:47.084294    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:47.084419 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:47.084373    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:47.084955 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:47.084935    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jgs7w"]
Jul 28 20:08:47.085048 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:47.085037    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:47.085159 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:47.085132    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:47.189203 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:47.189082    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad6e3524-1485-4c8c-a362-e07e9592f705" containerID="7e38a21b29872d1b3fb4e796f88a9fafa2ae7180459d549e20f9640def9bd62e" exitCode=0
Jul 28 20:08:47.189203 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:47.189176    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7frw" event={"ID":"ad6e3524-1485-4c8c-a362-e07e9592f705","Type":"ContainerDied","Data":"7e38a21b29872d1b3fb4e796f88a9fafa2ae7180459d549e20f9640def9bd62e"}
Jul 28 20:08:49.071373 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:49.071341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:49.071776 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:49.071341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:49.071776 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:49.071477    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:49.071776 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:49.071579    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:49.071776 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:49.071341    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:49.071776 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:49.071711    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:51.070827 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:51.070775    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:51.071278 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:51.070899    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:51.071278 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.070910    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nzjj" podUID="600e31fe-6857-4497-8fc5-376fa127489f"
Jul 28 20:08:51.071278 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:51.070933    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:51.071278 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.071026    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lh75w" podUID="01feb305-3c2b-4e29-a68c-ec74c2947625"
Jul 28 20:08:51.071278 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.071125    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jgs7w" podUID="d2581e4e-d2dd-4022-bf6a-669145444f0f"
Jul 28 20:08:51.750197 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:51.750167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:51.750434 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.750344    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:51.750434 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.750408    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret podName:600e31fe-6857-4497-8fc5-376fa127489f nodeName:}" failed. No retries permitted until 2026-07-28 20:09:23.750392661 +0000 UTC m=+66.147095796 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret") pod "global-pull-secret-syncer-8nzjj" (UID: "600e31fe-6857-4497-8fc5-376fa127489f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:08:51.851113 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:51.851079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcsbg\" (UniqueName: \"kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg\") pod \"network-check-target-lh75w\" (UID: \"01feb305-3c2b-4e29-a68c-ec74c2947625\") " pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:51.851293 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:51.851123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:51.851293 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.851223    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:51.851293 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.851259    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:08:51.851293 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.851281    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:08:51.851293 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.851291    2561 projected.go:196] Error preparing data for projected volume kube-api-access-lcsbg for pod openshift-network-diagnostics/network-check-target-lh75w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:51.851293 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.851295    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs podName:d2581e4e-d2dd-4022-bf6a-669145444f0f nodeName:}" failed. No retries permitted until 2026-07-28 20:09:23.851280684 +0000 UTC m=+66.247983817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs") pod "network-metrics-daemon-jgs7w" (UID: "d2581e4e-d2dd-4022-bf6a-669145444f0f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:08:51.851512 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:51.851329    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg podName:01feb305-3c2b-4e29-a68c-ec74c2947625 nodeName:}" failed. No retries permitted until 2026-07-28 20:09:23.851317751 +0000 UTC m=+66.248020885 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcsbg" (UniqueName: "kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg") pod "network-check-target-lh75w" (UID: "01feb305-3c2b-4e29-a68c-ec74c2947625") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:08:52.204227 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.204132    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad6e3524-1485-4c8c-a362-e07e9592f705" containerID="c6da1b311afe768f7fa1b1578a5a8b701c4b21d382cfd17ea613100f3dccba77" exitCode=0
Jul 28 20:08:52.204227 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.204191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7frw" event={"ID":"ad6e3524-1485-4c8c-a362-e07e9592f705","Type":"ContainerDied","Data":"c6da1b311afe768f7fa1b1578a5a8b701c4b21d382cfd17ea613100f3dccba77"}
Jul 28 20:08:52.378253 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.378064    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeReady"
Jul 28 20:08:52.378392 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.378355    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 20:08:52.414455 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.414423    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f78ccb684-q5z4n"]
Jul 28 20:08:52.426007 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.425978    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.428249 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.428207    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 20:08:52.428380 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.428296    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 20:08:52.429643 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.429100    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"]
Jul 28 20:08:52.429643 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.429407    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cmltp\""
Jul 28 20:08:52.429826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.429760    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 20:08:52.437510 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.437486    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-vprlt"]
Jul 28 20:08:52.437654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.437636    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.438109 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.437927    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 20:08:52.439954 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.439936    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:08:52.440432 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.440415    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 20:08:52.441078 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.441059    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 20:08:52.441125 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.441072    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wxn5x\""
Jul 28 20:08:52.441433 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.441418    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 20:08:52.455111 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.453838    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"]
Jul 28 20:08:52.455111 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.453977    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.462522 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.462126    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 28 20:08:52.462522 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.462430    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 28 20:08:52.462726 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.462715    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-w5tpb\""
Jul 28 20:08:52.462977 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.462786    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:08:52.463228 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.463175    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 28 20:08:52.469830 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.469811    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"]
Jul 28 20:08:52.469937 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.469923    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.472352 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.472336    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 28 20:08:52.472706 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.472692    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 28 20:08:52.472909 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.472893    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 28 20:08:52.473205 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.473192    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:08:52.474143 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.474125    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8fpzb\""
Jul 28 20:08:52.480884 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.480866    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 28 20:08:52.484033 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.484015    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b5458f665-rgvs8"]
Jul 28 20:08:52.484114 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.484058    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:08:52.486633 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.486595    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 20:08:52.486959 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.486942    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6hzm4\""
Jul 28 20:08:52.487397 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.487384    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 20:08:52.487647 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.487634    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:08:52.506868 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.506843    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"]
Jul 28 20:08:52.507009 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.506975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.510428 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.510407    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 20:08:52.510537 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.510433    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 20:08:52.510537 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.510471    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 20:08:52.510741 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.510722    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dkf55\""
Jul 28 20:08:52.510865 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.510761    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 20:08:52.511152 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.511136    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 20:08:52.511408 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.511391    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 20:08:52.520540 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.520519    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"]
Jul 28 20:08:52.520648 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.520633    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:08:52.522988 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.522968    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 20:08:52.523102 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.523074    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 20:08:52.523172 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.523159    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5mnkr\""
Jul 28 20:08:52.542745 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.542724    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf"]
Jul 28 20:08:52.542876 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.542841    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:52.545612 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.545594    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 28 20:08:52.545945 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.545930    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 20:08:52.546106 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.546088    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ds9vt\""
Jul 28 20:08:52.546954 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.546940    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 28 20:08:52.547014 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.546969    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 20:08:52.558124 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558103    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-certificates\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.558248 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-image-registry-private-configuration\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.558248 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558150    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8521c01-66a2-4a0d-b772-6b52b0ac644f-serving-cert\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.558248 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558166    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zblkt\" (UniqueName: \"kubernetes.io/projected/f735995e-7787-473c-b8a4-46de2510b36f-kube-api-access-zblkt\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz\" (UID: \"f735995e-7787-473c-b8a4-46de2510b36f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.558415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-trusted-ca\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.558415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b40f4867-d257-4088-9aaf-7fba209130bc-config\") pod \"service-ca-operator-5d6c75f84f-ml89v\" (UID: \"b40f4867-d257-4088-9aaf-7fba209130bc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.558415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f735995e-7787-473c-b8a4-46de2510b36f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz\" (UID: \"f735995e-7787-473c-b8a4-46de2510b36f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.558415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-bound-sa-token\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.558415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4dqz\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-kube-api-access-s4dqz\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.558610 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.558658 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558613    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-installation-pull-secrets\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.558658 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b40f4867-d257-4088-9aaf-7fba209130bc-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ml89v\" (UID: \"b40f4867-d257-4088-9aaf-7fba209130bc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.558751 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqjzr\" (UniqueName: \"kubernetes.io/projected/e8521c01-66a2-4a0d-b772-6b52b0ac644f-kube-api-access-qqjzr\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.558823 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f735995e-7787-473c-b8a4-46de2510b36f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz\" (UID: \"f735995e-7787-473c-b8a4-46de2510b36f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.558953 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558937    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jt4b\" (UniqueName: \"kubernetes.io/projected/b40f4867-d257-4088-9aaf-7fba209130bc-kube-api-access-9jt4b\") pod \"service-ca-operator-5d6c75f84f-ml89v\" (UID: \"b40f4867-d257-4088-9aaf-7fba209130bc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.559022 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.558973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efc8d5-9803-465d-9c87-9e899507bbcf-ca-trust-extracted\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.559022 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.559001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8521c01-66a2-4a0d-b772-6b52b0ac644f-config\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.559117 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.559041    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8521c01-66a2-4a0d-b772-6b52b0ac644f-trusted-ca\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.566823 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.566801    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-2sjmh"]
Jul 28 20:08:52.566949 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.566925    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf"
Jul 28 20:08:52.568885 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.568866    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hqj9l\""
Jul 28 20:08:52.569013 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.568998    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:08:52.569265 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.569245    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 20:08:52.586993 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.586969    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.586993 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.586975    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb"]
Jul 28 20:08:52.589148 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.589128    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 20:08:52.589148 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.589135    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9g7vl\""
Jul 28 20:08:52.589334 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.589201    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 28 20:08:52.589452 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.589436    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 20:08:52.589521 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.589511    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 28 20:08:52.593759 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.593740    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 28 20:08:52.603045 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.603015    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f78ccb684-q5z4n"]
Jul 28 20:08:52.603139 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.603054    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5mjp9"]
Jul 28 20:08:52.603139 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.603126    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb"
Jul 28 20:08:52.605268 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.605250    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 20:08:52.605339 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.605258    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fzmct\""
Jul 28 20:08:52.605521 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.605508    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 20:08:52.613035 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.613019    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rwsms"]
Jul 28 20:08:52.613147 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.613132    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5mjp9"
Jul 28 20:08:52.615406 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.615387    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 20:08:52.615470 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.615406    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 20:08:52.615470 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.615421    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k95ng\""
Jul 28 20:08:52.615550 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.615421    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 20:08:52.629245 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629210    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"]
Jul 28 20:08:52.629322 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629255    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"]
Jul 28 20:08:52.629322 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629269    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"]
Jul 28 20:08:52.629322 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629286    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-vprlt"]
Jul 28 20:08:52.629322 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629297    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5mjp9"]
Jul 28 20:08:52.629322 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629309    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rwsms"]
Jul 28 20:08:52.629322 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.629322 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629323    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-2sjmh"]
Jul 28 20:08:52.629577 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629339    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b5458f665-rgvs8"]
Jul 28 20:08:52.629577 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629352    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"]
Jul 28 20:08:52.629577 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629363    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb"]
Jul 28 20:08:52.629577 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629375    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"]
Jul 28 20:08:52.629577 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.629389    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf"]
Jul 28 20:08:52.631927 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.631897    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 20:08:52.632035 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.631940    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 20:08:52.632035 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.631944    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-488rx\""
Jul 28 20:08:52.659585 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b40f4867-d257-4088-9aaf-7fba209130bc-config\") pod \"service-ca-operator-5d6c75f84f-ml89v\" (UID: \"b40f4867-d257-4088-9aaf-7fba209130bc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.659585 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659586    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f735995e-7787-473c-b8a4-46de2510b36f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz\" (UID: \"f735995e-7787-473c-b8a4-46de2510b36f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.659785 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:52.659785 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:08:52.659785 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9kwj\" (UniqueName: \"kubernetes.io/projected/d325844b-c6aa-4ab8-91ff-51276bbbeeba-kube-api-access-z9kwj\") pod \"volume-data-source-validator-549c6d54cf-b2wvf\" (UID: \"d325844b-c6aa-4ab8-91ff-51276bbbeeba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf"
Jul 28 20:08:52.659785 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.659785 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.660009 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-installation-pull-secrets\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.660009 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-stats-auth\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.660009 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:08:52.660009 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.659896    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:08:52.660009 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.659916    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f78ccb684-q5z4n: secret "image-registry-tls" not found
Jul 28 20:08:52.660009 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.659900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8521c01-66a2-4a0d-b772-6b52b0ac644f-config\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.660009 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.659974    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls podName:a7efc8d5-9803-465d-9c87-9e899507bbcf nodeName:}" failed. No retries permitted until 2026-07-28 20:08:53.15995524 +0000 UTC m=+35.556658395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls") pod "image-registry-f78ccb684-q5z4n" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf") : secret "image-registry-tls" not found
Jul 28 20:08:52.660365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8rzs\" (UniqueName: \"kubernetes.io/projected/b54e55c7-a901-427f-8344-7665df115a17-kube-api-access-g8rzs\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:08:52.660365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efc8d5-9803-465d-9c87-9e899507bbcf-ca-trust-extracted\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.660365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxqnn\" (UniqueName: \"kubernetes.io/projected/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-kube-api-access-jxqnn\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.660365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-default-certificate\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.660365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-bound-sa-token\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.660365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660198    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4dqz\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-kube-api-access-s4dqz\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.660365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8521c01-66a2-4a0d-b772-6b52b0ac644f-trusted-ca\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.660365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660224    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b40f4867-d257-4088-9aaf-7fba209130bc-config\") pod \"service-ca-operator-5d6c75f84f-ml89v\" (UID: \"b40f4867-d257-4088-9aaf-7fba209130bc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.660365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-certificates\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cf4d8ec7-2e28-47cd-873e-0c94c9879609-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b40f4867-d257-4088-9aaf-7fba209130bc-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ml89v\" (UID: \"b40f4867-d257-4088-9aaf-7fba209130bc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f735995e-7787-473c-b8a4-46de2510b36f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz\" (UID: \"f735995e-7787-473c-b8a4-46de2510b36f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660509    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efc8d5-9803-465d-9c87-9e899507bbcf-ca-trust-extracted\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqjzr\" (UniqueName: \"kubernetes.io/projected/e8521c01-66a2-4a0d-b772-6b52b0ac644f-kube-api-access-qqjzr\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660558    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8521c01-66a2-4a0d-b772-6b52b0ac644f-config\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jt4b\" (UniqueName: \"kubernetes.io/projected/b40f4867-d257-4088-9aaf-7fba209130bc-kube-api-access-9jt4b\") pod \"service-ca-operator-5d6c75f84f-ml89v\" (UID: \"b40f4867-d257-4088-9aaf-7fba209130bc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660618    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rpnz\" (UniqueName: \"kubernetes.io/projected/cf4d8ec7-2e28-47cd-873e-0c94c9879609-kube-api-access-4rpnz\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660651    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8521c01-66a2-4a0d-b772-6b52b0ac644f-serving-cert\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-image-registry-private-configuration\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zblkt\" (UniqueName: \"kubernetes.io/projected/f735995e-7787-473c-b8a4-46de2510b36f-kube-api-access-zblkt\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz\" (UID: \"f735995e-7787-473c-b8a4-46de2510b36f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660754    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-trusted-ca\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.660796 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.660801    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-certificates\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.661585 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.661263    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f735995e-7787-473c-b8a4-46de2510b36f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz\" (UID: \"f735995e-7787-473c-b8a4-46de2510b36f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.661895 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.661875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8521c01-66a2-4a0d-b772-6b52b0ac644f-trusted-ca\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.662030 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.662016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-trusted-ca\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.664173 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.664123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b40f4867-d257-4088-9aaf-7fba209130bc-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ml89v\" (UID: \"b40f4867-d257-4088-9aaf-7fba209130bc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.664315 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.664300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f735995e-7787-473c-b8a4-46de2510b36f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz\" (UID: \"f735995e-7787-473c-b8a4-46de2510b36f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.664381 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.664303    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8521c01-66a2-4a0d-b772-6b52b0ac644f-serving-cert\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.664381 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.664369    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-image-registry-private-configuration\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.664444 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.664410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-installation-pull-secrets\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.671053 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.671016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-bound-sa-token\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.671317 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.671300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jt4b\" (UniqueName: \"kubernetes.io/projected/b40f4867-d257-4088-9aaf-7fba209130bc-kube-api-access-9jt4b\") pod \"service-ca-operator-5d6c75f84f-ml89v\" (UID: \"b40f4867-d257-4088-9aaf-7fba209130bc\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.672061 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.672036    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqjzr\" (UniqueName: \"kubernetes.io/projected/e8521c01-66a2-4a0d-b772-6b52b0ac644f-kube-api-access-qqjzr\") pod \"console-operator-584dcb6b54-vprlt\" (UID: \"e8521c01-66a2-4a0d-b772-6b52b0ac644f\") " pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.672460 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.672441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zblkt\" (UniqueName: \"kubernetes.io/projected/f735995e-7787-473c-b8a4-46de2510b36f-kube-api-access-zblkt\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz\" (UID: \"f735995e-7787-473c-b8a4-46de2510b36f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.673534 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.673518    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4dqz\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-kube-api-access-s4dqz\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:52.750192 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.750155    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"
Jul 28 20:08:52.761526 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.761493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cf4d8ec7-2e28-47cd-873e-0c94c9879609-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:52.761609 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.761532    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.761609 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.761552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.761695 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.761670    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4fjq\" (UniqueName: \"kubernetes.io/projected/e747d2f9-f813-4fcf-a43e-e4562b74decb-kube-api-access-m4fjq\") pod \"ingress-canary-5mjp9\" (UID: \"e747d2f9-f813-4fcf-a43e-e4562b74decb\") " pod="openshift-ingress-canary/ingress-canary-5mjp9"
Jul 28 20:08:52.761782 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.761769    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:08:52.761837 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.761829    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:08:53.261811167 +0000 UTC m=+35.658514300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : secret "router-metrics-certs-default" not found
Jul 28 20:08:52.761875 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.761829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-tmp\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.761914 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.761875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-serving-cert\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.761914 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.761905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bdph\" (UniqueName: \"kubernetes.io/projected/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-kube-api-access-5bdph\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.762021 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.761996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-service-ca-bundle\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.762082 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-config-volume\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.762134 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rpnz\" (UniqueName: \"kubernetes.io/projected/cf4d8ec7-2e28-47cd-873e-0c94c9879609-kube-api-access-4rpnz\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:52.762134 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45vtx\" (UniqueName: \"kubernetes.io/projected/8e23869d-315a-4468-a72a-6e0ac9f2db9b-kube-api-access-45vtx\") pod \"network-check-source-7d88cb55d8-p9npb\" (UID: \"8e23869d-315a-4468-a72a-6e0ac9f2db9b\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb"
Jul 28 20:08:52.762227 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:08:52.762227 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-tmp-dir\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.762227 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762220    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsffg\" (UniqueName: \"kubernetes.io/projected/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-kube-api-access-wsffg\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.762376 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:52.762376 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.762330    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:08:52.762376 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cf4d8ec7-2e28-47cd-873e-0c94c9879609-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:52.762475 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.762391    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert podName:5a73c164-09ba-4337-b1c9-ec9ab07cf91d nodeName:}" failed. No retries permitted until 2026-07-28 20:08:53.262376084 +0000 UTC m=+35.659079222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-njdbn" (UID: "5a73c164-09ba-4337-b1c9-ec9ab07cf91d") : secret "networking-console-plugin-cert" not found
Jul 28 20:08:52.762475 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.762394    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:08:52.762475 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.762434    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls podName:cf4d8ec7-2e28-47cd-873e-0c94c9879609 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:53.262424649 +0000 UTC m=+35.659127786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hhkfr" (UID: "cf4d8ec7-2e28-47cd-873e-0c94c9879609") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:08:52.762475 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:08:52.762653 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9kwj\" (UniqueName: \"kubernetes.io/projected/d325844b-c6aa-4ab8-91ff-51276bbbeeba-kube-api-access-z9kwj\") pod \"volume-data-source-validator-549c6d54cf-b2wvf\" (UID: \"d325844b-c6aa-4ab8-91ff-51276bbbeeba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf"
Jul 28 20:08:52.762653 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.762653 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-stats-auth\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.762653 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762541    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:08:52.762653 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.762550    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:08:52.762653 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762574    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-snapshots\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.762653 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.762597    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls podName:b54e55c7-a901-427f-8344-7665df115a17 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:53.262579302 +0000 UTC m=+35.659282443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls") pod "cluster-samples-operator-6748489656-fsp75" (UID: "b54e55c7-a901-427f-8344-7665df115a17") : secret "samples-operator-tls" not found
Jul 28 20:08:52.762653 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8rzs\" (UniqueName: \"kubernetes.io/projected/b54e55c7-a901-427f-8344-7665df115a17-kube-api-access-g8rzs\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:08:52.762995 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.762675    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:08:53.26265179 +0000 UTC m=+35.659354946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : configmap references non-existent config key: service-ca.crt
Jul 28 20:08:52.762995 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.762995 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxqnn\" (UniqueName: \"kubernetes.io/projected/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-kube-api-access-jxqnn\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.762995 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762763    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e747d2f9-f813-4fcf-a43e-e4562b74decb-cert\") pod \"ingress-canary-5mjp9\" (UID: \"e747d2f9-f813-4fcf-a43e-e4562b74decb\") " pod="openshift-ingress-canary/ingress-canary-5mjp9"
Jul 28 20:08:52.762995 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.762809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-default-certificate\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.763184 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.763162    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:08:52.765076 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.765058    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-stats-auth\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.765142 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.765120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-default-certificate\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.768119 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.768102    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:08:52.770773 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.770750    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9kwj\" (UniqueName: \"kubernetes.io/projected/d325844b-c6aa-4ab8-91ff-51276bbbeeba-kube-api-access-z9kwj\") pod \"volume-data-source-validator-549c6d54cf-b2wvf\" (UID: \"d325844b-c6aa-4ab8-91ff-51276bbbeeba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf"
Jul 28 20:08:52.770953 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.770932    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8rzs\" (UniqueName: \"kubernetes.io/projected/b54e55c7-a901-427f-8344-7665df115a17-kube-api-access-g8rzs\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:08:52.771014 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.770977    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxqnn\" (UniqueName: \"kubernetes.io/projected/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-kube-api-access-jxqnn\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:52.771251 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.771219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rpnz\" (UniqueName: \"kubernetes.io/projected/cf4d8ec7-2e28-47cd-873e-0c94c9879609-kube-api-access-4rpnz\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:52.777738 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.777725    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"
Jul 28 20:08:52.863870 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.863823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-tmp-dir\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.863870 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.863859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsffg\" (UniqueName: \"kubernetes.io/projected/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-kube-api-access-wsffg\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.863924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-snapshots\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.863939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.863955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e747d2f9-f813-4fcf-a43e-e4562b74decb-cert\") pod \"ingress-canary-5mjp9\" (UID: \"e747d2f9-f813-4fcf-a43e-e4562b74decb\") " pod="openshift-ingress-canary/ingress-canary-5mjp9"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.863987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.864009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4fjq\" (UniqueName: \"kubernetes.io/projected/e747d2f9-f813-4fcf-a43e-e4562b74decb-kube-api-access-m4fjq\") pod \"ingress-canary-5mjp9\" (UID: \"e747d2f9-f813-4fcf-a43e-e4562b74decb\") " pod="openshift-ingress-canary/ingress-canary-5mjp9"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.864023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-tmp\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.864039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-serving-cert\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.864055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bdph\" (UniqueName: \"kubernetes.io/projected/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-kube-api-access-5bdph\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.864082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-service-ca-bundle\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.864097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-config-volume\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.864108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.864113    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45vtx\" (UniqueName: \"kubernetes.io/projected/8e23869d-315a-4468-a72a-6e0ac9f2db9b-kube-api-access-45vtx\") pod \"network-check-source-7d88cb55d8-p9npb\" (UID: \"8e23869d-315a-4468-a72a-6e0ac9f2db9b\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb"
Jul 28 20:08:52.864629 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.864465    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:08:52.864629 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:52.864551    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls podName:74a7b7f8-0625-40ac-abfa-a433f4bfec5b nodeName:}" failed. No retries permitted until 2026-07-28 20:08:53.364528133 +0000 UTC m=+35.761231269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls") pod "dns-default-rwsms" (UID: "74a7b7f8-0625-40ac-abfa-a433f4bfec5b") : secret "dns-default-metrics-tls" not found
Jul 28 20:08:52.865144 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.865089    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-service-ca-bundle\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.865144 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.865110    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-tmp\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.865345 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.865227    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-snapshots\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.865345 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.865287    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.865463 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.865348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-tmp-dir\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.865463 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.865355    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-config-volume\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.867002 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.866983    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-serving-cert\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.867205 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.867186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e747d2f9-f813-4fcf-a43e-e4562b74decb-cert\") pod \"ingress-canary-5mjp9\" (UID: \"e747d2f9-f813-4fcf-a43e-e4562b74decb\") " pod="openshift-ingress-canary/ingress-canary-5mjp9"
Jul 28 20:08:52.875034 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.875006    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf"
Jul 28 20:08:52.877940 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.876088    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45vtx\" (UniqueName: \"kubernetes.io/projected/8e23869d-315a-4468-a72a-6e0ac9f2db9b-kube-api-access-45vtx\") pod \"network-check-source-7d88cb55d8-p9npb\" (UID: \"8e23869d-315a-4468-a72a-6e0ac9f2db9b\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb"
Jul 28 20:08:52.877940 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.876257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4fjq\" (UniqueName: \"kubernetes.io/projected/e747d2f9-f813-4fcf-a43e-e4562b74decb-kube-api-access-m4fjq\") pod \"ingress-canary-5mjp9\" (UID: \"e747d2f9-f813-4fcf-a43e-e4562b74decb\") " pod="openshift-ingress-canary/ingress-canary-5mjp9"
Jul 28 20:08:52.877940 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.876860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsffg\" (UniqueName: \"kubernetes.io/projected/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-kube-api-access-wsffg\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:52.877940 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.877535    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bdph\" (UniqueName: \"kubernetes.io/projected/7e6f21f4-9b6c-4595-bd37-7b4661e09d0c-kube-api-access-5bdph\") pod \"insights-operator-5885fdb759-2sjmh\" (UID: \"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c\") " pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.895844 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.895810    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-2sjmh"
Jul 28 20:08:52.911057 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.911030    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb"
Jul 28 20:08:52.921927 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.921869    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5mjp9"
Jul 28 20:08:52.980084 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.979092    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v"]
Jul 28 20:08:52.987927 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.987652    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-vprlt"]
Jul 28 20:08:52.993366 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:52.993344    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz"]
Jul 28 20:08:53.019170 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:53.019126    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf735995e_7787_473c_b8a4_46de2510b36f.slice/crio-ce4b2e1947d6e00ea793d5d432dc518231e0676a50591540021a5cdcce2381d3 WatchSource:0}: Error finding container ce4b2e1947d6e00ea793d5d432dc518231e0676a50591540021a5cdcce2381d3: Status 404 returned error can't find the container with id ce4b2e1947d6e00ea793d5d432dc518231e0676a50591540021a5cdcce2381d3
Jul 28 20:08:53.070889 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.070526    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:08:53.070889 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.070825    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:08:53.071065 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.070957    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:08:53.073967 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.073462    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 20:08:53.073967 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.073591    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sp59p\""
Jul 28 20:08:53.073967 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.073808    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 20:08:53.073967 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.073849    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-82krx\""
Jul 28 20:08:53.100517 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.100469    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf"]
Jul 28 20:08:53.104263 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:53.104229    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd325844b_c6aa_4ab8_91ff_51276bbbeeba.slice/crio-b0bf0c4c1fa622e4e0bb5a2e16aef9b28b0a2b10a33db1fa545c31fe3cf78f96 WatchSource:0}: Error finding container b0bf0c4c1fa622e4e0bb5a2e16aef9b28b0a2b10a33db1fa545c31fe3cf78f96: Status 404 returned error can't find the container with id b0bf0c4c1fa622e4e0bb5a2e16aef9b28b0a2b10a33db1fa545c31fe3cf78f96
Jul 28 20:08:53.137596 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.137565    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-2sjmh"]
Jul 28 20:08:53.140074 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:53.140046    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6f21f4_9b6c_4595_bd37_7b4661e09d0c.slice/crio-e4aff28513846ae8a27eadc1e7822f15b816968ea0266878e6b79ae4ae05f5ad WatchSource:0}: Error finding container e4aff28513846ae8a27eadc1e7822f15b816968ea0266878e6b79ae4ae05f5ad: Status 404 returned error can't find the container with id e4aff28513846ae8a27eadc1e7822f15b816968ea0266878e6b79ae4ae05f5ad
Jul 28 20:08:53.141154 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.141132    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb"]
Jul 28 20:08:53.143883 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:53.143857    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e23869d_315a_4468_a72a_6e0ac9f2db9b.slice/crio-bbf5950e6548da202945d642033827047b45a1a89b9d3e32723ac8d93de871e9 WatchSource:0}: Error finding container bbf5950e6548da202945d642033827047b45a1a89b9d3e32723ac8d93de871e9: Status 404 returned error can't find the container with id bbf5950e6548da202945d642033827047b45a1a89b9d3e32723ac8d93de871e9
Jul 28 20:08:53.148491 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.148460    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5mjp9"]
Jul 28 20:08:53.150667 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:08:53.150646    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode747d2f9_f813_4fcf_a43e_e4562b74decb.slice/crio-fef66107136cdc39a24ed44b7a5b718be6dedbbd6d517b83bf7a4d60bcffa932 WatchSource:0}: Error finding container fef66107136cdc39a24ed44b7a5b718be6dedbbd6d517b83bf7a4d60bcffa932: Status 404 returned error can't find the container with id fef66107136cdc39a24ed44b7a5b718be6dedbbd6d517b83bf7a4d60bcffa932
Jul 28 20:08:53.167834 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.167803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:53.167973 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.167954    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:08:53.168024 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.167974    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f78ccb684-q5z4n: secret "image-registry-tls" not found
Jul 28 20:08:53.168024 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.168024    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls podName:a7efc8d5-9803-465d-9c87-9e899507bbcf nodeName:}" failed. No retries permitted until 2026-07-28 20:08:54.168006245 +0000 UTC m=+36.564709381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls") pod "image-registry-f78ccb684-q5z4n" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf") : secret "image-registry-tls" not found
Jul 28 20:08:53.209976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.209941    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad6e3524-1485-4c8c-a362-e07e9592f705" containerID="f21f32aabcc59a857944cab50107bfb670dbfe56e5915ff4a0b81d6372516608" exitCode=0
Jul 28 20:08:53.210847 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.210012    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7frw" event={"ID":"ad6e3524-1485-4c8c-a362-e07e9592f705","Type":"ContainerDied","Data":"f21f32aabcc59a857944cab50107bfb670dbfe56e5915ff4a0b81d6372516608"}
Jul 28 20:08:53.211197 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.211174    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt" event={"ID":"e8521c01-66a2-4a0d-b772-6b52b0ac644f","Type":"ContainerStarted","Data":"eb924d5d9d1564681e6679cbe1a0edfe048d57dfdc7eb7c198bf450a300dac05"}
Jul 28 20:08:53.212306 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.212252    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5mjp9" event={"ID":"e747d2f9-f813-4fcf-a43e-e4562b74decb","Type":"ContainerStarted","Data":"fef66107136cdc39a24ed44b7a5b718be6dedbbd6d517b83bf7a4d60bcffa932"}
Jul 28 20:08:53.213304 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.213284    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb" event={"ID":"8e23869d-315a-4468-a72a-6e0ac9f2db9b","Type":"ContainerStarted","Data":"bbf5950e6548da202945d642033827047b45a1a89b9d3e32723ac8d93de871e9"}
Jul 28 20:08:53.214410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.214382    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz" event={"ID":"f735995e-7787-473c-b8a4-46de2510b36f","Type":"ContainerStarted","Data":"ce4b2e1947d6e00ea793d5d432dc518231e0676a50591540021a5cdcce2381d3"}
Jul 28 20:08:53.215333 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.215316    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-2sjmh" event={"ID":"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c","Type":"ContainerStarted","Data":"e4aff28513846ae8a27eadc1e7822f15b816968ea0266878e6b79ae4ae05f5ad"}
Jul 28 20:08:53.216311 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.216293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf" event={"ID":"d325844b-c6aa-4ab8-91ff-51276bbbeeba","Type":"ContainerStarted","Data":"b0bf0c4c1fa622e4e0bb5a2e16aef9b28b0a2b10a33db1fa545c31fe3cf78f96"}
Jul 28 20:08:53.217145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.217127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v" event={"ID":"b40f4867-d257-4088-9aaf-7fba209130bc","Type":"ContainerStarted","Data":"3283a0b32fb2921d3c64ba82098a0f42524a2d39e618597e4ad243195bb76d49"}
Jul 28 20:08:53.269377 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.269341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:53.269533 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.269473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:53.269606 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.269556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:08:53.269691 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.269606    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:53.269691 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.269633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:08:53.269828 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.269767    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:08:53.269895 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.269828    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls podName:b54e55c7-a901-427f-8344-7665df115a17 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:54.269808811 +0000 UTC m=+36.666511950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls") pod "cluster-samples-operator-6748489656-fsp75" (UID: "b54e55c7-a901-427f-8344-7665df115a17") : secret "samples-operator-tls" not found
Jul 28 20:08:53.270053 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.270019    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:08:54.270001443 +0000 UTC m=+36.666704592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : configmap references non-existent config key: service-ca.crt
Jul 28 20:08:53.270141 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.270099    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:08:53.270141 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.270135    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:08:54.270124914 +0000 UTC m=+36.666828072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : secret "router-metrics-certs-default" not found
Jul 28 20:08:53.270286 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.270207    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:08:53.270286 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.270262    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls podName:cf4d8ec7-2e28-47cd-873e-0c94c9879609 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:54.270248883 +0000 UTC m=+36.666952031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hhkfr" (UID: "cf4d8ec7-2e28-47cd-873e-0c94c9879609") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:08:53.270286 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.270268    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:08:53.270410 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.270318    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert podName:5a73c164-09ba-4337-b1c9-ec9ab07cf91d nodeName:}" failed. No retries permitted until 2026-07-28 20:08:54.27030688 +0000 UTC m=+36.667010015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-njdbn" (UID: "5a73c164-09ba-4337-b1c9-ec9ab07cf91d") : secret "networking-console-plugin-cert" not found
Jul 28 20:08:53.370580 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:53.370551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:53.370701 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.370684    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:08:53.370756 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:53.370745    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls podName:74a7b7f8-0625-40ac-abfa-a433f4bfec5b nodeName:}" failed. No retries permitted until 2026-07-28 20:08:54.370727979 +0000 UTC m=+36.767431115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls") pod "dns-default-rwsms" (UID: "74a7b7f8-0625-40ac-abfa-a433f4bfec5b") : secret "dns-default-metrics-tls" not found
Jul 28 20:08:54.179795 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:54.179737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:54.180009 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.179943    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:08:54.180009 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.179958    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f78ccb684-q5z4n: secret "image-registry-tls" not found
Jul 28 20:08:54.180122 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.180018    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls podName:a7efc8d5-9803-465d-9c87-9e899507bbcf nodeName:}" failed. No retries permitted until 2026-07-28 20:08:56.179999168 +0000 UTC m=+38.576702307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls") pod "image-registry-f78ccb684-q5z4n" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf") : secret "image-registry-tls" not found
Jul 28 20:08:54.225191 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:54.225153    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k7frw" event={"ID":"ad6e3524-1485-4c8c-a362-e07e9592f705","Type":"ContainerStarted","Data":"4c974c5319cb692c4f809aaf578ef91f32c3377298e3eba3737fd549316bb849"}
Jul 28 20:08:54.249140 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:54.248697    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k7frw" podStartSLOduration=11.249387304 podStartE2EDuration="36.248677545s" totalImagesPullingTime="24.999290241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:54.247009585 +0000 UTC m=+36.643712743" watchObservedRunningTime="2026-07-28 20:08:54.248677545 +0000 UTC m=+36.645380703"
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:54.280624    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:54.280712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:54.280759    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:54.280786    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:54.280823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.281435    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.281501    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.281509    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls podName:cf4d8ec7-2e28-47cd-873e-0c94c9879609 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:56.281488274 +0000 UTC m=+38.678191420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hhkfr" (UID: "cf4d8ec7-2e28-47cd-873e-0c94c9879609") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.281538    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls podName:b54e55c7-a901-427f-8344-7665df115a17 nodeName:}" failed. No retries permitted until 2026-07-28 20:08:56.281527799 +0000 UTC m=+38.678230933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls") pod "cluster-samples-operator-6748489656-fsp75" (UID: "b54e55c7-a901-427f-8344-7665df115a17") : secret "samples-operator-tls" not found
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.281600    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:08:56.281590576 +0000 UTC m=+38.678293710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : configmap references non-existent config key: service-ca.crt
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.281654    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.281682    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert podName:5a73c164-09ba-4337-b1c9-ec9ab07cf91d nodeName:}" failed. No retries permitted until 2026-07-28 20:08:56.281673352 +0000 UTC m=+38.678376486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-njdbn" (UID: "5a73c164-09ba-4337-b1c9-ec9ab07cf91d") : secret "networking-console-plugin-cert" not found
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.281727    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:08:54.281809 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.281754    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:08:56.281745511 +0000 UTC m=+38.678448646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : secret "router-metrics-certs-default" not found
Jul 28 20:08:54.381970 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:54.381936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:54.383209 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.382719    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:08:54.383209 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:54.382793    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls podName:74a7b7f8-0625-40ac-abfa-a433f4bfec5b nodeName:}" failed. No retries permitted until 2026-07-28 20:08:56.382772807 +0000 UTC m=+38.779475948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls") pod "dns-default-rwsms" (UID: "74a7b7f8-0625-40ac-abfa-a433f4bfec5b") : secret "dns-default-metrics-tls" not found
Jul 28 20:08:56.201725 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:56.201186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:08:56.201725 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.201319    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:08:56.201725 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.201331    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f78ccb684-q5z4n: secret "image-registry-tls" not found
Jul 28 20:08:56.201725 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.201387    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls podName:a7efc8d5-9803-465d-9c87-9e899507bbcf nodeName:}" failed. No retries permitted until 2026-07-28 20:09:00.201372352 +0000 UTC m=+42.598075486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls") pod "image-registry-f78ccb684-q5z4n" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf") : secret "image-registry-tls" not found
Jul 28 20:08:56.302359 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:56.302314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:08:56.302359 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:56.302367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:08:56.302590 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:56.302397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:56.302590 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.302479    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:08:56.302590 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.302504    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:08:56.302590 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.302517    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:09:00.30249891 +0000 UTC m=+42.699202064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : configmap references non-existent config key: service-ca.crt
Jul 28 20:08:56.302590 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.302547    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls podName:cf4d8ec7-2e28-47cd-873e-0c94c9879609 nodeName:}" failed. No retries permitted until 2026-07-28 20:09:00.302529251 +0000 UTC m=+42.699232385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hhkfr" (UID: "cf4d8ec7-2e28-47cd-873e-0c94c9879609") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:08:56.302590 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.302570    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls podName:b54e55c7-a901-427f-8344-7665df115a17 nodeName:}" failed. No retries permitted until 2026-07-28 20:09:00.30255916 +0000 UTC m=+42.699262295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls") pod "cluster-samples-operator-6748489656-fsp75" (UID: "b54e55c7-a901-427f-8344-7665df115a17") : secret "samples-operator-tls" not found
Jul 28 20:08:56.302900 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:56.302687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:08:56.302900 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:56.302754    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:08:56.302900 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.302811    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:08:56.302900 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.302859    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:09:00.302843315 +0000 UTC m=+42.699546464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : secret "router-metrics-certs-default" not found
Jul 28 20:08:56.302900 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.302861    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:08:56.303103 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.302906    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert podName:5a73c164-09ba-4337-b1c9-ec9ab07cf91d nodeName:}" failed. No retries permitted until 2026-07-28 20:09:00.302893372 +0000 UTC m=+42.699596529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-njdbn" (UID: "5a73c164-09ba-4337-b1c9-ec9ab07cf91d") : secret "networking-console-plugin-cert" not found
Jul 28 20:08:56.403773 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:08:56.403716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:08:56.403950 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.403887    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:08:56.404005 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:08:56.403966    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls podName:74a7b7f8-0625-40ac-abfa-a433f4bfec5b nodeName:}" failed. No retries permitted until 2026-07-28 20:09:00.403946013 +0000 UTC m=+42.800649147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls") pod "dns-default-rwsms" (UID: "74a7b7f8-0625-40ac-abfa-a433f4bfec5b") : secret "dns-default-metrics-tls" not found
Jul 28 20:09:00.239640 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:00.239602    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:09:00.240223 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.239751    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:09:00.240223 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.239771    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f78ccb684-q5z4n: secret "image-registry-tls" not found
Jul 28 20:09:00.240223 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.239830    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls podName:a7efc8d5-9803-465d-9c87-9e899507bbcf nodeName:}" failed. No retries permitted until 2026-07-28 20:09:08.239815032 +0000 UTC m=+50.636518166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls") pod "image-registry-f78ccb684-q5z4n" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf") : secret "image-registry-tls" not found
Jul 28 20:09:00.340130 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:00.340087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:09:00.340130 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:00.340139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:09:00.340434 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:00.340171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:00.340434 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.340288    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:09:00.340434 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:00.340301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:00.340434 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.340305    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:09:00.340434 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.340366    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls podName:cf4d8ec7-2e28-47cd-873e-0c94c9879609 nodeName:}" failed. No retries permitted until 2026-07-28 20:09:08.340344679 +0000 UTC m=+50.737047814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hhkfr" (UID: "cf4d8ec7-2e28-47cd-873e-0c94c9879609") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:09:00.340434 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.340383    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:09:08.340375793 +0000 UTC m=+50.737078927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : configmap references non-existent config key: service-ca.crt
Jul 28 20:09:00.340434 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.340395    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls podName:b54e55c7-a901-427f-8344-7665df115a17 nodeName:}" failed. No retries permitted until 2026-07-28 20:09:08.340389278 +0000 UTC m=+50.737092411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls") pod "cluster-samples-operator-6748489656-fsp75" (UID: "b54e55c7-a901-427f-8344-7665df115a17") : secret "samples-operator-tls" not found
Jul 28 20:09:00.340434 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.340399    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:09:00.340811 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:00.340446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:09:00.340811 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.340456    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:09:08.340442384 +0000 UTC m=+50.737145518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : secret "router-metrics-certs-default" not found
Jul 28 20:09:00.340811 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.340490    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:09:00.340811 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.340518    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert podName:5a73c164-09ba-4337-b1c9-ec9ab07cf91d nodeName:}" failed. No retries permitted until 2026-07-28 20:09:08.340509112 +0000 UTC m=+50.737212260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-njdbn" (UID: "5a73c164-09ba-4337-b1c9-ec9ab07cf91d") : secret "networking-console-plugin-cert" not found
Jul 28 20:09:00.441052 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:00.441032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:09:00.441151 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.441138    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:09:00.441203 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:00.441194    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls podName:74a7b7f8-0625-40ac-abfa-a433f4bfec5b nodeName:}" failed. No retries permitted until 2026-07-28 20:09:08.441178303 +0000 UTC m=+50.837881454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls") pod "dns-default-rwsms" (UID: "74a7b7f8-0625-40ac-abfa-a433f4bfec5b") : secret "dns-default-metrics-tls" not found
Jul 28 20:09:01.246989 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.246954    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-2sjmh" event={"ID":"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c","Type":"ContainerStarted","Data":"2826b7edb5b7dde8e3398299baba05693f37078c3dbef10013c822ffb55ea2d9"}
Jul 28 20:09:01.248837 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.248571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf" event={"ID":"d325844b-c6aa-4ab8-91ff-51276bbbeeba","Type":"ContainerStarted","Data":"7b4b2fcf86bbc16059facb5973aa45d483d4546866f39859ee497a9df31d6f05"}
Jul 28 20:09:01.250250 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.250206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v" event={"ID":"b40f4867-d257-4088-9aaf-7fba209130bc","Type":"ContainerStarted","Data":"60aa6efcec0a59310e27c373790e4cf918f9a15ec7aea62de93e3669edab667a"}
Jul 28 20:09:01.258275 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.255912    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/0.log"
Jul 28 20:09:01.258275 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.255947    2561 generic.go:356] "Generic (PLEG): container finished" podID="e8521c01-66a2-4a0d-b772-6b52b0ac644f" containerID="184ad48ad179b015b11bd104a06ba21f1d5c868d961b8e2f42fb265b2ee794d3" exitCode=255
Jul 28 20:09:01.258275 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.256044    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt" event={"ID":"e8521c01-66a2-4a0d-b772-6b52b0ac644f","Type":"ContainerDied","Data":"184ad48ad179b015b11bd104a06ba21f1d5c868d961b8e2f42fb265b2ee794d3"}
Jul 28 20:09:01.258275 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.256465    2561 scope.go:117] "RemoveContainer" containerID="184ad48ad179b015b11bd104a06ba21f1d5c868d961b8e2f42fb265b2ee794d3"
Jul 28 20:09:01.262868 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.262828    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5mjp9" event={"ID":"e747d2f9-f813-4fcf-a43e-e4562b74decb","Type":"ContainerStarted","Data":"54343f244279e67f9cb43dbe6aab62b86ccdd27e39c865ffd013d04643b139a8"}
Jul 28 20:09:01.264715 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.264692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb" event={"ID":"8e23869d-315a-4468-a72a-6e0ac9f2db9b","Type":"ContainerStarted","Data":"bb32a3e5de338e2c959dd35adf2359e2889ad0f96d45e8dd671797cd5aa16386"}
Jul 28 20:09:01.266767 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.266721    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-2sjmh" podStartSLOduration=5.919087202 podStartE2EDuration="13.266705467s" totalImagesPullingTime="7.347618265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:01.265837261 +0000 UTC m=+43.662540419" watchObservedRunningTime="2026-07-28 20:09:01.266705467 +0000 UTC m=+43.663408624"
Jul 28 20:09:01.267106 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.267085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz" event={"ID":"f735995e-7787-473c-b8a4-46de2510b36f","Type":"ContainerStarted","Data":"690ca19a6cd3f187e55bdcce568cb5cd10eb4e4fde2af1352fcc10fc225cdc5d"}
Jul 28 20:09:01.283420 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.282429    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-p9npb" podStartSLOduration=5.937432219 podStartE2EDuration="13.282407351s" totalImagesPullingTime="7.344975132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:01.281226691 +0000 UTC m=+43.677929875" watchObservedRunningTime="2026-07-28 20:09:01.282407351 +0000 UTC m=+43.679110509"
Jul 28 20:09:01.318030 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.317623    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-b2wvf" podStartSLOduration=6.002571644 podStartE2EDuration="13.317605803s" totalImagesPullingTime="7.315034159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:01.299038038 +0000 UTC m=+43.695741193" watchObservedRunningTime="2026-07-28 20:09:01.317605803 +0000 UTC m=+43.714308937"
Jul 28 20:09:01.340252 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.340187    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5mjp9" podStartSLOduration=1.995709162 podStartE2EDuration="9.340163597s" totalImagesPullingTime="7.344454435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:01.318688769 +0000 UTC m=+43.715391926" watchObservedRunningTime="2026-07-28 20:09:01.340163597 +0000 UTC m=+43.736866755"
Jul 28 20:09:01.341164 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.341128    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v" podStartSLOduration=6.840572723 podStartE2EDuration="14.341113518s" totalImagesPullingTime="7.500540795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:01.33940424 +0000 UTC m=+43.736107397" watchObservedRunningTime="2026-07-28 20:09:01.341113518 +0000 UTC m=+43.737816676"
Jul 28 20:09:01.378133 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.377574    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz" podStartSLOduration=6.9377819800000005 podStartE2EDuration="14.377508534s" totalImagesPullingTime="7.439726554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:01.376081056 +0000 UTC m=+43.772784247" watchObservedRunningTime="2026-07-28 20:09:01.377508534 +0000 UTC m=+43.774211690"
Jul 28 20:09:01.798129 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.798008    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dfkhg"]
Jul 28 20:09:01.824476 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.824448    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dfkhg"]
Jul 28 20:09:01.824637 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.824567    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.826778 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.826756    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tn5xs\""
Jul 28 20:09:01.826877 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.826805    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 20:09:01.827324 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.827305    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 20:09:01.858533 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.858498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.858720 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.858546    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.858720 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.858642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/875957db-e0ed-4178-9d66-855092ecaddc-crio-socket\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.858804 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.858769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/875957db-e0ed-4178-9d66-855092ecaddc-data-volume\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.858872 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.858854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqbgw\" (UniqueName: \"kubernetes.io/projected/875957db-e0ed-4178-9d66-855092ecaddc-kube-api-access-fqbgw\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.959460 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.959427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.959460 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.959464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.959681 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.959515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/875957db-e0ed-4178-9d66-855092ecaddc-crio-socket\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.959681 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:01.959554    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:09:01.959681 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:01.959627    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm podName:875957db-e0ed-4178-9d66-855092ecaddc nodeName:}" failed. No retries permitted until 2026-07-28 20:09:02.459607005 +0000 UTC m=+44.856310162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfkhg" (UID: "875957db-e0ed-4178-9d66-855092ecaddc") : configmap "kube-rbac-proxy" not found
Jul 28 20:09:01.959681 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.959627    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/875957db-e0ed-4178-9d66-855092ecaddc-crio-socket\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.959681 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:01.959665    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:09:01.959861 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:01.959721    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls podName:875957db-e0ed-4178-9d66-855092ecaddc nodeName:}" failed. No retries permitted until 2026-07-28 20:09:02.45970895 +0000 UTC m=+44.856412084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfkhg" (UID: "875957db-e0ed-4178-9d66-855092ecaddc") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:09:01.959861 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.959716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/875957db-e0ed-4178-9d66-855092ecaddc-data-volume\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.959861 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.959803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqbgw\" (UniqueName: \"kubernetes.io/projected/875957db-e0ed-4178-9d66-855092ecaddc-kube-api-access-fqbgw\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.960163 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.960005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/875957db-e0ed-4178-9d66-855092ecaddc-data-volume\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:01.975321 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:01.975295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqbgw\" (UniqueName: \"kubernetes.io/projected/875957db-e0ed-4178-9d66-855092ecaddc-kube-api-access-fqbgw\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:02.271413 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:02.271384    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:09:02.271790 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:02.271756    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/0.log"
Jul 28 20:09:02.271828 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:02.271788    2561 generic.go:356] "Generic (PLEG): container finished" podID="e8521c01-66a2-4a0d-b772-6b52b0ac644f" containerID="83eb1274b21adca63917da2defec7545da0d355ad6d0f6f388c945525d282423" exitCode=255
Jul 28 20:09:02.271858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:02.271825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt" event={"ID":"e8521c01-66a2-4a0d-b772-6b52b0ac644f","Type":"ContainerDied","Data":"83eb1274b21adca63917da2defec7545da0d355ad6d0f6f388c945525d282423"}
Jul 28 20:09:02.271899 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:02.271883    2561 scope.go:117] "RemoveContainer" containerID="184ad48ad179b015b11bd104a06ba21f1d5c868d961b8e2f42fb265b2ee794d3"
Jul 28 20:09:02.272099 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:02.272079    2561 scope.go:117] "RemoveContainer" containerID="83eb1274b21adca63917da2defec7545da0d355ad6d0f6f388c945525d282423"
Jul 28 20:09:02.272310 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:02.272290    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-vprlt_openshift-console-operator(e8521c01-66a2-4a0d-b772-6b52b0ac644f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt" podUID="e8521c01-66a2-4a0d-b772-6b52b0ac644f"
Jul 28 20:09:02.464284 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:02.464226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:02.464284 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:02.464287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:02.464549 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:02.464368    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:09:02.464549 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:02.464375    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:09:02.464549 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:02.464464    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm podName:875957db-e0ed-4178-9d66-855092ecaddc nodeName:}" failed. No retries permitted until 2026-07-28 20:09:03.464442033 +0000 UTC m=+45.861145181 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfkhg" (UID: "875957db-e0ed-4178-9d66-855092ecaddc") : configmap "kube-rbac-proxy" not found
Jul 28 20:09:02.464549 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:02.464516    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls podName:875957db-e0ed-4178-9d66-855092ecaddc nodeName:}" failed. No retries permitted until 2026-07-28 20:09:03.464502886 +0000 UTC m=+45.861206020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfkhg" (UID: "875957db-e0ed-4178-9d66-855092ecaddc") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:09:02.769061 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:02.769030    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:09:02.769203 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:02.769083    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:09:03.276698 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:03.276672    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:09:03.277094 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:03.276990    2561 scope.go:117] "RemoveContainer" containerID="83eb1274b21adca63917da2defec7545da0d355ad6d0f6f388c945525d282423"
Jul 28 20:09:03.277155 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:03.277134    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-vprlt_openshift-console-operator(e8521c01-66a2-4a0d-b772-6b52b0ac644f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt" podUID="e8521c01-66a2-4a0d-b772-6b52b0ac644f"
Jul 28 20:09:03.473265 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:03.473212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:03.473265 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:03.473265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:03.473440 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:03.473343    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:09:03.473440 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:03.473426    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm podName:875957db-e0ed-4178-9d66-855092ecaddc nodeName:}" failed. No retries permitted until 2026-07-28 20:09:05.4734057 +0000 UTC m=+47.870108857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfkhg" (UID: "875957db-e0ed-4178-9d66-855092ecaddc") : configmap "kube-rbac-proxy" not found
Jul 28 20:09:03.473529 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:03.473460    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:09:03.473529 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:03.473510    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls podName:875957db-e0ed-4178-9d66-855092ecaddc nodeName:}" failed. No retries permitted until 2026-07-28 20:09:05.473498324 +0000 UTC m=+47.870201472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfkhg" (UID: "875957db-e0ed-4178-9d66-855092ecaddc") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:09:04.218066 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:04.218038    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8w5cw_6ac67f8d-9601-4ea3-b073-2acf0ab559be/dns-node-resolver/0.log"
Jul 28 20:09:04.281492 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:04.281466    2561 scope.go:117] "RemoveContainer" containerID="83eb1274b21adca63917da2defec7545da0d355ad6d0f6f388c945525d282423"
Jul 28 20:09:04.281934 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:04.281639    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-vprlt_openshift-console-operator(e8521c01-66a2-4a0d-b772-6b52b0ac644f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt" podUID="e8521c01-66a2-4a0d-b772-6b52b0ac644f"
Jul 28 20:09:05.218971 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:05.218944    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dkw2x_04b71894-3481-4701-b281-895f305778ed/node-ca/0.log"
Jul 28 20:09:05.491279 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:05.491176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:05.491279 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:05.491215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:05.491672 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:05.491365    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:09:05.491672 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:05.491426    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls podName:875957db-e0ed-4178-9d66-855092ecaddc nodeName:}" failed. No retries permitted until 2026-07-28 20:09:09.491412247 +0000 UTC m=+51.888115381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfkhg" (UID: "875957db-e0ed-4178-9d66-855092ecaddc") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:09:05.491672 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:05.491460    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:09:05.491672 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:05.491526    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm podName:875957db-e0ed-4178-9d66-855092ecaddc nodeName:}" failed. No retries permitted until 2026-07-28 20:09:09.491509654 +0000 UTC m=+51.888212809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfkhg" (UID: "875957db-e0ed-4178-9d66-855092ecaddc") : configmap "kube-rbac-proxy" not found
Jul 28 20:09:05.819030 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:05.819000    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5mjp9_e747d2f9-f813-4fcf-a43e-e4562b74decb/serve-healthcheck-canary/0.log"
Jul 28 20:09:06.619901 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:06.619864    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz_f735995e-7787-473c-b8a4-46de2510b36f/kube-storage-version-migrator-operator/0.log"
Jul 28 20:09:08.315878 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:08.315838    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:09:08.316316 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.315954    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:09:08.316316 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.315965    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f78ccb684-q5z4n: secret "image-registry-tls" not found
Jul 28 20:09:08.316316 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.316016    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls podName:a7efc8d5-9803-465d-9c87-9e899507bbcf nodeName:}" failed. No retries permitted until 2026-07-28 20:09:24.3160018 +0000 UTC m=+66.712704934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls") pod "image-registry-f78ccb684-q5z4n" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf") : secret "image-registry-tls" not found
Jul 28 20:09:08.417034 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:08.416997    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:09:08.417230 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:08.417055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:09:08.417230 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:08.417081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:09:08.417230 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:08.417108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:08.417230 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.417151    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:09:08.417230 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.417207    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:09:08.417230 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.417249    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert podName:5a73c164-09ba-4337-b1c9-ec9ab07cf91d nodeName:}" failed. No retries permitted until 2026-07-28 20:09:24.41721495 +0000 UTC m=+66.813918084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-njdbn" (UID: "5a73c164-09ba-4337-b1c9-ec9ab07cf91d") : secret "networking-console-plugin-cert" not found
Jul 28 20:09:08.417497 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.417255    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:09:08.417497 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.417278    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls podName:cf4d8ec7-2e28-47cd-873e-0c94c9879609 nodeName:}" failed. No retries permitted until 2026-07-28 20:09:24.41726299 +0000 UTC m=+66.813966136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-hhkfr" (UID: "cf4d8ec7-2e28-47cd-873e-0c94c9879609") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:09:08.417497 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.417295    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:09:24.417288311 +0000 UTC m=+66.813991445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : configmap references non-existent config key: service-ca.crt
Jul 28 20:09:08.417497 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.417312    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls podName:b54e55c7-a901-427f-8344-7665df115a17 nodeName:}" failed. No retries permitted until 2026-07-28 20:09:24.41729966 +0000 UTC m=+66.814002793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls") pod "cluster-samples-operator-6748489656-fsp75" (UID: "b54e55c7-a901-427f-8344-7665df115a17") : secret "samples-operator-tls" not found
Jul 28 20:09:08.417497 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:08.417332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:08.417497 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.417403    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:09:08.417497 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.417427    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs podName:7e34a811-8e3c-4f37-91b8-c3b6f5251ccd nodeName:}" failed. No retries permitted until 2026-07-28 20:09:24.417420175 +0000 UTC m=+66.814123361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs") pod "router-default-6b5458f665-rgvs8" (UID: "7e34a811-8e3c-4f37-91b8-c3b6f5251ccd") : secret "router-metrics-certs-default" not found
Jul 28 20:09:08.518610 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:08.518570    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:09:08.518787 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.518726    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:09:08.518826 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:08.518792    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls podName:74a7b7f8-0625-40ac-abfa-a433f4bfec5b nodeName:}" failed. No retries permitted until 2026-07-28 20:09:24.518776887 +0000 UTC m=+66.915480021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls") pod "dns-default-rwsms" (UID: "74a7b7f8-0625-40ac-abfa-a433f4bfec5b") : secret "dns-default-metrics-tls" not found
Jul 28 20:09:09.527170 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:09.527123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:09.527170 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:09.527173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:09.527946 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:09.527290    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:09:09.527946 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:09:09.527437    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls podName:875957db-e0ed-4178-9d66-855092ecaddc nodeName:}" failed. No retries permitted until 2026-07-28 20:09:17.527404539 +0000 UTC m=+59.924107687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfkhg" (UID: "875957db-e0ed-4178-9d66-855092ecaddc") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:09:09.527946 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:09.527667    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/875957db-e0ed-4178-9d66-855092ecaddc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:15.070757 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:15.070727    2561 scope.go:117] "RemoveContainer" containerID="83eb1274b21adca63917da2defec7545da0d355ad6d0f6f388c945525d282423"
Jul 28 20:09:15.313961 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:15.313937    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:09:15.314123 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:15.314000    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt" event={"ID":"e8521c01-66a2-4a0d-b772-6b52b0ac644f","Type":"ContainerStarted","Data":"d01089676ac7d05cad9ed9e75d8b052f5f0cac8ba6b039977d9ce20d3ba3fdeb"}
Jul 28 20:09:15.314283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:15.314268    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:09:15.330520 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:15.330431    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt" podStartSLOduration=20.833366315 podStartE2EDuration="28.330416755s" totalImagesPullingTime="7.49705044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:15.329754023 +0000 UTC m=+57.726457181" watchObservedRunningTime="2026-07-28 20:09:15.330416755 +0000 UTC m=+57.727119910"
Jul 28 20:09:15.529730 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:15.529691    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-vprlt"
Jul 28 20:09:17.594556 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:17.594520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:17.596854 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:17.596832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/875957db-e0ed-4178-9d66-855092ecaddc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfkhg\" (UID: \"875957db-e0ed-4178-9d66-855092ecaddc\") " pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:17.733875 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:17.733833    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dfkhg"
Jul 28 20:09:17.857515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:17.857438    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dfkhg"]
Jul 28 20:09:17.860529 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:17.860505    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875957db_e0ed_4178_9d66_855092ecaddc.slice/crio-99a7f54b31d28d0f83388c66dec7a6581aa375132a6d4a818df94bdb4bfb9e32 WatchSource:0}: Error finding container 99a7f54b31d28d0f83388c66dec7a6581aa375132a6d4a818df94bdb4bfb9e32: Status 404 returned error can't find the container with id 99a7f54b31d28d0f83388c66dec7a6581aa375132a6d4a818df94bdb4bfb9e32
Jul 28 20:09:18.202619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:18.202539    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z45h6"
Jul 28 20:09:18.325715 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:18.325677    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfkhg" event={"ID":"875957db-e0ed-4178-9d66-855092ecaddc","Type":"ContainerStarted","Data":"99a7f54b31d28d0f83388c66dec7a6581aa375132a6d4a818df94bdb4bfb9e32"}
Jul 28 20:09:23.345123 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.345047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfkhg" event={"ID":"875957db-e0ed-4178-9d66-855092ecaddc","Type":"ContainerStarted","Data":"fc6e6cda7a46c1de0f3046549189a3c49d24054a0835a70684c938cc55dfc938"}
Jul 28 20:09:23.754902 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.754862    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:09:23.757282 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.757259    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 20:09:23.768727 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.768700    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/600e31fe-6857-4497-8fc5-376fa127489f-original-pull-secret\") pod \"global-pull-secret-syncer-8nzjj\" (UID: \"600e31fe-6857-4497-8fc5-376fa127489f\") " pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:09:23.856495 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.856456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcsbg\" (UniqueName: \"kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg\") pod \"network-check-target-lh75w\" (UID: \"01feb305-3c2b-4e29-a68c-ec74c2947625\") " pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:09:23.856683 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.856527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:09:23.859587 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.859559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcsbg\" (UniqueName: \"kubernetes.io/projected/01feb305-3c2b-4e29-a68c-ec74c2947625-kube-api-access-lcsbg\") pod \"network-check-target-lh75w\" (UID: \"01feb305-3c2b-4e29-a68c-ec74c2947625\") " pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:09:23.859698 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.859564    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 20:09:23.869780 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.869757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2581e4e-d2dd-4022-bf6a-669145444f0f-metrics-certs\") pod \"network-metrics-daemon-jgs7w\" (UID: \"d2581e4e-d2dd-4022-bf6a-669145444f0f\") " pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:09:23.991413 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.991381    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sp59p\""
Jul 28 20:09:23.996338 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.996311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nzjj"
Jul 28 20:09:23.999456 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:23.999437    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:09:24.007059 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.007008    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-82krx\""
Jul 28 20:09:24.014934 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.014915    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jgs7w"
Jul 28 20:09:24.172365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.172288    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8nzjj"]
Jul 28 20:09:24.176002 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:24.175962    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600e31fe_6857_4497_8fc5_376fa127489f.slice/crio-777310be2a79d78a0bbba988e86bf6f79838b06a62d19ece45b64f2ed239e40e WatchSource:0}: Error finding container 777310be2a79d78a0bbba988e86bf6f79838b06a62d19ece45b64f2ed239e40e: Status 404 returned error can't find the container with id 777310be2a79d78a0bbba988e86bf6f79838b06a62d19ece45b64f2ed239e40e
Jul 28 20:09:24.188195 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.188172    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lh75w"]
Jul 28 20:09:24.190943 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:24.190907    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01feb305_3c2b_4e29_a68c_ec74c2947625.slice/crio-2c1314793bc08bab36a13e5cd5add6cccddd87f9922c495e308bad296e9c44e0 WatchSource:0}: Error finding container 2c1314793bc08bab36a13e5cd5add6cccddd87f9922c495e308bad296e9c44e0: Status 404 returned error can't find the container with id 2c1314793bc08bab36a13e5cd5add6cccddd87f9922c495e308bad296e9c44e0
Jul 28 20:09:24.219675 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.219650    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jgs7w"]
Jul 28 20:09:24.222184 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:24.222161    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2581e4e_d2dd_4022_bf6a_669145444f0f.slice/crio-d1b352013c0e602caf3d520aa0e9d45b33df90f5b656a629c7914e13c5219546 WatchSource:0}: Error finding container d1b352013c0e602caf3d520aa0e9d45b33df90f5b656a629c7914e13c5219546: Status 404 returned error can't find the container with id d1b352013c0e602caf3d520aa0e9d45b33df90f5b656a629c7914e13c5219546
Jul 28 20:09:24.350552 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.350408    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lh75w" event={"ID":"01feb305-3c2b-4e29-a68c-ec74c2947625","Type":"ContainerStarted","Data":"58fbd335e700ea0240ff8f5db78756fe866c67ee6febe058ea471f437890432d"}
Jul 28 20:09:24.350552 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.350465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lh75w" event={"ID":"01feb305-3c2b-4e29-a68c-ec74c2947625","Type":"ContainerStarted","Data":"2c1314793bc08bab36a13e5cd5add6cccddd87f9922c495e308bad296e9c44e0"}
Jul 28 20:09:24.350552 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.350488    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:09:24.351751 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.351725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jgs7w" event={"ID":"d2581e4e-d2dd-4022-bf6a-669145444f0f","Type":"ContainerStarted","Data":"d1b352013c0e602caf3d520aa0e9d45b33df90f5b656a629c7914e13c5219546"}
Jul 28 20:09:24.352909 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.352884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8nzjj" event={"ID":"600e31fe-6857-4497-8fc5-376fa127489f","Type":"ContainerStarted","Data":"777310be2a79d78a0bbba988e86bf6f79838b06a62d19ece45b64f2ed239e40e"}
Jul 28 20:09:24.363673 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.363639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:09:24.365169 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.365127    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lh75w" podStartSLOduration=66.365108337 podStartE2EDuration="1m6.365108337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:24.363693359 +0000 UTC m=+66.760396516" watchObservedRunningTime="2026-07-28 20:09:24.365108337 +0000 UTC m=+66.761811494"
Jul 28 20:09:24.366415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.366386    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") pod \"image-registry-f78ccb684-q5z4n\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") " pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:09:24.464670 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.464624    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:09:24.464870 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.464702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:09:24.464870 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.464734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:09:24.464870 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.464767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:24.464870 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.464855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:24.465618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.465594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-service-ca-bundle\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:24.467738 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.467715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf4d8ec7-2e28-47cd-873e-0c94c9879609-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-hhkfr\" (UID: \"cf4d8ec7-2e28-47cd-873e-0c94c9879609\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:09:24.467945 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.467919    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b54e55c7-a901-427f-8344-7665df115a17-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-fsp75\" (UID: \"b54e55c7-a901-427f-8344-7665df115a17\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:09:24.468017 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.467972    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e34a811-8e3c-4f37-91b8-c3b6f5251ccd-metrics-certs\") pod \"router-default-6b5458f665-rgvs8\" (UID: \"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd\") " pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:24.469061 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.469042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a73c164-09ba-4337-b1c9-ec9ab07cf91d-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njdbn\" (UID: \"5a73c164-09ba-4337-b1c9-ec9ab07cf91d\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:09:24.548140 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.548056    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cmltp\""
Jul 28 20:09:24.556343 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.556316    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:09:24.565437 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.565411    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:09:24.567823 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.567797    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a7b7f8-0625-40ac-abfa-a433f4bfec5b-metrics-tls\") pod \"dns-default-rwsms\" (UID: \"74a7b7f8-0625-40ac-abfa-a433f4bfec5b\") " pod="openshift-dns/dns-default-rwsms"
Jul 28 20:09:24.594118 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.594086    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6hzm4\""
Jul 28 20:09:24.602783 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.602755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"
Jul 28 20:09:24.628698 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.628672    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dkf55\""
Jul 28 20:09:24.630317 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.630294    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5mnkr\""
Jul 28 20:09:24.636314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.636297    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:24.638911 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.638885    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"
Jul 28 20:09:24.653857 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.653835    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ds9vt\""
Jul 28 20:09:24.661689 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.661668    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"
Jul 28 20:09:24.740221 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.740196    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-488rx\""
Jul 28 20:09:24.747982 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:24.747956    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwsms"
Jul 28 20:09:26.589413 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.587270    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rwsms"]
Jul 28 20:09:26.589413 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.589508    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f78ccb684-q5z4n"]
Jul 28 20:09:26.619422 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.619346    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b5458f665-rgvs8"]
Jul 28 20:09:26.638417 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.638339    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75"]
Jul 28 20:09:26.773179 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:26.773137    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7efc8d5_9803_465d_9c87_9e899507bbcf.slice/crio-cf570754d384e31dac781f1024f92afeb90288a14ed218b3f5259e608d741e5d WatchSource:0}: Error finding container cf570754d384e31dac781f1024f92afeb90288a14ed218b3f5259e608d741e5d: Status 404 returned error can't find the container with id cf570754d384e31dac781f1024f92afeb90288a14ed218b3f5259e608d741e5d
Jul 28 20:09:26.776411 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:26.776308    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e34a811_8e3c_4f37_91b8_c3b6f5251ccd.slice/crio-0a1336c3d208042715f9a8362609b6c569048c5aaeaff3f31f7356971ccc8cfb WatchSource:0}: Error finding container 0a1336c3d208042715f9a8362609b6c569048c5aaeaff3f31f7356971ccc8cfb: Status 404 returned error can't find the container with id 0a1336c3d208042715f9a8362609b6c569048c5aaeaff3f31f7356971ccc8cfb
Jul 28 20:09:26.776605 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:26.776579    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a7b7f8_0625_40ac_abfa_a433f4bfec5b.slice/crio-d4d296985be4e247f6cf1eca9e2e984595363bd7fdc4d1c158ade97b023f4339 WatchSource:0}: Error finding container d4d296985be4e247f6cf1eca9e2e984595363bd7fdc4d1c158ade97b023f4339: Status 404 returned error can't find the container with id d4d296985be4e247f6cf1eca9e2e984595363bd7fdc4d1c158ade97b023f4339
Jul 28 20:09:26.882434 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.881675    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-njdbn"]
Jul 28 20:09:26.888281 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.887812    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr"]
Jul 28 20:09:26.891081 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:26.891016    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a73c164_09ba_4337_b1c9_ec9ab07cf91d.slice/crio-30423d3aef76a232a1961d5288e46f4f8c8768cff7a3532e9e521ebed72165a1 WatchSource:0}: Error finding container 30423d3aef76a232a1961d5288e46f4f8c8768cff7a3532e9e521ebed72165a1: Status 404 returned error can't find the container with id 30423d3aef76a232a1961d5288e46f4f8c8768cff7a3532e9e521ebed72165a1
Jul 28 20:09:26.930297 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.930180    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"]
Jul 28 20:09:26.933743 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.933719    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:26.937376 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.937179    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 20:09:26.937662 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.937545    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 20:09:26.938450 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.938292    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 20:09:26.938450 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.938292    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 20:09:26.956425 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:26.956207    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"]
Jul 28 20:09:27.027520 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.026874    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-5cvg4"]
Jul 28 20:09:27.031711 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.031661    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-5cvg4"
Jul 28 20:09:27.034476 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.034446    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 20:09:27.035480 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.034689    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 20:09:27.035480 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.034898    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xm5gm\""
Jul 28 20:09:27.045453 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.045382    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-5cvg4"]
Jul 28 20:09:27.088819 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.088791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9778c83a-318f-41d7-afde-2cc7c9b7806f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f97f775d8-fkw86\" (UID: \"9778c83a-318f-41d7-afde-2cc7c9b7806f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:27.088943 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.088868    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9778c83a-318f-41d7-afde-2cc7c9b7806f-tmp\") pod \"klusterlet-addon-workmgr-7f97f775d8-fkw86\" (UID: \"9778c83a-318f-41d7-afde-2cc7c9b7806f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:27.088943 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.088920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m66t\" (UniqueName: \"kubernetes.io/projected/9778c83a-318f-41d7-afde-2cc7c9b7806f-kube-api-access-2m66t\") pod \"klusterlet-addon-workmgr-7f97f775d8-fkw86\" (UID: \"9778c83a-318f-41d7-afde-2cc7c9b7806f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:27.190195 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.190119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9778c83a-318f-41d7-afde-2cc7c9b7806f-tmp\") pod \"klusterlet-addon-workmgr-7f97f775d8-fkw86\" (UID: \"9778c83a-318f-41d7-afde-2cc7c9b7806f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:27.190195 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.190174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m66t\" (UniqueName: \"kubernetes.io/projected/9778c83a-318f-41d7-afde-2cc7c9b7806f-kube-api-access-2m66t\") pod \"klusterlet-addon-workmgr-7f97f775d8-fkw86\" (UID: \"9778c83a-318f-41d7-afde-2cc7c9b7806f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:27.190426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.190222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkcct\" (UniqueName: \"kubernetes.io/projected/d5d3fc94-1e79-4286-841b-f6740596a1bd-kube-api-access-rkcct\") pod \"downloads-7c97dc4555-5cvg4\" (UID: \"d5d3fc94-1e79-4286-841b-f6740596a1bd\") " pod="openshift-console/downloads-7c97dc4555-5cvg4"
Jul 28 20:09:27.190426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.190289    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9778c83a-318f-41d7-afde-2cc7c9b7806f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f97f775d8-fkw86\" (UID: \"9778c83a-318f-41d7-afde-2cc7c9b7806f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:27.190533 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.190496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9778c83a-318f-41d7-afde-2cc7c9b7806f-tmp\") pod \"klusterlet-addon-workmgr-7f97f775d8-fkw86\" (UID: \"9778c83a-318f-41d7-afde-2cc7c9b7806f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:27.193639 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.193615    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9778c83a-318f-41d7-afde-2cc7c9b7806f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f97f775d8-fkw86\" (UID: \"9778c83a-318f-41d7-afde-2cc7c9b7806f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:27.205101 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.205073    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m66t\" (UniqueName: \"kubernetes.io/projected/9778c83a-318f-41d7-afde-2cc7c9b7806f-kube-api-access-2m66t\") pod \"klusterlet-addon-workmgr-7f97f775d8-fkw86\" (UID: \"9778c83a-318f-41d7-afde-2cc7c9b7806f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:27.266682 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.266646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:27.291092 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.291054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkcct\" (UniqueName: \"kubernetes.io/projected/d5d3fc94-1e79-4286-841b-f6740596a1bd-kube-api-access-rkcct\") pod \"downloads-7c97dc4555-5cvg4\" (UID: \"d5d3fc94-1e79-4286-841b-f6740596a1bd\") " pod="openshift-console/downloads-7c97dc4555-5cvg4"
Jul 28 20:09:27.299794 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.299766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkcct\" (UniqueName: \"kubernetes.io/projected/d5d3fc94-1e79-4286-841b-f6740596a1bd-kube-api-access-rkcct\") pod \"downloads-7c97dc4555-5cvg4\" (UID: \"d5d3fc94-1e79-4286-841b-f6740596a1bd\") " pod="openshift-console/downloads-7c97dc4555-5cvg4"
Jul 28 20:09:27.347608 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.347296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-5cvg4"
Jul 28 20:09:27.370112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.369989    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75" event={"ID":"b54e55c7-a901-427f-8344-7665df115a17","Type":"ContainerStarted","Data":"71ce12e441ee4c1f7ee3a1b7195f33cfc167d13a0888d06aab325bb0b28bdae0"}
Jul 28 20:09:27.371918 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.371835    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwsms" event={"ID":"74a7b7f8-0625-40ac-abfa-a433f4bfec5b","Type":"ContainerStarted","Data":"d4d296985be4e247f6cf1eca9e2e984595363bd7fdc4d1c158ade97b023f4339"}
Jul 28 20:09:27.376244 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.375338    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n" event={"ID":"a7efc8d5-9803-465d-9c87-9e899507bbcf","Type":"ContainerStarted","Data":"6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30"}
Jul 28 20:09:27.376244 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.375385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n" event={"ID":"a7efc8d5-9803-465d-9c87-9e899507bbcf","Type":"ContainerStarted","Data":"cf570754d384e31dac781f1024f92afeb90288a14ed218b3f5259e608d741e5d"}
Jul 28 20:09:27.376244 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.376160    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:09:27.380319 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.380222    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfkhg" event={"ID":"875957db-e0ed-4178-9d66-855092ecaddc","Type":"ContainerStarted","Data":"15652b1e1302f613dc3f3b0fb194a6fb80137be187c45a9c1f759118b66c0e65"}
Jul 28 20:09:27.387308 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.387208    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jgs7w" event={"ID":"d2581e4e-d2dd-4022-bf6a-669145444f0f","Type":"ContainerStarted","Data":"7e4d38de0ebf68395056f2e87969b320c202a77a009ca5dbdc3ed95c8765e8e7"}
Jul 28 20:09:27.387308 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.387278    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jgs7w" event={"ID":"d2581e4e-d2dd-4022-bf6a-669145444f0f","Type":"ContainerStarted","Data":"4d71f503ca5fe08b7b71c33cc2177bfd75952c26e75734b77287133ffa46609d"}
Jul 28 20:09:27.389324 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.389208    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn" event={"ID":"5a73c164-09ba-4337-b1c9-ec9ab07cf91d","Type":"ContainerStarted","Data":"30423d3aef76a232a1961d5288e46f4f8c8768cff7a3532e9e521ebed72165a1"}
Jul 28 20:09:27.390591 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.390565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr" event={"ID":"cf4d8ec7-2e28-47cd-873e-0c94c9879609","Type":"ContainerStarted","Data":"84d7548bf516618398734a37280a169ae80e4391de2ef57e37690ab56cbad93f"}
Jul 28 20:09:27.394599 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.393557    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b5458f665-rgvs8" event={"ID":"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd","Type":"ContainerStarted","Data":"094f6197d07881ef7b0f1511fc3d0eee93bb784432411304edbaebe3520bbc9b"}
Jul 28 20:09:27.394599 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.393599    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b5458f665-rgvs8" event={"ID":"7e34a811-8e3c-4f37-91b8-c3b6f5251ccd","Type":"ContainerStarted","Data":"0a1336c3d208042715f9a8362609b6c569048c5aaeaff3f31f7356971ccc8cfb"}
Jul 28 20:09:27.422113 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.421984    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n" podStartSLOduration=69.421960392 podStartE2EDuration="1m9.421960392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:27.401715143 +0000 UTC m=+69.798418301" watchObservedRunningTime="2026-07-28 20:09:27.421960392 +0000 UTC m=+69.818663552"
Jul 28 20:09:27.422933 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.422695    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b5458f665-rgvs8" podStartSLOduration=40.42268031 podStartE2EDuration="40.42268031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:27.421007487 +0000 UTC m=+69.817710682" watchObservedRunningTime="2026-07-28 20:09:27.42268031 +0000 UTC m=+69.819383468"
Jul 28 20:09:27.435505 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.435441    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"]
Jul 28 20:09:27.536417 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.536357    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jgs7w" podStartSLOduration=66.932403927 podStartE2EDuration="1m9.536331314s" totalImagesPullingTime="2.603927387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:27.437059933 +0000 UTC m=+69.833763092" watchObservedRunningTime="2026-07-28 20:09:27.536331314 +0000 UTC m=+69.933034472"
Jul 28 20:09:27.539022 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.537690    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-5cvg4"]
Jul 28 20:09:27.546615 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:27.546584    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d3fc94_1e79_4286_841b_f6740596a1bd.slice/crio-1c694ecd1e71a6cb20a8bf7fbe42d5559edb14f19407c65e32cb2feda4d4af3a WatchSource:0}: Error finding container 1c694ecd1e71a6cb20a8bf7fbe42d5559edb14f19407c65e32cb2feda4d4af3a: Status 404 returned error can't find the container with id 1c694ecd1e71a6cb20a8bf7fbe42d5559edb14f19407c65e32cb2feda4d4af3a
Jul 28 20:09:27.637654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.637563    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:27.640434 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:27.640115    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:28.408486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:28.408395    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86" event={"ID":"9778c83a-318f-41d7-afde-2cc7c9b7806f","Type":"ContainerStarted","Data":"543a09419d187874358198c50c6f9a0690398b789715bf3f5df5447b87b9baf3"}
Jul 28 20:09:28.410309 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:28.410272    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-5cvg4" event={"ID":"d5d3fc94-1e79-4286-841b-f6740596a1bd","Type":"ContainerStarted","Data":"1c694ecd1e71a6cb20a8bf7fbe42d5559edb14f19407c65e32cb2feda4d4af3a"}
Jul 28 20:09:28.411855 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:28.411626    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:28.413089 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:28.412877    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b5458f665-rgvs8"
Jul 28 20:09:32.023437 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.023400    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c8cc87967-sn6j6"]
Jul 28 20:09:32.037981 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.037949    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8cc87967-sn6j6"]
Jul 28 20:09:32.038148 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.038060    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.040598 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.040572    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 20:09:32.040806 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.040783    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 20:09:32.041041 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.041025    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 20:09:32.041875 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.041533    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 20:09:32.041875 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.041730    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 20:09:32.041875 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.041797    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9zrj5\""
Jul 28 20:09:32.132438 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.132386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-serving-cert\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.132604 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.132466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-console-config\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.132604 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.132504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzw4m\" (UniqueName: \"kubernetes.io/projected/4a28ab16-8d27-4c60-b713-f19952b888b1-kube-api-access-lzw4m\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.132604 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.132524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-oauth-config\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.132604 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.132560    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-service-ca\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.132604 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.132582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-oauth-serving-cert\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.233884 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.233844    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-service-ca\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.233884 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.233887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-oauth-serving-cert\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.234126 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.233922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-serving-cert\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.234126 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.233962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-console-config\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.234225 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.234154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzw4m\" (UniqueName: \"kubernetes.io/projected/4a28ab16-8d27-4c60-b713-f19952b888b1-kube-api-access-lzw4m\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.234225 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.234199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-oauth-config\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.234827 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.234805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-service-ca\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.234934 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.234810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-console-config\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.235161 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.235138    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-oauth-serving-cert\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.237080 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.237061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-oauth-config\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.237956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.237936    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-serving-cert\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.243818 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.243793    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzw4m\" (UniqueName: \"kubernetes.io/projected/4a28ab16-8d27-4c60-b713-f19952b888b1-kube-api-access-lzw4m\") pod \"console-5c8cc87967-sn6j6\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") " pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:32.350644 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:32.350566    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:38.775880 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:38.775368    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8cc87967-sn6j6"]
Jul 28 20:09:38.783164 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:38.783128    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a28ab16_8d27_4c60_b713_f19952b888b1.slice/crio-b095b371c48ddddc97d70c67fd185d0b0be4948b3d72749aab0855fc62323fe5 WatchSource:0}: Error finding container b095b371c48ddddc97d70c67fd185d0b0be4948b3d72749aab0855fc62323fe5: Status 404 returned error can't find the container with id b095b371c48ddddc97d70c67fd185d0b0be4948b3d72749aab0855fc62323fe5
Jul 28 20:09:39.476300 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.476267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn" event={"ID":"5a73c164-09ba-4337-b1c9-ec9ab07cf91d","Type":"ContainerStarted","Data":"4bc691d22866dbea54b28e74ebeb5f733d826c6c06358a75fd41b4021ae8ee89"}
Jul 28 20:09:39.478868 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.478843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86" event={"ID":"9778c83a-318f-41d7-afde-2cc7c9b7806f","Type":"ContainerStarted","Data":"4d120da48a4a3a9f3f5e0a2ac640c781595af75607b68a3c882f6b002a74bc0a"}
Jul 28 20:09:39.479118 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.479101    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:39.480962 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.480944    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86"
Jul 28 20:09:39.482134 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.482108    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75" event={"ID":"b54e55c7-a901-427f-8344-7665df115a17","Type":"ContainerStarted","Data":"c1d8dc8a08a0dcbbac14b8430d66405012e3009e1ff758466c15d1ab5bd120ad"}
Jul 28 20:09:39.482229 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.482159    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75" event={"ID":"b54e55c7-a901-427f-8344-7665df115a17","Type":"ContainerStarted","Data":"71007f7445c57fbf2374fc497d5d998023b647bee384132a81f77b65cf88cce2"}
Jul 28 20:09:39.484068 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.483995    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8cc87967-sn6j6" event={"ID":"4a28ab16-8d27-4c60-b713-f19952b888b1","Type":"ContainerStarted","Data":"b095b371c48ddddc97d70c67fd185d0b0be4948b3d72749aab0855fc62323fe5"}
Jul 28 20:09:39.485528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.485499    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8nzjj" event={"ID":"600e31fe-6857-4497-8fc5-376fa127489f","Type":"ContainerStarted","Data":"d127f085c3d6bd426b7b518ba6adcf0a8265fe54738f5dae2ff5b7bfe4f13d1a"}
Jul 28 20:09:39.488619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.488267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr" event={"ID":"cf4d8ec7-2e28-47cd-873e-0c94c9879609","Type":"ContainerStarted","Data":"b2ef7460e30e290b849d9553719b6281b2443cf029d662817ca60b2d8a7d35c5"}
Jul 28 20:09:39.490565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.490452    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwsms" event={"ID":"74a7b7f8-0625-40ac-abfa-a433f4bfec5b","Type":"ContainerStarted","Data":"5bef560a9601197caf5867be0372ed97cf5776b6ced8bbe19c560e9adb77c8f9"}
Jul 28 20:09:39.490565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.490499    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwsms" event={"ID":"74a7b7f8-0625-40ac-abfa-a433f4bfec5b","Type":"ContainerStarted","Data":"a082b0222abd550af4ff1399fa6b00af3f3e885a7a188ef767608cdb457981e2"}
Jul 28 20:09:39.490565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.490529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rwsms"
Jul 28 20:09:39.494704 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.494680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfkhg" event={"ID":"875957db-e0ed-4178-9d66-855092ecaddc","Type":"ContainerStarted","Data":"5ebb92b157b705d04a9f064a620191b9931670ebaa4af0f6eeb45322a47ba87a"}
Jul 28 20:09:39.516444 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.516384    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-njdbn" podStartSLOduration=49.397316718 podStartE2EDuration="51.516360553s" totalImagesPullingTime="2.119043835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:39.494394139 +0000 UTC m=+81.891097316" watchObservedRunningTime="2026-07-28 20:09:39.516360553 +0000 UTC m=+81.913063711"
Jul 28 20:09:39.537984 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.536902    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-hhkfr" podStartSLOduration=39.831533801 podStartE2EDuration="51.536880565s" totalImagesPullingTime="11.705346764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:39.535794904 +0000 UTC m=+81.932498061" watchObservedRunningTime="2026-07-28 20:09:39.536880565 +0000 UTC m=+81.933583723"
Jul 28 20:09:39.537984 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.537053    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8nzjj" podStartSLOduration=67.11058614 podStartE2EDuration="1m21.537031245s" totalImagesPullingTime="14.426445105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:39.516881411 +0000 UTC m=+81.913584568" watchObservedRunningTime="2026-07-28 20:09:39.537031245 +0000 UTC m=+81.933734399"
Jul 28 20:09:39.559051 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.558963    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-fsp75" podStartSLOduration=40.78474478 podStartE2EDuration="52.558940993s" totalImagesPullingTime="11.774196213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:39.557227347 +0000 UTC m=+81.953930520" watchObservedRunningTime="2026-07-28 20:09:39.558940993 +0000 UTC m=+81.955644150"
Jul 28 20:09:39.574403 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.574274    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f97f775d8-fkw86" podStartSLOduration=2.392588514 podStartE2EDuration="13.57425763s" totalImagesPullingTime="11.181669116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:39.573502281 +0000 UTC m=+81.970205438" watchObservedRunningTime="2026-07-28 20:09:39.57425763 +0000 UTC m=+81.970960787"
Jul 28 20:09:39.596048 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.595994    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rwsms" podStartSLOduration=35.770220625 podStartE2EDuration="47.595980958s" totalImagesPullingTime="11.825760333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:39.59437448 +0000 UTC m=+81.991077637" watchObservedRunningTime="2026-07-28 20:09:39.595980958 +0000 UTC m=+81.992684114"
Jul 28 20:09:39.612418 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:39.612359    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dfkhg" podStartSLOduration=18.087899025 podStartE2EDuration="38.6123423s" totalImagesPullingTime="20.524443275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:09:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:39.611153365 +0000 UTC m=+82.007856523" watchObservedRunningTime="2026-07-28 20:09:39.6123423 +0000 UTC m=+82.009045456"
Jul 28 20:09:44.561418 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:44.561164    2561 patch_prober.go:28] interesting pod/image-registry-f78ccb684-q5z4n container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 20:09:44.561418 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:44.561228    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n" podUID="a7efc8d5-9803-465d-9c87-9e899507bbcf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:09:48.533466 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:48.533427    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-5cvg4" event={"ID":"d5d3fc94-1e79-4286-841b-f6740596a1bd","Type":"ContainerStarted","Data":"cc72edffd15cb5ac8f721490ce2fd43369be4a33a8334de81129de7b255d9a52"}
Jul 28 20:09:48.533898 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:48.533622    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-5cvg4"
Jul 28 20:09:48.535139 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:48.535112    2561 patch_prober.go:28] interesting pod/downloads-7c97dc4555-5cvg4 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.21:8080/\": dial tcp 10.132.0.21:8080: connect: connection refused" start-of-body=
Jul 28 20:09:48.535273 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:48.535175    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-5cvg4" podUID="d5d3fc94-1e79-4286-841b-f6740596a1bd" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.21:8080/\": dial tcp 10.132.0.21:8080: connect: connection refused"
Jul 28 20:09:48.535273 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:48.535123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8cc87967-sn6j6" event={"ID":"4a28ab16-8d27-4c60-b713-f19952b888b1","Type":"ContainerStarted","Data":"000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e"}
Jul 28 20:09:48.553737 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:48.553690    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-5cvg4" podStartSLOduration=0.859457959 podStartE2EDuration="21.55367476s" totalImagesPullingTime="20.694216801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:48.551901085 +0000 UTC m=+90.948604240" watchObservedRunningTime="2026-07-28 20:09:48.55367476 +0000 UTC m=+90.950377915"
Jul 28 20:09:48.572410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:48.572362    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c8cc87967-sn6j6" podStartSLOduration=8.128132611 podStartE2EDuration="17.572345271s" totalImagesPullingTime="9.44421266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:48.571335162 +0000 UTC m=+90.968038320" watchObservedRunningTime="2026-07-28 20:09:48.572345271 +0000 UTC m=+90.969048427"
Jul 28 20:09:49.427184 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:49.427143    2561 patch_prober.go:28] interesting pod/image-registry-f78ccb684-q5z4n container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 20:09:49.427383 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:49.427275    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n" podUID="a7efc8d5-9803-465d-9c87-9e899507bbcf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:09:49.501205 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:49.501166    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rwsms"
Jul 28 20:09:49.552950 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:49.552916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-5cvg4"
Jul 28 20:09:50.298962 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:50.298917    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f78ccb684-q5z4n"]
Jul 28 20:09:50.304248 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:50.304200    2561 patch_prober.go:28] interesting pod/image-registry-f78ccb684-q5z4n container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 20:09:50.304424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:50.304290    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n" podUID="a7efc8d5-9803-465d-9c87-9e899507bbcf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:09:51.939655 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:51.939621    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h8clp"]
Jul 28 20:09:51.988081 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:51.988051    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:51.991029 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:51.991000    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 20:09:51.991164 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:51.991133    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 20:09:51.991258 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:51.991183    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 20:09:51.991877 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:51.991859    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 20:09:51.991972 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:51.991898    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w8qwr\""
Jul 28 20:09:52.115103 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.115066    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-tls\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.115103 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.115112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.115396 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.115142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-root\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.115396 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.115218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-textfile\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.115396 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.115305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-sys\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.115396 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.115343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-metrics-client-ca\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.115584 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.115405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphdf\" (UniqueName: \"kubernetes.io/projected/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-kube-api-access-wphdf\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.115584 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.115471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-accelerators-collector-config\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.115584 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.115507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-wtmp\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216482 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-sys\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216482 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216437    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-metrics-client-ca\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216494    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wphdf\" (UniqueName: \"kubernetes.io/projected/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-kube-api-access-wphdf\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-accelerators-collector-config\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-sys\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-wtmp\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-tls\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-root\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216746    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-textfile\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216710    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-wtmp\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.216996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.216913    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-root\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.217189 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.217099    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-textfile\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.217272 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.217222    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-accelerators-collector-config\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.217406 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.217386    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-metrics-client-ca\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.219519 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.219495    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.219637 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.219616    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-node-exporter-tls\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.228104 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.228075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphdf\" (UniqueName: \"kubernetes.io/projected/a8282c6b-3a46-45ca-acc0-db6fcbaa1290-kube-api-access-wphdf\") pod \"node-exporter-h8clp\" (UID: \"a8282c6b-3a46-45ca-acc0-db6fcbaa1290\") " pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.299260 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.299208    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h8clp"
Jul 28 20:09:52.346202 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:09:52.346155    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8282c6b_3a46_45ca_acc0_db6fcbaa1290.slice/crio-e2104def7dc48f35e8162ce4c368b65a014bca22a219c27183203c6d2bfeb7f5 WatchSource:0}: Error finding container e2104def7dc48f35e8162ce4c368b65a014bca22a219c27183203c6d2bfeb7f5: Status 404 returned error can't find the container with id e2104def7dc48f35e8162ce4c368b65a014bca22a219c27183203c6d2bfeb7f5
Jul 28 20:09:52.351582 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.350929    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:52.351582 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.351019    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:52.356914 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.356889    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:52.554111 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.554074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h8clp" event={"ID":"a8282c6b-3a46-45ca-acc0-db6fcbaa1290","Type":"ContainerStarted","Data":"e2104def7dc48f35e8162ce4c368b65a014bca22a219c27183203c6d2bfeb7f5"}
Jul 28 20:09:52.558745 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:52.558715    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:09:54.564616 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:54.564577    2561 generic.go:356] "Generic (PLEG): container finished" podID="a8282c6b-3a46-45ca-acc0-db6fcbaa1290" containerID="1362b3f8a79a28e9fbc14563c13121efcd6e7065cfa3c930f01b601ba6bb0a3f" exitCode=0
Jul 28 20:09:54.565079 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:54.564671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h8clp" event={"ID":"a8282c6b-3a46-45ca-acc0-db6fcbaa1290","Type":"ContainerDied","Data":"1362b3f8a79a28e9fbc14563c13121efcd6e7065cfa3c930f01b601ba6bb0a3f"}
Jul 28 20:09:55.359228 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:55.359196    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lh75w"
Jul 28 20:09:55.572997 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:55.572955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h8clp" event={"ID":"a8282c6b-3a46-45ca-acc0-db6fcbaa1290","Type":"ContainerStarted","Data":"cf548ed05dcf67b024d613f381595380b02c4b55c1b9ff7bae38411819ab3acf"}
Jul 28 20:09:55.573469 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:55.573066    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h8clp" event={"ID":"a8282c6b-3a46-45ca-acc0-db6fcbaa1290","Type":"ContainerStarted","Data":"03835e2d79669b538a88c2203173ddbcd559394c0df03ad9f1695f997e8460c9"}
Jul 28 20:09:55.592443 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:09:55.592378    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h8clp" podStartSLOduration=2.923886173 podStartE2EDuration="4.592360443s" totalImagesPullingTime="1.573166549s" totalInitContainerRuntime="95.307721ms" isStatefulPod=true podCreationTimestamp="2026-07-28 20:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:09:55.590458295 +0000 UTC m=+97.987161484" watchObservedRunningTime="2026-07-28 20:09:55.592360443 +0000 UTC m=+97.989063598"
Jul 28 20:10:00.303629 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:00.303601    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:10:02.874879 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:02.874831    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cc77c9fd7-tj8dt"]
Jul 28 20:10:02.965803 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:02.965770    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cc77c9fd7-tj8dt"]
Jul 28 20:10:02.965959 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:02.965871    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:02.974427 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:02.974403    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 20:10:03.115334 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.115303    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-oauth-serving-cert\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.115492 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.115341    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-service-ca\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.115492 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.115360    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26j9g\" (UniqueName: \"kubernetes.io/projected/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-kube-api-access-26j9g\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.115492 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.115404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-oauth-config\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.115492 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.115451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-config\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.115492 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.115478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-trusted-ca-bundle\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.115650 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.115512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-serving-cert\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.216858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.216777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-oauth-serving-cert\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.216858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.216816    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-service-ca\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.216858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.216833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26j9g\" (UniqueName: \"kubernetes.io/projected/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-kube-api-access-26j9g\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.216858 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.216851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-oauth-config\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.217161 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.216877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-config\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.217161 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.216893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-trusted-ca-bundle\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.217161 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.216932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-serving-cert\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.217693 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.217661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-service-ca\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.217808 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.217701    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-config\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.217808 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.217714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-oauth-serving-cert\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.218048 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.218026    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-trusted-ca-bundle\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.219498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.219478    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-serving-cert\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.219586 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.219479    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-oauth-config\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.227708 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.227681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26j9g\" (UniqueName: \"kubernetes.io/projected/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-kube-api-access-26j9g\") pod \"console-7cc77c9fd7-tj8dt\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") " pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.275020 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.274980    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:03.434508 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.434440    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cc77c9fd7-tj8dt"]
Jul 28 20:10:03.438219 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:10:03.438186    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f3e4fc_2c4b_4af1_8ee5_7eebd2fe38f3.slice/crio-f0d1725a3550f79eded3743d5b19fe1947d3a7fc99815464b31d45a4d6f11e09 WatchSource:0}: Error finding container f0d1725a3550f79eded3743d5b19fe1947d3a7fc99815464b31d45a4d6f11e09: Status 404 returned error can't find the container with id f0d1725a3550f79eded3743d5b19fe1947d3a7fc99815464b31d45a4d6f11e09
Jul 28 20:10:03.604048 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.604011    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc77c9fd7-tj8dt" event={"ID":"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3","Type":"ContainerStarted","Data":"a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866"}
Jul 28 20:10:03.604260 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.604073    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc77c9fd7-tj8dt" event={"ID":"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3","Type":"ContainerStarted","Data":"f0d1725a3550f79eded3743d5b19fe1947d3a7fc99815464b31d45a4d6f11e09"}
Jul 28 20:10:03.631745 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:03.631694    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cc77c9fd7-tj8dt" podStartSLOduration=1.631678563 podStartE2EDuration="1.631678563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:10:03.629908316 +0000 UTC m=+106.026611507" watchObservedRunningTime="2026-07-28 20:10:03.631678563 +0000 UTC m=+106.028381720"
Jul 28 20:10:06.617895 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:06.617861    2561 generic.go:356] "Generic (PLEG): container finished" podID="b40f4867-d257-4088-9aaf-7fba209130bc" containerID="60aa6efcec0a59310e27c373790e4cf918f9a15ec7aea62de93e3669edab667a" exitCode=0
Jul 28 20:10:06.618317 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:06.617936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v" event={"ID":"b40f4867-d257-4088-9aaf-7fba209130bc","Type":"ContainerDied","Data":"60aa6efcec0a59310e27c373790e4cf918f9a15ec7aea62de93e3669edab667a"}
Jul 28 20:10:06.618368 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:06.618310    2561 scope.go:117] "RemoveContainer" containerID="60aa6efcec0a59310e27c373790e4cf918f9a15ec7aea62de93e3669edab667a"
Jul 28 20:10:07.623710 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:07.623676    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ml89v" event={"ID":"b40f4867-d257-4088-9aaf-7fba209130bc","Type":"ContainerStarted","Data":"9e93021be3137c4e5cad24160b7ac027a7c7d9ccffee1d5367f232df7bac2293"}
Jul 28 20:10:13.275864 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:13.275827    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:13.276371 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:13.275886    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:13.280722 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:13.280703    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:13.648573 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:13.648494    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:10:13.699448 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:13.699411    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8cc87967-sn6j6"]
Jul 28 20:10:15.322468 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.322420    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n" podUID="a7efc8d5-9803-465d-9c87-9e899507bbcf" containerName="registry" containerID="cri-o://6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30" gracePeriod=30
Jul 28 20:10:15.594326 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.594257    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:10:15.623392 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.623355    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-bound-sa-token\") pod \"a7efc8d5-9803-465d-9c87-9e899507bbcf\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") "
Jul 28 20:10:15.623544 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.623411    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efc8d5-9803-465d-9c87-9e899507bbcf-ca-trust-extracted\") pod \"a7efc8d5-9803-465d-9c87-9e899507bbcf\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") "
Jul 28 20:10:15.623544 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.623455    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-installation-pull-secrets\") pod \"a7efc8d5-9803-465d-9c87-9e899507bbcf\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") "
Jul 28 20:10:15.623544 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.623502    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") pod \"a7efc8d5-9803-465d-9c87-9e899507bbcf\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") "
Jul 28 20:10:15.623544 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.623532    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-image-registry-private-configuration\") pod \"a7efc8d5-9803-465d-9c87-9e899507bbcf\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") "
Jul 28 20:10:15.623742 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.623567    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4dqz\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-kube-api-access-s4dqz\") pod \"a7efc8d5-9803-465d-9c87-9e899507bbcf\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") "
Jul 28 20:10:15.623742 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.623596    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-certificates\") pod \"a7efc8d5-9803-465d-9c87-9e899507bbcf\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") "
Jul 28 20:10:15.623742 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.623644    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-trusted-ca\") pod \"a7efc8d5-9803-465d-9c87-9e899507bbcf\" (UID: \"a7efc8d5-9803-465d-9c87-9e899507bbcf\") "
Jul 28 20:10:15.624286 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.624259    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a7efc8d5-9803-465d-9c87-9e899507bbcf" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:10:15.624473 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.624272    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a7efc8d5-9803-465d-9c87-9e899507bbcf" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:10:15.626479 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.626457    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a7efc8d5-9803-465d-9c87-9e899507bbcf" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:10:15.626625 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.626507    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a7efc8d5-9803-465d-9c87-9e899507bbcf" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:10:15.626625 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.626605    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-kube-api-access-s4dqz" (OuterVolumeSpecName: "kube-api-access-s4dqz") pod "a7efc8d5-9803-465d-9c87-9e899507bbcf" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf"). InnerVolumeSpecName "kube-api-access-s4dqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:10:15.626896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.626704    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a7efc8d5-9803-465d-9c87-9e899507bbcf" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:10:15.626896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.626796    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a7efc8d5-9803-465d-9c87-9e899507bbcf" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:10:15.635009 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.634974    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7efc8d5-9803-465d-9c87-9e899507bbcf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a7efc8d5-9803-465d-9c87-9e899507bbcf" (UID: "a7efc8d5-9803-465d-9c87-9e899507bbcf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:10:15.654350 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.654319    2561 generic.go:356] "Generic (PLEG): container finished" podID="a7efc8d5-9803-465d-9c87-9e899507bbcf" containerID="6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30" exitCode=0
Jul 28 20:10:15.654464 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.654367    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n"
Jul 28 20:10:15.654464 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.654405    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n" event={"ID":"a7efc8d5-9803-465d-9c87-9e899507bbcf","Type":"ContainerDied","Data":"6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30"}
Jul 28 20:10:15.654554 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.654493    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f78ccb684-q5z4n" event={"ID":"a7efc8d5-9803-465d-9c87-9e899507bbcf","Type":"ContainerDied","Data":"cf570754d384e31dac781f1024f92afeb90288a14ed218b3f5259e608d741e5d"}
Jul 28 20:10:15.654554 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.654518    2561 scope.go:117] "RemoveContainer" containerID="6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30"
Jul 28 20:10:15.683875 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.680949    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f78ccb684-q5z4n"]
Jul 28 20:10:15.686947 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.686915    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f78ccb684-q5z4n"]
Jul 28 20:10:15.687999 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.687979    2561 scope.go:117] "RemoveContainer" containerID="6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30"
Jul 28 20:10:15.688386 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:10:15.688362    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30\": container with ID starting with 6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30 not found: ID does not exist" containerID="6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30"
Jul 28 20:10:15.688469 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.688395    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30"} err="failed to get container status \"6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30\": rpc error: code = NotFound desc = could not find container \"6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30\": container with ID starting with 6e3fd39f9083e2cca9f697e3b3ae612656b0b52b98cfe8bc2b7e76b159bf0c30 not found: ID does not exist"
Jul 28 20:10:15.724314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.724281    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-installation-pull-secrets\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.724314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.724309    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-tls\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.724498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.724327    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efc8d5-9803-465d-9c87-9e899507bbcf-image-registry-private-configuration\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.724498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.724337    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4dqz\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-kube-api-access-s4dqz\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.724498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.724346    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-registry-certificates\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.724498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.724353    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efc8d5-9803-465d-9c87-9e899507bbcf-trusted-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.724498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.724361    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efc8d5-9803-465d-9c87-9e899507bbcf-bound-sa-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:15.724498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:15.724369    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efc8d5-9803-465d-9c87-9e899507bbcf-ca-trust-extracted\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:16.076221 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:16.076188    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7efc8d5-9803-465d-9c87-9e899507bbcf" path="/var/lib/kubelet/pods/a7efc8d5-9803-465d-9c87-9e899507bbcf/volumes"
Jul 28 20:10:16.660371 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:16.660276    2561 generic.go:356] "Generic (PLEG): container finished" podID="f735995e-7787-473c-b8a4-46de2510b36f" containerID="690ca19a6cd3f187e55bdcce568cb5cd10eb4e4fde2af1352fcc10fc225cdc5d" exitCode=0
Jul 28 20:10:16.660371 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:16.660349    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz" event={"ID":"f735995e-7787-473c-b8a4-46de2510b36f","Type":"ContainerDied","Data":"690ca19a6cd3f187e55bdcce568cb5cd10eb4e4fde2af1352fcc10fc225cdc5d"}
Jul 28 20:10:16.660822 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:16.660711    2561 scope.go:117] "RemoveContainer" containerID="690ca19a6cd3f187e55bdcce568cb5cd10eb4e4fde2af1352fcc10fc225cdc5d"
Jul 28 20:10:17.667613 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:17.667581    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz" event={"ID":"f735995e-7787-473c-b8a4-46de2510b36f","Type":"ContainerStarted","Data":"b0d090938fe6ebed0007e01dcc25e60c55c84c95bd9091424ce017389f2faf7a"}
Jul 28 20:10:36.739571 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:36.739539    2561 generic.go:356] "Generic (PLEG): container finished" podID="7e6f21f4-9b6c-4595-bd37-7b4661e09d0c" containerID="2826b7edb5b7dde8e3398299baba05693f37078c3dbef10013c822ffb55ea2d9" exitCode=0
Jul 28 20:10:36.740014 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:36.739618    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-2sjmh" event={"ID":"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c","Type":"ContainerDied","Data":"2826b7edb5b7dde8e3398299baba05693f37078c3dbef10013c822ffb55ea2d9"}
Jul 28 20:10:36.740082 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:36.740041    2561 scope.go:117] "RemoveContainer" containerID="2826b7edb5b7dde8e3398299baba05693f37078c3dbef10013c822ffb55ea2d9"
Jul 28 20:10:37.744705 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:37.744674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-2sjmh" event={"ID":"7e6f21f4-9b6c-4595-bd37-7b4661e09d0c","Type":"ContainerStarted","Data":"994605af3043fb916c24342c4ce931ef0a379fc2907b6621de259fa7b8183951"}
Jul 28 20:10:38.722498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:38.722424    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c8cc87967-sn6j6" podUID="4a28ab16-8d27-4c60-b713-f19952b888b1" containerName="console" containerID="cri-o://000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e" gracePeriod=15
Jul 28 20:10:38.991356 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:38.991306    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:10:39.121678 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.121652    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-serving-cert\") pod \"4a28ab16-8d27-4c60-b713-f19952b888b1\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") "
Jul 28 20:10:39.121803 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.121682    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-oauth-serving-cert\") pod \"4a28ab16-8d27-4c60-b713-f19952b888b1\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") "
Jul 28 20:10:39.121803 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.121717    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-service-ca\") pod \"4a28ab16-8d27-4c60-b713-f19952b888b1\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") "
Jul 28 20:10:39.121803 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.121743    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-console-config\") pod \"4a28ab16-8d27-4c60-b713-f19952b888b1\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") "
Jul 28 20:10:39.121803 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.121774    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzw4m\" (UniqueName: \"kubernetes.io/projected/4a28ab16-8d27-4c60-b713-f19952b888b1-kube-api-access-lzw4m\") pod \"4a28ab16-8d27-4c60-b713-f19952b888b1\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") "
Jul 28 20:10:39.122011 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.121817    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-oauth-config\") pod \"4a28ab16-8d27-4c60-b713-f19952b888b1\" (UID: \"4a28ab16-8d27-4c60-b713-f19952b888b1\") "
Jul 28 20:10:39.122171 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.122131    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4a28ab16-8d27-4c60-b713-f19952b888b1" (UID: "4a28ab16-8d27-4c60-b713-f19952b888b1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:10:39.122269 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.122186    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-service-ca" (OuterVolumeSpecName: "service-ca") pod "4a28ab16-8d27-4c60-b713-f19952b888b1" (UID: "4a28ab16-8d27-4c60-b713-f19952b888b1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:10:39.122269 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.122199    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-console-config" (OuterVolumeSpecName: "console-config") pod "4a28ab16-8d27-4c60-b713-f19952b888b1" (UID: "4a28ab16-8d27-4c60-b713-f19952b888b1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:10:39.124064 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.124029    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4a28ab16-8d27-4c60-b713-f19952b888b1" (UID: "4a28ab16-8d27-4c60-b713-f19952b888b1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:10:39.124167 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.124081    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a28ab16-8d27-4c60-b713-f19952b888b1-kube-api-access-lzw4m" (OuterVolumeSpecName: "kube-api-access-lzw4m") pod "4a28ab16-8d27-4c60-b713-f19952b888b1" (UID: "4a28ab16-8d27-4c60-b713-f19952b888b1"). InnerVolumeSpecName "kube-api-access-lzw4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:10:39.124167 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.124122    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4a28ab16-8d27-4c60-b713-f19952b888b1" (UID: "4a28ab16-8d27-4c60-b713-f19952b888b1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:10:39.222469 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.222444    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-oauth-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:39.222469 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.222467    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a28ab16-8d27-4c60-b713-f19952b888b1-console-serving-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:39.222582 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.222476    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-oauth-serving-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:39.222582 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.222485    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:39.222582 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.222494    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a28ab16-8d27-4c60-b713-f19952b888b1-console-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:39.222582 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.222502    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzw4m\" (UniqueName: \"kubernetes.io/projected/4a28ab16-8d27-4c60-b713-f19952b888b1-kube-api-access-lzw4m\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:10:39.754741 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.754711    2561 generic.go:356] "Generic (PLEG): container finished" podID="4a28ab16-8d27-4c60-b713-f19952b888b1" containerID="000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e" exitCode=0
Jul 28 20:10:39.754886 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.754749    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8cc87967-sn6j6" event={"ID":"4a28ab16-8d27-4c60-b713-f19952b888b1","Type":"ContainerDied","Data":"000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e"}
Jul 28 20:10:39.754886 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.754755    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8cc87967-sn6j6"
Jul 28 20:10:39.754886 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.754789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8cc87967-sn6j6" event={"ID":"4a28ab16-8d27-4c60-b713-f19952b888b1","Type":"ContainerDied","Data":"b095b371c48ddddc97d70c67fd185d0b0be4948b3d72749aab0855fc62323fe5"}
Jul 28 20:10:39.754886 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.754811    2561 scope.go:117] "RemoveContainer" containerID="000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e"
Jul 28 20:10:39.763926 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.763909    2561 scope.go:117] "RemoveContainer" containerID="000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e"
Jul 28 20:10:39.764203 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:10:39.764182    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e\": container with ID starting with 000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e not found: ID does not exist" containerID="000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e"
Jul 28 20:10:39.764306 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.764212    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e"} err="failed to get container status \"000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e\": rpc error: code = NotFound desc = could not find container \"000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e\": container with ID starting with 000b599b92fa97f255cbffc7302a001f9598e4deb56fe466749fb56a2ad7d92e not found: ID does not exist"
Jul 28 20:10:39.777618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.777592    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8cc87967-sn6j6"]
Jul 28 20:10:39.780738 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:39.780719    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c8cc87967-sn6j6"]
Jul 28 20:10:40.075499 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:10:40.075433    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a28ab16-8d27-4c60-b713-f19952b888b1" path="/var/lib/kubelet/pods/4a28ab16-8d27-4c60-b713-f19952b888b1/volumes"
Jul 28 20:11:15.822063 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.821970    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f74489947-552cd"]
Jul 28 20:11:15.822669 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.822404    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7efc8d5-9803-465d-9c87-9e899507bbcf" containerName="registry"
Jul 28 20:11:15.822669 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.822423    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7efc8d5-9803-465d-9c87-9e899507bbcf" containerName="registry"
Jul 28 20:11:15.822669 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.822446    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a28ab16-8d27-4c60-b713-f19952b888b1" containerName="console"
Jul 28 20:11:15.822669 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.822456    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a28ab16-8d27-4c60-b713-f19952b888b1" containerName="console"
Jul 28 20:11:15.822669 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.822528    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7efc8d5-9803-465d-9c87-9e899507bbcf" containerName="registry"
Jul 28 20:11:15.822669 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.822542    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a28ab16-8d27-4c60-b713-f19952b888b1" containerName="console"
Jul 28 20:11:15.824192 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.824167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:15.840909 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.840881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f74489947-552cd"]
Jul 28 20:11:15.985066 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.985035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l92n8\" (UniqueName: \"kubernetes.io/projected/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-kube-api-access-l92n8\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:15.985202 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.985074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-service-ca\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:15.985202 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.985095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-config\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:15.985202 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.985134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-oauth-config\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:15.985202 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.985156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-oauth-serving-cert\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:15.985202 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.985176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-serving-cert\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:15.985382 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:15.985211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-trusted-ca-bundle\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.086179 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.086114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-service-ca\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.086179 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.086148    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-config\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.086179 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.086173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-oauth-config\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.086445 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.086200    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-oauth-serving-cert\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.086445 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.086254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-serving-cert\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.086445 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.086307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-trusted-ca-bundle\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.086445 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.086335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92n8\" (UniqueName: \"kubernetes.io/projected/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-kube-api-access-l92n8\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.087059 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.087008    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-oauth-serving-cert\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.087059 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.087019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-service-ca\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.087059 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.087017    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-config\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.087277 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.087163    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-trusted-ca-bundle\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.088888 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.088860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-oauth-config\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.089061 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.089041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-serving-cert\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.094307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.094288    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l92n8\" (UniqueName: \"kubernetes.io/projected/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-kube-api-access-l92n8\") pod \"console-5f74489947-552cd\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") " pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.138354 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.138331    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:16.264418 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.264388    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f74489947-552cd"]
Jul 28 20:11:16.266690 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:11:16.266653    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581143fd_7d3e_49e0_b0dc_3cdd8ca42c26.slice/crio-72e6a4b9ad35ad1df0cea8f791177e3194105fc0cc383b154fe51afec03161af WatchSource:0}: Error finding container 72e6a4b9ad35ad1df0cea8f791177e3194105fc0cc383b154fe51afec03161af: Status 404 returned error can't find the container with id 72e6a4b9ad35ad1df0cea8f791177e3194105fc0cc383b154fe51afec03161af
Jul 28 20:11:16.907735 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.907698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f74489947-552cd" event={"ID":"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26","Type":"ContainerStarted","Data":"2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472"}
Jul 28 20:11:16.908198 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.907760    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f74489947-552cd" event={"ID":"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26","Type":"ContainerStarted","Data":"72e6a4b9ad35ad1df0cea8f791177e3194105fc0cc383b154fe51afec03161af"}
Jul 28 20:11:16.926925 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:16.926878    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f74489947-552cd" podStartSLOduration=1.9268618549999998 podStartE2EDuration="1.926861855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:11:16.925078571 +0000 UTC m=+179.321781741" watchObservedRunningTime="2026-07-28 20:11:16.926861855 +0000 UTC m=+179.323565010"
Jul 28 20:11:26.138729 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:26.138692    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:26.139213 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:26.138759    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:26.143743 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:26.143714    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:26.950476 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:26.950446    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:11:26.997937 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:26.997904    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cc77c9fd7-tj8dt"]
Jul 28 20:11:52.020721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.020676    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cc77c9fd7-tj8dt" podUID="b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" containerName="console" containerID="cri-o://a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866" gracePeriod=15
Jul 28 20:11:52.256342 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.256311    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:11:52.339351 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339292    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-config\") pod \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") "
Jul 28 20:11:52.339351 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339327    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-oauth-serving-cert\") pod \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") "
Jul 28 20:11:52.339351 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339346    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-service-ca\") pod \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") "
Jul 28 20:11:52.339533 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339383    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-trusted-ca-bundle\") pod \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") "
Jul 28 20:11:52.339533 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339434    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-serving-cert\") pod \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") "
Jul 28 20:11:52.339533 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339488    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26j9g\" (UniqueName: \"kubernetes.io/projected/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-kube-api-access-26j9g\") pod \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") "
Jul 28 20:11:52.339674 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339541    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-oauth-config\") pod \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\" (UID: \"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3\") "
Jul 28 20:11:52.339770 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339746    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-config" (OuterVolumeSpecName: "console-config") pod "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" (UID: "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:11:52.339835 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339760    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" (UID: "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:11:52.339835 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339770    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-service-ca" (OuterVolumeSpecName: "service-ca") pod "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" (UID: "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:11:52.339944 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.339836    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" (UID: "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:11:52.341718 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.341692    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" (UID: "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:11:52.341718 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.341706    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" (UID: "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:11:52.341888 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.341734    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-kube-api-access-26j9g" (OuterVolumeSpecName: "kube-api-access-26j9g") pod "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" (UID: "b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3"). InnerVolumeSpecName "kube-api-access-26j9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:11:52.440381 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.440354    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:11:52.440381 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.440377    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-oauth-serving-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:11:52.440509 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.440387    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:11:52.440509 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.440396    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-trusted-ca-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:11:52.440509 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.440405    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-serving-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:11:52.440509 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.440413    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26j9g\" (UniqueName: \"kubernetes.io/projected/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-kube-api-access-26j9g\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:11:52.440509 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:52.440422    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3-console-oauth-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:11:53.050023 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:53.049980    2561 generic.go:356] "Generic (PLEG): container finished" podID="b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" containerID="a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866" exitCode=0
Jul 28 20:11:53.050418 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:53.050041    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc77c9fd7-tj8dt"
Jul 28 20:11:53.050418 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:53.050073    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc77c9fd7-tj8dt" event={"ID":"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3","Type":"ContainerDied","Data":"a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866"}
Jul 28 20:11:53.050418 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:53.050142    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc77c9fd7-tj8dt" event={"ID":"b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3","Type":"ContainerDied","Data":"f0d1725a3550f79eded3743d5b19fe1947d3a7fc99815464b31d45a4d6f11e09"}
Jul 28 20:11:53.050418 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:53.050168    2561 scope.go:117] "RemoveContainer" containerID="a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866"
Jul 28 20:11:53.060075 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:53.060055    2561 scope.go:117] "RemoveContainer" containerID="a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866"
Jul 28 20:11:53.060444 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:11:53.060402    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866\": container with ID starting with a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866 not found: ID does not exist" containerID="a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866"
Jul 28 20:11:53.060509 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:53.060451    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866"} err="failed to get container status \"a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866\": rpc error: code = NotFound desc = could not find container \"a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866\": container with ID starting with a435433fe4d707a842cb8d0ba2c922abb0e0115eb089cd0d046e25b47edb9866 not found: ID does not exist"
Jul 28 20:11:53.074873 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:53.074847    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cc77c9fd7-tj8dt"]
Jul 28 20:11:53.077704 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:53.077680    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cc77c9fd7-tj8dt"]
Jul 28 20:11:54.078438 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:11:54.076353    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" path="/var/lib/kubelet/pods/b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3/volumes"
Jul 28 20:12:23.156792 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.156746    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"]
Jul 28 20:12:23.158146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.158111    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" containerName="console"
Jul 28 20:12:23.158330 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.158315    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" containerName="console"
Jul 28 20:12:23.158610 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.158595    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7f3e4fc-2c4b-4af1-8ee5-7eebd2fe38f3" containerName="console"
Jul 28 20:12:23.162483 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.162454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.164945 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.164917    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 20:12:23.165071 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.164917    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8x78j\""
Jul 28 20:12:23.165071 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.164972    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 20:12:23.168769 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.168745    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"]
Jul 28 20:12:23.246889 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.246864    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.246985 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.246914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.246985 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.246942    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwxlb\" (UniqueName: \"kubernetes.io/projected/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-kube-api-access-hwxlb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.347541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.347517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.347618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.347548    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwxlb\" (UniqueName: \"kubernetes.io/projected/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-kube-api-access-hwxlb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.347618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.347585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.347848 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.347829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.347886 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.347872    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.356473 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.356449    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwxlb\" (UniqueName: \"kubernetes.io/projected/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-kube-api-access-hwxlb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.473632 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.473584    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:23.605745 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:23.605719    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"]
Jul 28 20:12:23.608106 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:12:23.608069    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f2ef90_dfcf_4771_923b_e0eb2180e6e6.slice/crio-bf7a212fd086da8ddf795b9f90ef0b70e88d305b09ce727a659a158e7ca7acc8 WatchSource:0}: Error finding container bf7a212fd086da8ddf795b9f90ef0b70e88d305b09ce727a659a158e7ca7acc8: Status 404 returned error can't find the container with id bf7a212fd086da8ddf795b9f90ef0b70e88d305b09ce727a659a158e7ca7acc8
Jul 28 20:12:24.171759 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:24.171719    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f" event={"ID":"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6","Type":"ContainerStarted","Data":"bf7a212fd086da8ddf795b9f90ef0b70e88d305b09ce727a659a158e7ca7acc8"}
Jul 28 20:12:31.201459 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:31.201421    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" containerID="03907e6b4b9058fb2703b04cdd8e2219b8187d3e425914ad3c4eb8420b12b751" exitCode=0
Jul 28 20:12:31.201739 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:31.201496    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f" event={"ID":"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6","Type":"ContainerDied","Data":"03907e6b4b9058fb2703b04cdd8e2219b8187d3e425914ad3c4eb8420b12b751"}
Jul 28 20:12:34.216711 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:34.216670    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" containerID="62339279949e97b68e7a53df9fa3ced1471082d7231dc0356c5bd644c70584fe" exitCode=0
Jul 28 20:12:34.217230 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:34.216764    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f" event={"ID":"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6","Type":"ContainerDied","Data":"62339279949e97b68e7a53df9fa3ced1471082d7231dc0356c5bd644c70584fe"}
Jul 28 20:12:41.248099 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:41.248059    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" containerID="c2aeea5a67d2a05b05c820ce88e1dedb828f61c4a8960ee117a506709793f95a" exitCode=0
Jul 28 20:12:41.248539 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:41.248123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f" event={"ID":"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6","Type":"ContainerDied","Data":"c2aeea5a67d2a05b05c820ce88e1dedb828f61c4a8960ee117a506709793f95a"}
Jul 28 20:12:42.378916 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:42.378894    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:42.493331 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:42.493309    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwxlb\" (UniqueName: \"kubernetes.io/projected/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-kube-api-access-hwxlb\") pod \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") "
Jul 28 20:12:42.493469 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:42.493340    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-util\") pod \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") "
Jul 28 20:12:42.493469 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:42.493377    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-bundle\") pod \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\" (UID: \"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6\") "
Jul 28 20:12:42.493990 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:42.493963    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-bundle" (OuterVolumeSpecName: "bundle") pod "e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" (UID: "e6f2ef90-dfcf-4771-923b-e0eb2180e6e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:12:42.495426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:42.495400    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-kube-api-access-hwxlb" (OuterVolumeSpecName: "kube-api-access-hwxlb") pod "e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" (UID: "e6f2ef90-dfcf-4771-923b-e0eb2180e6e6"). InnerVolumeSpecName "kube-api-access-hwxlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:12:42.498894 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:42.498863    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-util" (OuterVolumeSpecName: "util") pod "e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" (UID: "e6f2ef90-dfcf-4771-923b-e0eb2180e6e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:12:42.594462 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:42.594412    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwxlb\" (UniqueName: \"kubernetes.io/projected/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-kube-api-access-hwxlb\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:12:42.594462 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:42.594435    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-util\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:12:42.594462 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:42.594446    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6f2ef90-dfcf-4771-923b-e0eb2180e6e6-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:12:43.258556 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:43.258531    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f"
Jul 28 20:12:43.258556 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:43.258538    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l827f" event={"ID":"e6f2ef90-dfcf-4771-923b-e0eb2180e6e6","Type":"ContainerDied","Data":"bf7a212fd086da8ddf795b9f90ef0b70e88d305b09ce727a659a158e7ca7acc8"}
Jul 28 20:12:43.258719 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:43.258581    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf7a212fd086da8ddf795b9f90ef0b70e88d305b09ce727a659a158e7ca7acc8"
Jul 28 20:12:51.510781 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.510744    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"]
Jul 28 20:12:51.511307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.511028    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" containerName="extract"
Jul 28 20:12:51.511307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.511039    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" containerName="extract"
Jul 28 20:12:51.511307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.511062    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" containerName="util"
Jul 28 20:12:51.511307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.511068    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" containerName="util"
Jul 28 20:12:51.511307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.511076    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" containerName="pull"
Jul 28 20:12:51.511307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.511081    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" containerName="pull"
Jul 28 20:12:51.511307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.511132    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f2ef90-dfcf-4771-923b-e0eb2180e6e6" containerName="extract"
Jul 28 20:12:51.514340 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.514318    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"
Jul 28 20:12:51.516645 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.516621    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 28 20:12:51.516645 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.516635    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jc4qb\""
Jul 28 20:12:51.517000 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.516982    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:12:51.526205 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.526180    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"]
Jul 28 20:12:51.662534 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.662507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65a30bb5-3da3-481c-a2da-e4c4ad3503b8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv5p6\" (UID: \"65a30bb5-3da3-481c-a2da-e4c4ad3503b8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"
Jul 28 20:12:51.662644 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.662563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8vf4\" (UniqueName: \"kubernetes.io/projected/65a30bb5-3da3-481c-a2da-e4c4ad3503b8-kube-api-access-j8vf4\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv5p6\" (UID: \"65a30bb5-3da3-481c-a2da-e4c4ad3503b8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"
Jul 28 20:12:51.763740 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.763684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8vf4\" (UniqueName: \"kubernetes.io/projected/65a30bb5-3da3-481c-a2da-e4c4ad3503b8-kube-api-access-j8vf4\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv5p6\" (UID: \"65a30bb5-3da3-481c-a2da-e4c4ad3503b8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"
Jul 28 20:12:51.763740 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.763736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65a30bb5-3da3-481c-a2da-e4c4ad3503b8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv5p6\" (UID: \"65a30bb5-3da3-481c-a2da-e4c4ad3503b8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"
Jul 28 20:12:51.764040 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.764023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65a30bb5-3da3-481c-a2da-e4c4ad3503b8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv5p6\" (UID: \"65a30bb5-3da3-481c-a2da-e4c4ad3503b8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"
Jul 28 20:12:51.774488 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.774463    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8vf4\" (UniqueName: \"kubernetes.io/projected/65a30bb5-3da3-481c-a2da-e4c4ad3503b8-kube-api-access-j8vf4\") pod \"cert-manager-operator-controller-manager-55c444bf86-tv5p6\" (UID: \"65a30bb5-3da3-481c-a2da-e4c4ad3503b8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"
Jul 28 20:12:51.824218 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.824195    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"
Jul 28 20:12:51.970031 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:51.970006    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6"]
Jul 28 20:12:51.971796 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:12:51.971770    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a30bb5_3da3_481c_a2da_e4c4ad3503b8.slice/crio-e0094b8a49d245146c38f869c860d56449b82486a4f4c2dbe0c47e91b85c5a1f WatchSource:0}: Error finding container e0094b8a49d245146c38f869c860d56449b82486a4f4c2dbe0c47e91b85c5a1f: Status 404 returned error can't find the container with id e0094b8a49d245146c38f869c860d56449b82486a4f4c2dbe0c47e91b85c5a1f
Jul 28 20:12:52.293262 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:52.293175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6" event={"ID":"65a30bb5-3da3-481c-a2da-e4c4ad3503b8","Type":"ContainerStarted","Data":"e0094b8a49d245146c38f869c860d56449b82486a4f4c2dbe0c47e91b85c5a1f"}
Jul 28 20:12:55.308694 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:55.308664    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6" event={"ID":"65a30bb5-3da3-481c-a2da-e4c4ad3503b8","Type":"ContainerStarted","Data":"83740ecd26e8e47a88136398918263656fe681f25e33f80452e39daf524caaa3"}
Jul 28 20:12:55.331887 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:55.331830    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tv5p6" podStartSLOduration=2.042940768 podStartE2EDuration="4.331815829s" totalImagesPullingTime="2.288875061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:12:55.330765748 +0000 UTC m=+277.727468903" watchObservedRunningTime="2026-07-28 20:12:55.331815829 +0000 UTC m=+277.728518984"
Jul 28 20:12:56.294742 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.294713    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"]
Jul 28 20:12:56.296825 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.296810    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.301178 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.301149    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 20:12:56.301178 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.301167    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 20:12:56.302021 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.302000    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8x78j\""
Jul 28 20:12:56.308482 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.308462    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"]
Jul 28 20:12:56.399354 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.399333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.399678 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.399386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.399678 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.399451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnb2m\" (UniqueName: \"kubernetes.io/projected/d1794e6b-6a36-43c0-b918-fc6d7425faa8-kube-api-access-rnb2m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.499920 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.499901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.500024 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.499939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.500024 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.499964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnb2m\" (UniqueName: \"kubernetes.io/projected/d1794e6b-6a36-43c0-b918-fc6d7425faa8-kube-api-access-rnb2m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.500276 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.500230    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.500339 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.500322    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.510996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.510969    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnb2m\" (UniqueName: \"kubernetes.io/projected/d1794e6b-6a36-43c0-b918-fc6d7425faa8-kube-api-access-rnb2m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.605282 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.605204    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:12:56.734729 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:56.734702    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"]
Jul 28 20:12:56.737430 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:12:56.737397    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1794e6b_6a36_43c0_b918_fc6d7425faa8.slice/crio-ebb88c478916349c89d03ea9a98091686d2e634fbd2f3eb78236f56449a218b1 WatchSource:0}: Error finding container ebb88c478916349c89d03ea9a98091686d2e634fbd2f3eb78236f56449a218b1: Status 404 returned error can't find the container with id ebb88c478916349c89d03ea9a98091686d2e634fbd2f3eb78236f56449a218b1
Jul 28 20:12:57.319395 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.319361    2561 generic.go:356] "Generic (PLEG): container finished" podID="d1794e6b-6a36-43c0-b918-fc6d7425faa8" containerID="5727dd698fda812f7154d8a8532868d5432fd2523103c87dce85671b2483f387" exitCode=0
Jul 28 20:12:57.319395 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.319399    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5" event={"ID":"d1794e6b-6a36-43c0-b918-fc6d7425faa8","Type":"ContainerDied","Data":"5727dd698fda812f7154d8a8532868d5432fd2523103c87dce85671b2483f387"}
Jul 28 20:12:57.319593 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.319436    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5" event={"ID":"d1794e6b-6a36-43c0-b918-fc6d7425faa8","Type":"ContainerStarted","Data":"ebb88c478916349c89d03ea9a98091686d2e634fbd2f3eb78236f56449a218b1"}
Jul 28 20:12:57.334941 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.334918    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"]
Jul 28 20:12:57.336746 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.336731    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"
Jul 28 20:12:57.339247 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.339218    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8z5lb\""
Jul 28 20:12:57.339247 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.339230    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 20:12:57.339407 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.339249    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 20:12:57.349300 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.349281    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"]
Jul 28 20:12:57.507444 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.507422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4a7547e-d935-4b05-a8cb-30cab07db3ef-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s98w5\" (UID: \"d4a7547e-d935-4b05-a8cb-30cab07db3ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"
Jul 28 20:12:57.507754 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.507455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v8dq\" (UniqueName: \"kubernetes.io/projected/d4a7547e-d935-4b05-a8cb-30cab07db3ef-kube-api-access-4v8dq\") pod \"cert-manager-cainjector-559cdd8c87-s98w5\" (UID: \"d4a7547e-d935-4b05-a8cb-30cab07db3ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"
Jul 28 20:12:57.608353 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.608286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4a7547e-d935-4b05-a8cb-30cab07db3ef-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s98w5\" (UID: \"d4a7547e-d935-4b05-a8cb-30cab07db3ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"
Jul 28 20:12:57.608353 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.608330    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v8dq\" (UniqueName: \"kubernetes.io/projected/d4a7547e-d935-4b05-a8cb-30cab07db3ef-kube-api-access-4v8dq\") pod \"cert-manager-cainjector-559cdd8c87-s98w5\" (UID: \"d4a7547e-d935-4b05-a8cb-30cab07db3ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"
Jul 28 20:12:57.621404 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.621370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4a7547e-d935-4b05-a8cb-30cab07db3ef-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s98w5\" (UID: \"d4a7547e-d935-4b05-a8cb-30cab07db3ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"
Jul 28 20:12:57.623485 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.623465    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v8dq\" (UniqueName: \"kubernetes.io/projected/d4a7547e-d935-4b05-a8cb-30cab07db3ef-kube-api-access-4v8dq\") pod \"cert-manager-cainjector-559cdd8c87-s98w5\" (UID: \"d4a7547e-d935-4b05-a8cb-30cab07db3ef\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"
Jul 28 20:12:57.661434 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.661416    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"
Jul 28 20:12:57.810694 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:57.810670    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s98w5"]
Jul 28 20:12:57.812943 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:12:57.812913    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4a7547e_d935_4b05_a8cb_30cab07db3ef.slice/crio-9133273fd9f757e3b5b747c02fa2559ef0d6feb9f1e9aa21e9be281a9efe8a5b WatchSource:0}: Error finding container 9133273fd9f757e3b5b747c02fa2559ef0d6feb9f1e9aa21e9be281a9efe8a5b: Status 404 returned error can't find the container with id 9133273fd9f757e3b5b747c02fa2559ef0d6feb9f1e9aa21e9be281a9efe8a5b
Jul 28 20:12:58.325228 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:12:58.325197    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5" event={"ID":"d4a7547e-d935-4b05-a8cb-30cab07db3ef","Type":"ContainerStarted","Data":"9133273fd9f757e3b5b747c02fa2559ef0d6feb9f1e9aa21e9be281a9efe8a5b"}
Jul 28 20:13:00.337607 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:00.337570    2561 generic.go:356] "Generic (PLEG): container finished" podID="d1794e6b-6a36-43c0-b918-fc6d7425faa8" containerID="916362156deb7993d8250aa59075a69ff1d34fb3b19bcbab3051c4bf8c5f6596" exitCode=0
Jul 28 20:13:00.337988 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:00.337652    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5" event={"ID":"d1794e6b-6a36-43c0-b918-fc6d7425faa8","Type":"ContainerDied","Data":"916362156deb7993d8250aa59075a69ff1d34fb3b19bcbab3051c4bf8c5f6596"}
Jul 28 20:13:01.345073 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:01.345031    2561 generic.go:356] "Generic (PLEG): container finished" podID="d1794e6b-6a36-43c0-b918-fc6d7425faa8" containerID="bce59575cbd06a5e40f10294c5d4b71e17f03804a5056a3cc52de490d89993b9" exitCode=0
Jul 28 20:13:01.345507 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:01.345084    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5" event={"ID":"d1794e6b-6a36-43c0-b918-fc6d7425faa8","Type":"ContainerDied","Data":"bce59575cbd06a5e40f10294c5d4b71e17f03804a5056a3cc52de490d89993b9"}
Jul 28 20:13:02.351388 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.351350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5" event={"ID":"d4a7547e-d935-4b05-a8cb-30cab07db3ef","Type":"ContainerStarted","Data":"a74d314849ff2aed130059f2dcf65a8fda03805083f17d79cd368b51ebd0f4f6"}
Jul 28 20:13:02.368273 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.368206    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s98w5" podStartSLOduration=1.296411758 podStartE2EDuration="5.368188786s" totalImagesPullingTime="4.071777028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:13:02.367586413 +0000 UTC m=+284.764289572" watchObservedRunningTime="2026-07-28 20:13:02.368188786 +0000 UTC m=+284.764891942"
Jul 28 20:13:02.490683 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.490660    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:13:02.548515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.548490    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-bundle\") pod \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") "
Jul 28 20:13:02.548649 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.548561    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-util\") pod \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") "
Jul 28 20:13:02.548649 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.548625    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnb2m\" (UniqueName: \"kubernetes.io/projected/d1794e6b-6a36-43c0-b918-fc6d7425faa8-kube-api-access-rnb2m\") pod \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\" (UID: \"d1794e6b-6a36-43c0-b918-fc6d7425faa8\") "
Jul 28 20:13:02.548897 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.548872    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-bundle" (OuterVolumeSpecName: "bundle") pod "d1794e6b-6a36-43c0-b918-fc6d7425faa8" (UID: "d1794e6b-6a36-43c0-b918-fc6d7425faa8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:13:02.550566 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.550538    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1794e6b-6a36-43c0-b918-fc6d7425faa8-kube-api-access-rnb2m" (OuterVolumeSpecName: "kube-api-access-rnb2m") pod "d1794e6b-6a36-43c0-b918-fc6d7425faa8" (UID: "d1794e6b-6a36-43c0-b918-fc6d7425faa8"). InnerVolumeSpecName "kube-api-access-rnb2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:13:02.553175 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.553151    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-util" (OuterVolumeSpecName: "util") pod "d1794e6b-6a36-43c0-b918-fc6d7425faa8" (UID: "d1794e6b-6a36-43c0-b918-fc6d7425faa8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:13:02.649183 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.649133    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-util\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:13:02.649183 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.649154    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnb2m\" (UniqueName: \"kubernetes.io/projected/d1794e6b-6a36-43c0-b918-fc6d7425faa8-kube-api-access-rnb2m\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:13:02.649183 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:02.649165    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1794e6b-6a36-43c0-b918-fc6d7425faa8-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:13:03.358433 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:03.358402    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5"
Jul 28 20:13:03.358433 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:03.358426    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9p5" event={"ID":"d1794e6b-6a36-43c0-b918-fc6d7425faa8","Type":"ContainerDied","Data":"ebb88c478916349c89d03ea9a98091686d2e634fbd2f3eb78236f56449a218b1"}
Jul 28 20:13:03.358910 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:03.358478    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebb88c478916349c89d03ea9a98091686d2e634fbd2f3eb78236f56449a218b1"
Jul 28 20:13:16.144203 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.144162    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"]
Jul 28 20:13:16.144634 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.144514    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1794e6b-6a36-43c0-b918-fc6d7425faa8" containerName="util"
Jul 28 20:13:16.144634 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.144528    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1794e6b-6a36-43c0-b918-fc6d7425faa8" containerName="util"
Jul 28 20:13:16.144634 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.144546    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1794e6b-6a36-43c0-b918-fc6d7425faa8" containerName="pull"
Jul 28 20:13:16.144634 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.144552    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1794e6b-6a36-43c0-b918-fc6d7425faa8" containerName="pull"
Jul 28 20:13:16.144634 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.144559    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1794e6b-6a36-43c0-b918-fc6d7425faa8" containerName="extract"
Jul 28 20:13:16.144634 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.144565    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1794e6b-6a36-43c0-b918-fc6d7425faa8" containerName="extract"
Jul 28 20:13:16.144634 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.144618    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1794e6b-6a36-43c0-b918-fc6d7425faa8" containerName="extract"
Jul 28 20:13:16.146577 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.146556    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.148959 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.148917    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 20:13:16.149207 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.149189    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8x78j\""
Jul 28 20:13:16.149945 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.149920    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 20:13:16.156344 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.156316    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"]
Jul 28 20:13:16.243511 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.243478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8g9v\" (UniqueName: \"kubernetes.io/projected/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-kube-api-access-p8g9v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.243651 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.243518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.243729 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.243661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.344496 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.344464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.344621 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.344502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8g9v\" (UniqueName: \"kubernetes.io/projected/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-kube-api-access-p8g9v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.344621 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.344524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.344863 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.344841    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.344941 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.344913    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.355045 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.355024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8g9v\" (UniqueName: \"kubernetes.io/projected/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-kube-api-access-p8g9v\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.456592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.456543    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:16.584174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:16.584142    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"]
Jul 28 20:13:16.586516 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:13:16.586492    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2b12074_fe11_43e8_b62d_c2a8ab8bdc29.slice/crio-ee89a1b0763bd0039045f9c082885965e4938400aab4a3d1bd5af3e62cb38f48 WatchSource:0}: Error finding container ee89a1b0763bd0039045f9c082885965e4938400aab4a3d1bd5af3e62cb38f48: Status 404 returned error can't find the container with id ee89a1b0763bd0039045f9c082885965e4938400aab4a3d1bd5af3e62cb38f48
Jul 28 20:13:17.420623 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:17.420592    2561 generic.go:356] "Generic (PLEG): container finished" podID="a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" containerID="091fd948b5bdcf2172bf4262b125a8887c79938f2914ae58613a9ae9013e53bf" exitCode=0
Jul 28 20:13:17.420964 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:17.420638    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5" event={"ID":"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29","Type":"ContainerDied","Data":"091fd948b5bdcf2172bf4262b125a8887c79938f2914ae58613a9ae9013e53bf"}
Jul 28 20:13:17.420964 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:17.420671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5" event={"ID":"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29","Type":"ContainerStarted","Data":"ee89a1b0763bd0039045f9c082885965e4938400aab4a3d1bd5af3e62cb38f48"}
Jul 28 20:13:18.024279 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:18.024253    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:13:18.024427 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:18.024340    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:13:18.033730 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:18.033712    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 20:13:18.427031 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:18.426959    2561 generic.go:356] "Generic (PLEG): container finished" podID="a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" containerID="64899de237ad4a42c17ff88f9a7aac57695a9ca8838d3ff807c1fde0d28097b2" exitCode=0
Jul 28 20:13:18.427031 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:18.427014    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5" event={"ID":"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29","Type":"ContainerDied","Data":"64899de237ad4a42c17ff88f9a7aac57695a9ca8838d3ff807c1fde0d28097b2"}
Jul 28 20:13:19.435360 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:19.435321    2561 generic.go:356] "Generic (PLEG): container finished" podID="a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" containerID="40a9f9f021abd775990389321720c2fecea9d2a65f7dcda7fbc51d4a746a8551" exitCode=0
Jul 28 20:13:19.435741 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:19.435381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5" event={"ID":"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29","Type":"ContainerDied","Data":"40a9f9f021abd775990389321720c2fecea9d2a65f7dcda7fbc51d4a746a8551"}
Jul 28 20:13:20.574311 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:20.574289    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:20.674729 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:20.674703    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-bundle\") pod \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") "
Jul 28 20:13:20.674852 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:20.674734    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8g9v\" (UniqueName: \"kubernetes.io/projected/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-kube-api-access-p8g9v\") pod \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") "
Jul 28 20:13:20.674852 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:20.674767    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-util\") pod \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\" (UID: \"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29\") "
Jul 28 20:13:20.675583 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:20.675551    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-bundle" (OuterVolumeSpecName: "bundle") pod "a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" (UID: "a2b12074-fe11-43e8-b62d-c2a8ab8bdc29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:13:20.676736 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:20.676709    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-kube-api-access-p8g9v" (OuterVolumeSpecName: "kube-api-access-p8g9v") pod "a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" (UID: "a2b12074-fe11-43e8-b62d-c2a8ab8bdc29"). InnerVolumeSpecName "kube-api-access-p8g9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:13:20.680627 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:20.680605    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-util" (OuterVolumeSpecName: "util") pod "a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" (UID: "a2b12074-fe11-43e8-b62d-c2a8ab8bdc29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:13:20.776060 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:20.776037    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:13:20.776060 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:20.776059    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8g9v\" (UniqueName: \"kubernetes.io/projected/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-kube-api-access-p8g9v\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:13:20.776190 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:20.776069    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2b12074-fe11-43e8-b62d-c2a8ab8bdc29-util\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:13:21.446943 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:21.446908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5" event={"ID":"a2b12074-fe11-43e8-b62d-c2a8ab8bdc29","Type":"ContainerDied","Data":"ee89a1b0763bd0039045f9c082885965e4938400aab4a3d1bd5af3e62cb38f48"}
Jul 28 20:13:21.447094 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:21.446951    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afbglv5"
Jul 28 20:13:21.447094 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:21.446956    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee89a1b0763bd0039045f9c082885965e4938400aab4a3d1bd5af3e62cb38f48"
Jul 28 20:13:22.596215 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.596174    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"]
Jul 28 20:13:22.596772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.596679    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" containerName="extract"
Jul 28 20:13:22.596772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.596701    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" containerName="extract"
Jul 28 20:13:22.596772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.596722    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" containerName="pull"
Jul 28 20:13:22.596772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.596730    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" containerName="pull"
Jul 28 20:13:22.596772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.596742    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" containerName="util"
Jul 28 20:13:22.596772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.596751    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" containerName="util"
Jul 28 20:13:22.597114 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.596829    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2b12074-fe11-43e8-b62d-c2a8ab8bdc29" containerName="extract"
Jul 28 20:13:22.600034 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.600011    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.603159 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.603137    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 20:13:22.603419 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.603402    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 20:13:22.603502 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.603487    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:13:22.603569 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.603501    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 20:13:22.603569 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.603503    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 20:13:22.603828 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.603812    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5thc9\""
Jul 28 20:13:22.613450 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.613428    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"]
Jul 28 20:13:22.690901 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.690874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16c567eb-ed41-419e-a76b-000d67995c0a-manager-config\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.690991 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.690921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16c567eb-ed41-419e-a76b-000d67995c0a-cert\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.690991 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.690956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16c567eb-ed41-419e-a76b-000d67995c0a-metrics-cert\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.691061 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.690996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcnw2\" (UniqueName: \"kubernetes.io/projected/16c567eb-ed41-419e-a76b-000d67995c0a-kube-api-access-kcnw2\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.791870 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.791846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16c567eb-ed41-419e-a76b-000d67995c0a-manager-config\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.791978 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.791886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16c567eb-ed41-419e-a76b-000d67995c0a-cert\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.791978 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.791902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16c567eb-ed41-419e-a76b-000d67995c0a-metrics-cert\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.791978 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.791961    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcnw2\" (UniqueName: \"kubernetes.io/projected/16c567eb-ed41-419e-a76b-000d67995c0a-kube-api-access-kcnw2\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.792610 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.792590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16c567eb-ed41-419e-a76b-000d67995c0a-manager-config\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.794487 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.794465    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16c567eb-ed41-419e-a76b-000d67995c0a-metrics-cert\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.794576 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.794510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16c567eb-ed41-419e-a76b-000d67995c0a-cert\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.802229 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.802208    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcnw2\" (UniqueName: \"kubernetes.io/projected/16c567eb-ed41-419e-a76b-000d67995c0a-kube-api-access-kcnw2\") pod \"lws-controller-manager-6f8978bd54-g4pzf\" (UID: \"16c567eb-ed41-419e-a76b-000d67995c0a\") " pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:22.909671 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:22.909623    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:23.059062 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:23.059017    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"]
Jul 28 20:13:23.061492 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:13:23.061467    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c567eb_ed41_419e_a76b_000d67995c0a.slice/crio-1f8cf78bc4e8f67e0c54a6932440bcadf721468ba88e5637b16990f212b10f6b WatchSource:0}: Error finding container 1f8cf78bc4e8f67e0c54a6932440bcadf721468ba88e5637b16990f212b10f6b: Status 404 returned error can't find the container with id 1f8cf78bc4e8f67e0c54a6932440bcadf721468ba88e5637b16990f212b10f6b
Jul 28 20:13:23.063516 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:23.063502    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:13:23.457725 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:23.457694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf" event={"ID":"16c567eb-ed41-419e-a76b-000d67995c0a","Type":"ContainerStarted","Data":"1f8cf78bc4e8f67e0c54a6932440bcadf721468ba88e5637b16990f212b10f6b"}
Jul 28 20:13:25.468922 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:25.468881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf" event={"ID":"16c567eb-ed41-419e-a76b-000d67995c0a","Type":"ContainerStarted","Data":"4d35abf30b0df6f3d70c55e1f6de314734f307691432d04594a158b978e23bd9"}
Jul 28 20:13:25.469350 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:25.469022    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:25.486670 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:25.486620    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf" podStartSLOduration=2.020569047 podStartE2EDuration="3.486605607s" totalImagesPullingTime="1.46603656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:13:25.485686065 +0000 UTC m=+307.882389275" watchObservedRunningTime="2026-07-28 20:13:25.486605607 +0000 UTC m=+307.883308763"
Jul 28 20:13:29.298290 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.298254    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"]
Jul 28 20:13:29.302602 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.302584    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.305311 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.305283    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 20:13:29.305445 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.305309    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h57cb\""
Jul 28 20:13:29.305445 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.305283    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 20:13:29.305445 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.305365    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 20:13:29.306608 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.306592    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 20:13:29.324047 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.324021    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"]
Jul 28 20:13:29.339097 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.339069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.339207 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.339101    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-tmp\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.339207 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.339118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.339338 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.339213    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fk5z\" (UniqueName: \"kubernetes.io/projected/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-kube-api-access-7fk5z\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.339338 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.339298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-manifests\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.439736 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.439711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.439839 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.439743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-tmp\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.439839 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.439761    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.439839 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.439789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fk5z\" (UniqueName: \"kubernetes.io/projected/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-kube-api-access-7fk5z\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.439839 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.439809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-manifests\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.440176 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.440158    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-manifests\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.441963 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.441934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-tmp\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.442214 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.442194    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.442306 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.442222    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.447733 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.447714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fk5z\" (UniqueName: \"kubernetes.io/projected/ffd31c06-4f2e-4d98-900c-5e85caf6c35b-kube-api-access-7fk5z\") pod \"opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v\" (UID: \"ffd31c06-4f2e-4d98-900c-5e85caf6c35b\") " pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.613168 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.613118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:29.748527 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:29.748503    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"]
Jul 28 20:13:29.751159 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:13:29.751130    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd31c06_4f2e_4d98_900c_5e85caf6c35b.slice/crio-735b4f81c010cb91b5fbb94d3479512a1e7d636226706bb2589d38c553f6d9f6 WatchSource:0}: Error finding container 735b4f81c010cb91b5fbb94d3479512a1e7d636226706bb2589d38c553f6d9f6: Status 404 returned error can't find the container with id 735b4f81c010cb91b5fbb94d3479512a1e7d636226706bb2589d38c553f6d9f6
Jul 28 20:13:30.494790 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:30.494747    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v" event={"ID":"ffd31c06-4f2e-4d98-900c-5e85caf6c35b","Type":"ContainerStarted","Data":"735b4f81c010cb91b5fbb94d3479512a1e7d636226706bb2589d38c553f6d9f6"}
Jul 28 20:13:33.510804 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:33.510772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v" event={"ID":"ffd31c06-4f2e-4d98-900c-5e85caf6c35b","Type":"ContainerStarted","Data":"c4bc5c2b05d41608a7eb5cdcb62b7bd97479202d4478b3ea3cc6f311afd89bb2"}
Jul 28 20:13:34.517285 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:34.517224    2561 generic.go:356] "Generic (PLEG): container finished" podID="ffd31c06-4f2e-4d98-900c-5e85caf6c35b" containerID="c4bc5c2b05d41608a7eb5cdcb62b7bd97479202d4478b3ea3cc6f311afd89bb2" exitCode=0
Jul 28 20:13:34.517285 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:34.517275    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v" event={"ID":"ffd31c06-4f2e-4d98-900c-5e85caf6c35b","Type":"ContainerDied","Data":"c4bc5c2b05d41608a7eb5cdcb62b7bd97479202d4478b3ea3cc6f311afd89bb2"}
Jul 28 20:13:35.525151 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:35.525109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v" event={"ID":"ffd31c06-4f2e-4d98-900c-5e85caf6c35b","Type":"ContainerStarted","Data":"5debb7de91b30247db843ad0fd763b26c87ed16c182a79f0a197f1f2e8ee883e"}
Jul 28 20:13:35.525544 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:35.525252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:35.548794 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:35.548745    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v" podStartSLOduration=1.958665142 podStartE2EDuration="6.548727784s" totalImagesPullingTime="3.50793723s" totalInitContainerRuntime="1.082125412s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:13:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:13:35.546907371 +0000 UTC m=+317.943610528" watchObservedRunningTime="2026-07-28 20:13:35.548727784 +0000 UTC m=+317.945430939"
Jul 28 20:13:36.475946 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:36.475909    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f8978bd54-g4pzf"
Jul 28 20:13:46.532570 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:46.532533    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v"
Jul 28 20:13:57.605532 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.605496    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"]
Jul 28 20:13:57.611900 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.611879    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.614346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.614227    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 20:13:57.614346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.614340    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hd7tm\""
Jul 28 20:13:57.622456 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.622428    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"]
Jul 28 20:13:57.673919 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.673892    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d5f4f51-8d8e-4220-96ed-204d6256298f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.674071 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.673928    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.674071 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.673971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.674071 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.674049    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.674205 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.674083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.674205 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.674100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.674205 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.674151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.674205 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.674168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf89m\" (UniqueName: \"kubernetes.io/projected/7d5f4f51-8d8e-4220-96ed-204d6256298f-kube-api-access-mf89m\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.674205 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.674198    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.774816 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.774787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.774961 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.774851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.774961 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.774882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.774961 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.774914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.774961 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.774938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.775169 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.774972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.775169 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.775001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf89m\" (UniqueName: \"kubernetes.io/projected/7d5f4f51-8d8e-4220-96ed-204d6256298f-kube-api-access-mf89m\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.775169 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.775038    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.775169 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.775090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d5f4f51-8d8e-4220-96ed-204d6256298f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.775397 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.775318    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.775397 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.775364    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.775505 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.775455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.775505 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.775468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.775767 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.775740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d5f4f51-8d8e-4220-96ed-204d6256298f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.777286 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.777268    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.777361 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.777292    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.788170 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.788143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d5f4f51-8d8e-4220-96ed-204d6256298f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.788446 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.788427    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf89m\" (UniqueName: \"kubernetes.io/projected/7d5f4f51-8d8e-4220-96ed-204d6256298f-kube-api-access-mf89m\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cgz86h\" (UID: \"7d5f4f51-8d8e-4220-96ed-204d6256298f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:57.922491 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:57.922431    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:13:58.061875 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.061850    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"]
Jul 28 20:13:58.063976 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:13:58.063950    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5f4f51_8d8e_4220_96ed_204d6256298f.slice/crio-adbe36fafd6ab40b1d8da2b4349995e18d13d39ecca471d0c7872fd63021156a WatchSource:0}: Error finding container adbe36fafd6ab40b1d8da2b4349995e18d13d39ecca471d0c7872fd63021156a: Status 404 returned error can't find the container with id adbe36fafd6ab40b1d8da2b4349995e18d13d39ecca471d0c7872fd63021156a
Jul 28 20:13:58.120867 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.120845    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"]
Jul 28 20:13:58.126934 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.126913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.130716 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.130688    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 20:13:58.130838 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.130733    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 20:13:58.130838 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.130758    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8nbz4\""
Jul 28 20:13:58.131019 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.131002    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 20:13:58.141657 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.141635    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"]
Jul 28 20:13:58.180318 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.180263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.180403 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.180385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.180450 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.180429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.180527 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.180506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6pjv\" (UniqueName: \"kubernetes.io/projected/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-kube-api-access-m6pjv\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.180581 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.180568    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.180637 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.180611    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.180727 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.180708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.281809 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.281785    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.281904 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.281835    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.281904 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.281860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.282006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.281898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.282006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.281939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6pjv\" (UniqueName: \"kubernetes.io/projected/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-kube-api-access-m6pjv\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.282006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.281966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.282154 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.282016    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.282571 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.282551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.284287 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.284270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.284444 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.284414    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.284649 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.284633    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.284707 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.284680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.292122 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.292099    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.292360 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.292343    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6pjv\" (UniqueName: \"kubernetes.io/projected/6899ec63-0fe1-4f1c-9a36-00f10837ed8d-kube-api-access-m6pjv\") pod \"istiod-openshift-gateway-5677ccb49b-5t5fv\" (UID: \"6899ec63-0fe1-4f1c-9a36-00f10837ed8d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.438254 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.438178    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:13:58.597192 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.597167    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"]
Jul 28 20:13:58.600123 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:13:58.600099    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6899ec63_0fe1_4f1c_9a36_00f10837ed8d.slice/crio-ea01ad15a8e9121ec0130166afc6b251477e2ed9910ee62afcc88557dd18fb75 WatchSource:0}: Error finding container ea01ad15a8e9121ec0130166afc6b251477e2ed9910ee62afcc88557dd18fb75: Status 404 returned error can't find the container with id ea01ad15a8e9121ec0130166afc6b251477e2ed9910ee62afcc88557dd18fb75
Jul 28 20:13:58.632456 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.632425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv" event={"ID":"6899ec63-0fe1-4f1c-9a36-00f10837ed8d","Type":"ContainerStarted","Data":"ea01ad15a8e9121ec0130166afc6b251477e2ed9910ee62afcc88557dd18fb75"}
Jul 28 20:13:58.633562 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:13:58.633536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h" event={"ID":"7d5f4f51-8d8e-4220-96ed-204d6256298f","Type":"ContainerStarted","Data":"adbe36fafd6ab40b1d8da2b4349995e18d13d39ecca471d0c7872fd63021156a"}
Jul 28 20:14:00.858270 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:00.858199    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:14:00.858561 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:00.858306    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:14:00.858561 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:00.858334    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:14:01.652909 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:01.652863    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h" event={"ID":"7d5f4f51-8d8e-4220-96ed-204d6256298f","Type":"ContainerStarted","Data":"1b9a630b1f828f1f3b73c69fe528e09af863c3b8fb33f0a3f9adad423186e81e"}
Jul 28 20:14:01.683567 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:01.683508    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h" podStartSLOduration=1.891462067 podStartE2EDuration="4.683486645s" totalImagesPullingTime="2.792024578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:01.681618906 +0000 UTC m=+344.078322069" watchObservedRunningTime="2026-07-28 20:14:01.683486645 +0000 UTC m=+344.080189818"
Jul 28 20:14:01.922874 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:01.922801    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:14:01.927829 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:01.927807    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:14:02.003692 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:02.003658    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:14:02.003783 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:02.003730    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:14:02.659567 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:02.659529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv" event={"ID":"6899ec63-0fe1-4f1c-9a36-00f10837ed8d","Type":"ContainerStarted","Data":"e7fc4c6c6e378f760b2911189e594c9b938e0fa052a251d321b06400d97287a2"}
Jul 28 20:14:02.659770 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:02.659733    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:14:02.659873 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:02.659777    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:14:02.660755 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:02.660736    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cgz86h"
Jul 28 20:14:02.703031 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:02.702985    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv" podStartSLOduration=1.301934934 podStartE2EDuration="4.702967399s" totalImagesPullingTime="3.401032465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:02.700361457 +0000 UTC m=+345.097064664" watchObservedRunningTime="2026-07-28 20:14:02.702967399 +0000 UTC m=+345.099670555"
Jul 28 20:14:03.666415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:14:03.666378    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-5t5fv"
Jul 28 20:15:09.175578 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.175541    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"]
Jul 28 20:15:09.179030 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.179012    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.181410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.181389    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 20:15:09.181525 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.181421    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 20:15:09.182191 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.182172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t9j99\""
Jul 28 20:15:09.186703 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.186678    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"]
Jul 28 20:15:09.266459 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.266416    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.266667 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.266500    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.266667 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.266554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzkgm\" (UniqueName: \"kubernetes.io/projected/cfb654b8-9dce-4f2d-a558-a061e087f4a7-kube-api-access-xzkgm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.290275 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.290224    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"]
Jul 28 20:15:09.293700 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.293677    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.302594 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.302569    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"]
Jul 28 20:15:09.367930 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.367892    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzgcm\" (UniqueName: \"kubernetes.io/projected/12fd732d-1ce0-4d79-93e4-d98ef509caac-kube-api-access-qzgcm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.368104 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.367940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.368104 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.367976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.368104 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.368026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzkgm\" (UniqueName: \"kubernetes.io/projected/cfb654b8-9dce-4f2d-a558-a061e087f4a7-kube-api-access-xzkgm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.368104 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.368074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.368104 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.368096    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.368350 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.368311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.368404 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.368387    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.376683 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.376660    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzkgm\" (UniqueName: \"kubernetes.io/projected/cfb654b8-9dce-4f2d-a558-a061e087f4a7-kube-api-access-xzkgm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.468983 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.468878    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgcm\" (UniqueName: \"kubernetes.io/projected/12fd732d-1ce0-4d79-93e4-d98ef509caac-kube-api-access-qzgcm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.468983 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.468953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.469190 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.469055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.469500 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.469473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.469543 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.469480    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.478313 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.478279    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzgcm\" (UniqueName: \"kubernetes.io/projected/12fd732d-1ce0-4d79-93e4-d98ef509caac-kube-api-access-qzgcm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.488632 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.488608    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:09.577831 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.577798    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"]
Jul 28 20:15:09.581515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.581492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.589570 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.589528    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"]
Jul 28 20:15:09.603802 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.603776    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:09.625398 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.625373    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"]
Jul 28 20:15:09.628178 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:15:09.628152    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb654b8_9dce_4f2d_a558_a061e087f4a7.slice/crio-25f9c6c1bd65ea44f3e85e5c7d6cfaf96c09ece2663c4d315c948a4819104998 WatchSource:0}: Error finding container 25f9c6c1bd65ea44f3e85e5c7d6cfaf96c09ece2663c4d315c948a4819104998: Status 404 returned error can't find the container with id 25f9c6c1bd65ea44f3e85e5c7d6cfaf96c09ece2663c4d315c948a4819104998
Jul 28 20:15:09.670490 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.670463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdksx\" (UniqueName: \"kubernetes.io/projected/96134e80-b387-4cd9-8ab4-a28cf778b6f2-kube-api-access-rdksx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.670617 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.670528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.670617 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.670605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.744864 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.744697    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"]
Jul 28 20:15:09.747606 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:15:09.747569    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fd732d_1ce0_4d79_93e4_d98ef509caac.slice/crio-18bdff003fa1133199060fcd600f53a98af0bddfc13d9fb188535c36caf04658 WatchSource:0}: Error finding container 18bdff003fa1133199060fcd600f53a98af0bddfc13d9fb188535c36caf04658: Status 404 returned error can't find the container with id 18bdff003fa1133199060fcd600f53a98af0bddfc13d9fb188535c36caf04658
Jul 28 20:15:09.771520 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.771493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.771610 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.771531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.771610 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.771598    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdksx\" (UniqueName: \"kubernetes.io/projected/96134e80-b387-4cd9-8ab4-a28cf778b6f2-kube-api-access-rdksx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.771924 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.771899    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.771965 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.771908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.781756 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.781731    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdksx\" (UniqueName: \"kubernetes.io/projected/96134e80-b387-4cd9-8ab4-a28cf778b6f2-kube-api-access-rdksx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.894314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.894287    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:09.972661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.972623    2561 generic.go:356] "Generic (PLEG): container finished" podID="cfb654b8-9dce-4f2d-a558-a061e087f4a7" containerID="66e9fca4b6b2d98a6c58e2a5a769ba21c9ca723b0a17bc3a01ca0d0f3d052c69" exitCode=0
Jul 28 20:15:09.972830 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.972668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz" event={"ID":"cfb654b8-9dce-4f2d-a558-a061e087f4a7","Type":"ContainerDied","Data":"66e9fca4b6b2d98a6c58e2a5a769ba21c9ca723b0a17bc3a01ca0d0f3d052c69"}
Jul 28 20:15:09.972830 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.972729    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz" event={"ID":"cfb654b8-9dce-4f2d-a558-a061e087f4a7","Type":"ContainerStarted","Data":"25f9c6c1bd65ea44f3e85e5c7d6cfaf96c09ece2663c4d315c948a4819104998"}
Jul 28 20:15:09.974587 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.974562    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"]
Jul 28 20:15:09.974950 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.974926    2561 generic.go:356] "Generic (PLEG): container finished" podID="12fd732d-1ce0-4d79-93e4-d98ef509caac" containerID="7d1fa8ab9a84e02f57da9f9fc9da498e5514fe497b3d04e0cf426a9da4d521f6" exitCode=0
Jul 28 20:15:09.981288 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.980686    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m" event={"ID":"12fd732d-1ce0-4d79-93e4-d98ef509caac","Type":"ContainerDied","Data":"7d1fa8ab9a84e02f57da9f9fc9da498e5514fe497b3d04e0cf426a9da4d521f6"}
Jul 28 20:15:09.981288 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.980724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m" event={"ID":"12fd732d-1ce0-4d79-93e4-d98ef509caac","Type":"ContainerStarted","Data":"18bdff003fa1133199060fcd600f53a98af0bddfc13d9fb188535c36caf04658"}
Jul 28 20:15:09.981288 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.980820    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:09.988219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:09.988191    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"]
Jul 28 20:15:10.039640 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.039595    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"]
Jul 28 20:15:10.042901 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:15:10.042873    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96134e80_b387_4cd9_8ab4_a28cf778b6f2.slice/crio-b51cc2b3701f2070914e5456889ac8075f894d2d09b6c3349962a6973fd60395 WatchSource:0}: Error finding container b51cc2b3701f2070914e5456889ac8075f894d2d09b6c3349962a6973fd60395: Status 404 returned error can't find the container with id b51cc2b3701f2070914e5456889ac8075f894d2d09b6c3349962a6973fd60395
Jul 28 20:15:10.074139 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.074115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:10.074302 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.074281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:10.074355 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.074317    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjbzq\" (UniqueName: \"kubernetes.io/projected/d3296c34-fb84-4354-9523-9fce26d250ce-kube-api-access-xjbzq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:10.174767 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.174739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:10.174898 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.174775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjbzq\" (UniqueName: \"kubernetes.io/projected/d3296c34-fb84-4354-9523-9fce26d250ce-kube-api-access-xjbzq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:10.174898 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.174809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:10.175175 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.175157    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:10.175221 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.175166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:10.183788 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.183761    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjbzq\" (UniqueName: \"kubernetes.io/projected/d3296c34-fb84-4354-9523-9fce26d250ce-kube-api-access-xjbzq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:10.295266 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.295155    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:10.455039 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.455010    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"]
Jul 28 20:15:10.457051 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:15:10.457016    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3296c34_fb84_4354_9523_9fce26d250ce.slice/crio-be96925acfd05c3008a6dbf590126e52a0670c854930bf4ec47acc239ddf0b6c WatchSource:0}: Error finding container be96925acfd05c3008a6dbf590126e52a0670c854930bf4ec47acc239ddf0b6c: Status 404 returned error can't find the container with id be96925acfd05c3008a6dbf590126e52a0670c854930bf4ec47acc239ddf0b6c
Jul 28 20:15:10.987369 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.987338    2561 generic.go:356] "Generic (PLEG): container finished" podID="96134e80-b387-4cd9-8ab4-a28cf778b6f2" containerID="496b917ebb5260edefb1ccff96f027a75edb5c888b5ed6a3b2414f1b28d84178" exitCode=0
Jul 28 20:15:10.987530 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.987415    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq" event={"ID":"96134e80-b387-4cd9-8ab4-a28cf778b6f2","Type":"ContainerDied","Data":"496b917ebb5260edefb1ccff96f027a75edb5c888b5ed6a3b2414f1b28d84178"}
Jul 28 20:15:10.987530 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.987514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq" event={"ID":"96134e80-b387-4cd9-8ab4-a28cf778b6f2","Type":"ContainerStarted","Data":"b51cc2b3701f2070914e5456889ac8075f894d2d09b6c3349962a6973fd60395"}
Jul 28 20:15:10.989565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.989540    2561 generic.go:356] "Generic (PLEG): container finished" podID="12fd732d-1ce0-4d79-93e4-d98ef509caac" containerID="995fd3cd2a75a74fd51d09f1e77fdca7be4b08cce78a1156117e0914b554f849" exitCode=0
Jul 28 20:15:10.989684 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.989622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m" event={"ID":"12fd732d-1ce0-4d79-93e4-d98ef509caac","Type":"ContainerDied","Data":"995fd3cd2a75a74fd51d09f1e77fdca7be4b08cce78a1156117e0914b554f849"}
Jul 28 20:15:10.991355 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.991314    2561 generic.go:356] "Generic (PLEG): container finished" podID="d3296c34-fb84-4354-9523-9fce26d250ce" containerID="8f150a5169bcaeff52975fc8662c5884087c2fb47442ce4adb32f7b5d3e50184" exitCode=0
Jul 28 20:15:10.991429 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.991404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk" event={"ID":"d3296c34-fb84-4354-9523-9fce26d250ce","Type":"ContainerDied","Data":"8f150a5169bcaeff52975fc8662c5884087c2fb47442ce4adb32f7b5d3e50184"}
Jul 28 20:15:10.991490 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:10.991441    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk" event={"ID":"d3296c34-fb84-4354-9523-9fce26d250ce","Type":"ContainerStarted","Data":"be96925acfd05c3008a6dbf590126e52a0670c854930bf4ec47acc239ddf0b6c"}
Jul 28 20:15:11.997880 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:11.997853    2561 generic.go:356] "Generic (PLEG): container finished" podID="12fd732d-1ce0-4d79-93e4-d98ef509caac" containerID="51c5047389ab4959df8cb0f0764c00c29a062fb6ca470bbefa504cab10581925" exitCode=0
Jul 28 20:15:11.998226 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:11.997937    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m" event={"ID":"12fd732d-1ce0-4d79-93e4-d98ef509caac","Type":"ContainerDied","Data":"51c5047389ab4959df8cb0f0764c00c29a062fb6ca470bbefa504cab10581925"}
Jul 28 20:15:11.999595 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:11.999574    2561 generic.go:356] "Generic (PLEG): container finished" podID="d3296c34-fb84-4354-9523-9fce26d250ce" containerID="0e3b65fb28dfc3940faa270c47206b505e00529ce7d21a365dc053fe829662b7" exitCode=0
Jul 28 20:15:11.999698 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:11.999654    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk" event={"ID":"d3296c34-fb84-4354-9523-9fce26d250ce","Type":"ContainerDied","Data":"0e3b65fb28dfc3940faa270c47206b505e00529ce7d21a365dc053fe829662b7"}
Jul 28 20:15:12.001624 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:12.001606    2561 generic.go:356] "Generic (PLEG): container finished" podID="cfb654b8-9dce-4f2d-a558-a061e087f4a7" containerID="fdf342fb0fb8b0479a672111d805055b011208324a223ee99079d3c3cb42e772" exitCode=0
Jul 28 20:15:12.001738 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:12.001664    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz" event={"ID":"cfb654b8-9dce-4f2d-a558-a061e087f4a7","Type":"ContainerDied","Data":"fdf342fb0fb8b0479a672111d805055b011208324a223ee99079d3c3cb42e772"}
Jul 28 20:15:13.007680 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.007645    2561 generic.go:356] "Generic (PLEG): container finished" podID="96134e80-b387-4cd9-8ab4-a28cf778b6f2" containerID="f34f573cdb5c0ac06e9d9feef2e59407b78bea5cc495865e1bc944cb3e0d6ad2" exitCode=0
Jul 28 20:15:13.008097 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.007738    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq" event={"ID":"96134e80-b387-4cd9-8ab4-a28cf778b6f2","Type":"ContainerDied","Data":"f34f573cdb5c0ac06e9d9feef2e59407b78bea5cc495865e1bc944cb3e0d6ad2"}
Jul 28 20:15:13.009944 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.009921    2561 generic.go:356] "Generic (PLEG): container finished" podID="d3296c34-fb84-4354-9523-9fce26d250ce" containerID="e96f55421d1bd8df615e5e207bcc0a856bf1389edf69dde17884afbe97449d3d" exitCode=0
Jul 28 20:15:13.010052 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.010001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk" event={"ID":"d3296c34-fb84-4354-9523-9fce26d250ce","Type":"ContainerDied","Data":"e96f55421d1bd8df615e5e207bcc0a856bf1389edf69dde17884afbe97449d3d"}
Jul 28 20:15:13.012022 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.012003    2561 generic.go:356] "Generic (PLEG): container finished" podID="cfb654b8-9dce-4f2d-a558-a061e087f4a7" containerID="6603194dab54213d16969f5961168436b294a48e393232503a0ce0654608de52" exitCode=0
Jul 28 20:15:13.012121 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.012090    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz" event={"ID":"cfb654b8-9dce-4f2d-a558-a061e087f4a7","Type":"ContainerDied","Data":"6603194dab54213d16969f5961168436b294a48e393232503a0ce0654608de52"}
Jul 28 20:15:13.214123 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.214099    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:13.304778 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.304699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-bundle\") pod \"12fd732d-1ce0-4d79-93e4-d98ef509caac\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") "
Jul 28 20:15:13.304778 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.304763    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzgcm\" (UniqueName: \"kubernetes.io/projected/12fd732d-1ce0-4d79-93e4-d98ef509caac-kube-api-access-qzgcm\") pod \"12fd732d-1ce0-4d79-93e4-d98ef509caac\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") "
Jul 28 20:15:13.305001 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.304795    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-util\") pod \"12fd732d-1ce0-4d79-93e4-d98ef509caac\" (UID: \"12fd732d-1ce0-4d79-93e4-d98ef509caac\") "
Jul 28 20:15:13.305203 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.305169    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-bundle" (OuterVolumeSpecName: "bundle") pod "12fd732d-1ce0-4d79-93e4-d98ef509caac" (UID: "12fd732d-1ce0-4d79-93e4-d98ef509caac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:13.307014 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.306992    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12fd732d-1ce0-4d79-93e4-d98ef509caac-kube-api-access-qzgcm" (OuterVolumeSpecName: "kube-api-access-qzgcm") pod "12fd732d-1ce0-4d79-93e4-d98ef509caac" (UID: "12fd732d-1ce0-4d79-93e4-d98ef509caac"). InnerVolumeSpecName "kube-api-access-qzgcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:13.310274 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.310255    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-util" (OuterVolumeSpecName: "util") pod "12fd732d-1ce0-4d79-93e4-d98ef509caac" (UID: "12fd732d-1ce0-4d79-93e4-d98ef509caac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:13.406196 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.406155    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:13.406196 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.406189    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzgcm\" (UniqueName: \"kubernetes.io/projected/12fd732d-1ce0-4d79-93e4-d98ef509caac-kube-api-access-qzgcm\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:13.406196 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:13.406198    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12fd732d-1ce0-4d79-93e4-d98ef509caac-util\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:14.019332 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.019300    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m"
Jul 28 20:15:14.019332 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.019309    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m" event={"ID":"12fd732d-1ce0-4d79-93e4-d98ef509caac","Type":"ContainerDied","Data":"18bdff003fa1133199060fcd600f53a98af0bddfc13d9fb188535c36caf04658"}
Jul 28 20:15:14.019817 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.019359    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18bdff003fa1133199060fcd600f53a98af0bddfc13d9fb188535c36caf04658"
Jul 28 20:15:14.021811 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.021781    2561 generic.go:356] "Generic (PLEG): container finished" podID="96134e80-b387-4cd9-8ab4-a28cf778b6f2" containerID="767924142ed4d72d9cf4b00ac8a1520ba11435d620ee0091f4d066112dc3243d" exitCode=0
Jul 28 20:15:14.021960 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.021872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq" event={"ID":"96134e80-b387-4cd9-8ab4-a28cf778b6f2","Type":"ContainerDied","Data":"767924142ed4d72d9cf4b00ac8a1520ba11435d620ee0091f4d066112dc3243d"}
Jul 28 20:15:14.180982 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.180958    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:14.183444 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.183429    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:14.312850 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.312784    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjbzq\" (UniqueName: \"kubernetes.io/projected/d3296c34-fb84-4354-9523-9fce26d250ce-kube-api-access-xjbzq\") pod \"d3296c34-fb84-4354-9523-9fce26d250ce\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") "
Jul 28 20:15:14.312850 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.312830    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-bundle\") pod \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") "
Jul 28 20:15:14.312989 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.312867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzkgm\" (UniqueName: \"kubernetes.io/projected/cfb654b8-9dce-4f2d-a558-a061e087f4a7-kube-api-access-xzkgm\") pod \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") "
Jul 28 20:15:14.312989 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.312968    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-bundle\") pod \"d3296c34-fb84-4354-9523-9fce26d250ce\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") "
Jul 28 20:15:14.313086 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.313005    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-util\") pod \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\" (UID: \"cfb654b8-9dce-4f2d-a558-a061e087f4a7\") "
Jul 28 20:15:14.313086 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.313038    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-util\") pod \"d3296c34-fb84-4354-9523-9fce26d250ce\" (UID: \"d3296c34-fb84-4354-9523-9fce26d250ce\") "
Jul 28 20:15:14.313526 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.313497    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-bundle" (OuterVolumeSpecName: "bundle") pod "cfb654b8-9dce-4f2d-a558-a061e087f4a7" (UID: "cfb654b8-9dce-4f2d-a558-a061e087f4a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:14.313643 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.313619    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-bundle" (OuterVolumeSpecName: "bundle") pod "d3296c34-fb84-4354-9523-9fce26d250ce" (UID: "d3296c34-fb84-4354-9523-9fce26d250ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:14.314996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.314966    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb654b8-9dce-4f2d-a558-a061e087f4a7-kube-api-access-xzkgm" (OuterVolumeSpecName: "kube-api-access-xzkgm") pod "cfb654b8-9dce-4f2d-a558-a061e087f4a7" (UID: "cfb654b8-9dce-4f2d-a558-a061e087f4a7"). InnerVolumeSpecName "kube-api-access-xzkgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:14.315617 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.315258    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3296c34-fb84-4354-9523-9fce26d250ce-kube-api-access-xjbzq" (OuterVolumeSpecName: "kube-api-access-xjbzq") pod "d3296c34-fb84-4354-9523-9fce26d250ce" (UID: "d3296c34-fb84-4354-9523-9fce26d250ce"). InnerVolumeSpecName "kube-api-access-xjbzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:14.318861 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.318823    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-util" (OuterVolumeSpecName: "util") pod "d3296c34-fb84-4354-9523-9fce26d250ce" (UID: "d3296c34-fb84-4354-9523-9fce26d250ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:14.318982 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.318962    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-util" (OuterVolumeSpecName: "util") pod "cfb654b8-9dce-4f2d-a558-a061e087f4a7" (UID: "cfb654b8-9dce-4f2d-a558-a061e087f4a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:14.414245 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.414219    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:14.414323 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.414257    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-util\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:14.414323 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.414267    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3296c34-fb84-4354-9523-9fce26d250ce-util\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:14.414323 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.414276    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjbzq\" (UniqueName: \"kubernetes.io/projected/d3296c34-fb84-4354-9523-9fce26d250ce-kube-api-access-xjbzq\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:14.414323 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.414285    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfb654b8-9dce-4f2d-a558-a061e087f4a7-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:14.414323 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:14.414293    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzkgm\" (UniqueName: \"kubernetes.io/projected/cfb654b8-9dce-4f2d-a558-a061e087f4a7-kube-api-access-xzkgm\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:15.029108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.029079    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk"
Jul 28 20:15:15.029521 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.029079    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk" event={"ID":"d3296c34-fb84-4354-9523-9fce26d250ce","Type":"ContainerDied","Data":"be96925acfd05c3008a6dbf590126e52a0670c854930bf4ec47acc239ddf0b6c"}
Jul 28 20:15:15.029521 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.029264    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be96925acfd05c3008a6dbf590126e52a0670c854930bf4ec47acc239ddf0b6c"
Jul 28 20:15:15.031302 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.031268    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz" event={"ID":"cfb654b8-9dce-4f2d-a558-a061e087f4a7","Type":"ContainerDied","Data":"25f9c6c1bd65ea44f3e85e5c7d6cfaf96c09ece2663c4d315c948a4819104998"}
Jul 28 20:15:15.031302 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.031290    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz"
Jul 28 20:15:15.031459 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.031317    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25f9c6c1bd65ea44f3e85e5c7d6cfaf96c09ece2663c4d315c948a4819104998"
Jul 28 20:15:15.169398 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.169377    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:15.322348 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.322287    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-util\") pod \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") "
Jul 28 20:15:15.322472 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.322348    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdksx\" (UniqueName: \"kubernetes.io/projected/96134e80-b387-4cd9-8ab4-a28cf778b6f2-kube-api-access-rdksx\") pod \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") "
Jul 28 20:15:15.322472 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.322373    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-bundle\") pod \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\" (UID: \"96134e80-b387-4cd9-8ab4-a28cf778b6f2\") "
Jul 28 20:15:15.322850 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.322822    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-bundle" (OuterVolumeSpecName: "bundle") pod "96134e80-b387-4cd9-8ab4-a28cf778b6f2" (UID: "96134e80-b387-4cd9-8ab4-a28cf778b6f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:15.324319 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.324299    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96134e80-b387-4cd9-8ab4-a28cf778b6f2-kube-api-access-rdksx" (OuterVolumeSpecName: "kube-api-access-rdksx") pod "96134e80-b387-4cd9-8ab4-a28cf778b6f2" (UID: "96134e80-b387-4cd9-8ab4-a28cf778b6f2"). InnerVolumeSpecName "kube-api-access-rdksx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:15.327081 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.327062    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-util" (OuterVolumeSpecName: "util") pod "96134e80-b387-4cd9-8ab4-a28cf778b6f2" (UID: "96134e80-b387-4cd9-8ab4-a28cf778b6f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:15:15.423937 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.423898    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-util\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:15.423937 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.423933    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdksx\" (UniqueName: \"kubernetes.io/projected/96134e80-b387-4cd9-8ab4-a28cf778b6f2-kube-api-access-rdksx\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:15.424058 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:15.423950    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96134e80-b387-4cd9-8ab4-a28cf778b6f2-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:16.039218 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:16.039188    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq"
Jul 28 20:15:16.039592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:16.039217    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq" event={"ID":"96134e80-b387-4cd9-8ab4-a28cf778b6f2","Type":"ContainerDied","Data":"b51cc2b3701f2070914e5456889ac8075f894d2d09b6c3349962a6973fd60395"}
Jul 28 20:15:16.039592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:16.039284    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b51cc2b3701f2070914e5456889ac8075f894d2d09b6c3349962a6973fd60395"
Jul 28 20:15:27.404519 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:27.404478    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f74489947-552cd"]
Jul 28 20:15:52.428082 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.428017    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f74489947-552cd" podUID="581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" containerName="console" containerID="cri-o://2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472" gracePeriod=15
Jul 28 20:15:52.674341 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.674314    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:15:52.699870 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.699792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l92n8\" (UniqueName: \"kubernetes.io/projected/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-kube-api-access-l92n8\") pod \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") "
Jul 28 20:15:52.699870 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.699846    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-serving-cert\") pod \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") "
Jul 28 20:15:52.700080 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.699891    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-service-ca\") pod \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") "
Jul 28 20:15:52.700080 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.699913    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-oauth-serving-cert\") pod \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") "
Jul 28 20:15:52.700080 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.699944    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-config\") pod \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") "
Jul 28 20:15:52.700080 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.700005    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-oauth-config\") pod \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") "
Jul 28 20:15:52.700080 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.700030    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-trusted-ca-bundle\") pod \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\" (UID: \"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26\") "
Jul 28 20:15:52.700562 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.700535    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" (UID: "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:52.700671 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.700624    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" (UID: "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:52.700914 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.700748    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-config" (OuterVolumeSpecName: "console-config") pod "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" (UID: "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:52.700914 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.700877    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-service-ca" (OuterVolumeSpecName: "service-ca") pod "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" (UID: "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:15:52.702145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.702115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-kube-api-access-l92n8" (OuterVolumeSpecName: "kube-api-access-l92n8") pod "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" (UID: "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26"). InnerVolumeSpecName "kube-api-access-l92n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:15:52.702229 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.702195    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" (UID: "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:15:52.702407 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.702341    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" (UID: "581143fd-7d3e-49e0-b0dc-3cdd8ca42c26"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:15:52.800976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.800944    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:52.800976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.800970    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-oauth-serving-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:52.800976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.800980    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:52.801195 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.800989    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-oauth-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:52.801195 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.800998    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-trusted-ca-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:52.801195 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.801006    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l92n8\" (UniqueName: \"kubernetes.io/projected/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-kube-api-access-l92n8\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:52.801195 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:52.801039    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26-console-serving-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:15:53.225189 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:53.225151    2561 generic.go:356] "Generic (PLEG): container finished" podID="581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" containerID="2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472" exitCode=0
Jul 28 20:15:53.225394 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:53.225205    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f74489947-552cd"
Jul 28 20:15:53.225394 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:53.225256    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f74489947-552cd" event={"ID":"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26","Type":"ContainerDied","Data":"2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472"}
Jul 28 20:15:53.225394 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:53.225307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f74489947-552cd" event={"ID":"581143fd-7d3e-49e0-b0dc-3cdd8ca42c26","Type":"ContainerDied","Data":"72e6a4b9ad35ad1df0cea8f791177e3194105fc0cc383b154fe51afec03161af"}
Jul 28 20:15:53.225394 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:53.225328    2561 scope.go:117] "RemoveContainer" containerID="2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472"
Jul 28 20:15:53.234307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:53.234292    2561 scope.go:117] "RemoveContainer" containerID="2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472"
Jul 28 20:15:53.234567 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:15:53.234549    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472\": container with ID starting with 2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472 not found: ID does not exist" containerID="2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472"
Jul 28 20:15:53.234612 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:53.234574    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472"} err="failed to get container status \"2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472\": rpc error: code = NotFound desc = could not find container \"2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472\": container with ID starting with 2a4f16bde96f24935fccd7cf816ee7c45d6725552fb4d45e14beb41ae4d81472 not found: ID does not exist"
Jul 28 20:15:53.248717 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:53.248691    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f74489947-552cd"]
Jul 28 20:15:53.251546 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:53.251513    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f74489947-552cd"]
Jul 28 20:15:54.076994 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:15:54.076964    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" path="/var/lib/kubelet/pods/581143fd-7d3e-49e0-b0dc-3cdd8ca42c26/volumes"
Jul 28 20:16:43.003253 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003205    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"]
Jul 28 20:16:43.003746 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003664    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96134e80-b387-4cd9-8ab4-a28cf778b6f2" containerName="pull"
Jul 28 20:16:43.003746 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003681    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="96134e80-b387-4cd9-8ab4-a28cf778b6f2" containerName="pull"
Jul 28 20:16:43.003746 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003696    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" containerName="console"
Jul 28 20:16:43.003746 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003705    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" containerName="console"
Jul 28 20:16:43.003746 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003717    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfb654b8-9dce-4f2d-a558-a061e087f4a7" containerName="pull"
Jul 28 20:16:43.003746 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003725    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfb654b8-9dce-4f2d-a558-a061e087f4a7" containerName="pull"
Jul 28 20:16:43.003746 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003736    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3296c34-fb84-4354-9523-9fce26d250ce" containerName="pull"
Jul 28 20:16:43.003746 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003746    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3296c34-fb84-4354-9523-9fce26d250ce" containerName="pull"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003759    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3296c34-fb84-4354-9523-9fce26d250ce" containerName="util"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003766    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3296c34-fb84-4354-9523-9fce26d250ce" containerName="util"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003778    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfb654b8-9dce-4f2d-a558-a061e087f4a7" containerName="util"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003786    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfb654b8-9dce-4f2d-a558-a061e087f4a7" containerName="util"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003796    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96134e80-b387-4cd9-8ab4-a28cf778b6f2" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003804    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="96134e80-b387-4cd9-8ab4-a28cf778b6f2" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003822    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fd732d-1ce0-4d79-93e4-d98ef509caac" containerName="util"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003829    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fd732d-1ce0-4d79-93e4-d98ef509caac" containerName="util"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003840    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96134e80-b387-4cd9-8ab4-a28cf778b6f2" containerName="util"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003848    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="96134e80-b387-4cd9-8ab4-a28cf778b6f2" containerName="util"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003857    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3296c34-fb84-4354-9523-9fce26d250ce" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003865    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3296c34-fb84-4354-9523-9fce26d250ce" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003874    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfb654b8-9dce-4f2d-a558-a061e087f4a7" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003882    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfb654b8-9dce-4f2d-a558-a061e087f4a7" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003894    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fd732d-1ce0-4d79-93e4-d98ef509caac" containerName="pull"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003902    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fd732d-1ce0-4d79-93e4-d98ef509caac" containerName="pull"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003911    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fd732d-1ce0-4d79-93e4-d98ef509caac" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003920    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fd732d-1ce0-4d79-93e4-d98ef509caac" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.003999    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="581143fd-7d3e-49e0-b0dc-3cdd8ca42c26" containerName="console"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.004010    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfb654b8-9dce-4f2d-a558-a061e087f4a7" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.004022    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="12fd732d-1ce0-4d79-93e4-d98ef509caac" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.004034    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3296c34-fb84-4354-9523-9fce26d250ce" containerName="extract"
Jul 28 20:16:43.004145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.004044    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="96134e80-b387-4cd9-8ab4-a28cf778b6f2" containerName="extract"
Jul 28 20:16:43.007077 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.007058    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.009408 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.009388    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9qmvn\""
Jul 28 20:16:43.018938 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.018914    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"]
Jul 28 20:16:43.020698 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.020672    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.020807 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.020722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.020861 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.020810    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.020899 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.020876    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.020934 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.020910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c285b08d-7c13-49a3-82f7-5be298d970db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.020980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.020965    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c285b08d-7c13-49a3-82f7-5be298d970db-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.021015 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.021005    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.021048 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.021029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c285b08d-7c13-49a3-82f7-5be298d970db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.021084 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.021053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqqsx\" (UniqueName: \"kubernetes.io/projected/c285b08d-7c13-49a3-82f7-5be298d970db-kube-api-access-nqqsx\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122229 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c285b08d-7c13-49a3-82f7-5be298d970db-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122422 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122422 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c285b08d-7c13-49a3-82f7-5be298d970db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122422 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122302    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqqsx\" (UniqueName: \"kubernetes.io/projected/c285b08d-7c13-49a3-82f7-5be298d970db-kube-api-access-nqqsx\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122422 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122346    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122719 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122719 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c285b08d-7c13-49a3-82f7-5be298d970db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122719 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122683    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122737    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122830    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.122976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.122909    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.123311 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.123290    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c285b08d-7c13-49a3-82f7-5be298d970db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.124630 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.124603    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c285b08d-7c13-49a3-82f7-5be298d970db-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.124736 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.124719    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c285b08d-7c13-49a3-82f7-5be298d970db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.129833 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.129813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c285b08d-7c13-49a3-82f7-5be298d970db-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.130116 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.130097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqqsx\" (UniqueName: \"kubernetes.io/projected/c285b08d-7c13-49a3-82f7-5be298d970db-kube-api-access-nqqsx\") pod \"maas-default-gateway-openshift-default-5ccb968c66-6jjbz\" (UID: \"c285b08d-7c13-49a3-82f7-5be298d970db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.318336 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.318248    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:43.451540 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.451511    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"]
Jul 28 20:16:43.453754 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:16:43.453726    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc285b08d_7c13_49a3_82f7_5be298d970db.slice/crio-bccba9e04ef303f9490aad67596eac7c3235f9d788f1b631a4ee9c4bcb977dc8 WatchSource:0}: Error finding container bccba9e04ef303f9490aad67596eac7c3235f9d788f1b631a4ee9c4bcb977dc8: Status 404 returned error can't find the container with id bccba9e04ef303f9490aad67596eac7c3235f9d788f1b631a4ee9c4bcb977dc8
Jul 28 20:16:43.456206 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.456167    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:16:43.456301 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.456258    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:16:43.456301 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.456295    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:16:43.471565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:43.471538    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz" event={"ID":"c285b08d-7c13-49a3-82f7-5be298d970db","Type":"ContainerStarted","Data":"bccba9e04ef303f9490aad67596eac7c3235f9d788f1b631a4ee9c4bcb977dc8"}
Jul 28 20:16:44.478095 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:44.478060    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz" event={"ID":"c285b08d-7c13-49a3-82f7-5be298d970db","Type":"ContainerStarted","Data":"0814e8a617489d04e92acdbb8b095f8f20f403ea167648027d2379007200345d"}
Jul 28 20:16:44.501023 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:44.500965    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz" podStartSLOduration=2.500949119 podStartE2EDuration="2.500949119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:16:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:16:44.498516191 +0000 UTC m=+506.895219347" watchObservedRunningTime="2026-07-28 20:16:44.500949119 +0000 UTC m=+506.897652274"
Jul 28 20:16:45.318510 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:45.318472    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:45.323344 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:45.323306    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:45.483395 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:45.483360    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:16:45.484426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:16:45.484410    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:18:11.580332 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.580296    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-864kr"]
Jul 28 20:18:11.583524 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.583506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-864kr"
Jul 28 20:18:11.587561 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.587544    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-52kzv\""
Jul 28 20:18:11.588029 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.588011    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 20:18:11.600701 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.600674    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-864kr"]
Jul 28 20:18:11.697521 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.697475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbzp\" (UniqueName: \"kubernetes.io/projected/180c0d40-0a50-431e-b082-6ac16adfaf80-kube-api-access-mgbzp\") pod \"payload-processing-5cc6cd444b-864kr\" (UID: \"180c0d40-0a50-431e-b082-6ac16adfaf80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-864kr"
Jul 28 20:18:11.697699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.697610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/180c0d40-0a50-431e-b082-6ac16adfaf80-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-864kr\" (UID: \"180c0d40-0a50-431e-b082-6ac16adfaf80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-864kr"
Jul 28 20:18:11.798437 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.798396    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/180c0d40-0a50-431e-b082-6ac16adfaf80-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-864kr\" (UID: \"180c0d40-0a50-431e-b082-6ac16adfaf80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-864kr"
Jul 28 20:18:11.798608 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.798457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbzp\" (UniqueName: \"kubernetes.io/projected/180c0d40-0a50-431e-b082-6ac16adfaf80-kube-api-access-mgbzp\") pod \"payload-processing-5cc6cd444b-864kr\" (UID: \"180c0d40-0a50-431e-b082-6ac16adfaf80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-864kr"
Jul 28 20:18:11.799101 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.799083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/180c0d40-0a50-431e-b082-6ac16adfaf80-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-864kr\" (UID: \"180c0d40-0a50-431e-b082-6ac16adfaf80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-864kr"
Jul 28 20:18:11.806661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.806639    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbzp\" (UniqueName: \"kubernetes.io/projected/180c0d40-0a50-431e-b082-6ac16adfaf80-kube-api-access-mgbzp\") pod \"payload-processing-5cc6cd444b-864kr\" (UID: \"180c0d40-0a50-431e-b082-6ac16adfaf80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-864kr"
Jul 28 20:18:11.893639 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:11.893544    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-864kr"
Jul 28 20:18:12.028181 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:12.028081    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-864kr"]
Jul 28 20:18:12.030401 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:18:12.030376    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod180c0d40_0a50_431e_b082_6ac16adfaf80.slice/crio-594a40bae08892dc3d5b76aaea2113a0383cf8fcc9983068598ea6c6f2efcdb9 WatchSource:0}: Error finding container 594a40bae08892dc3d5b76aaea2113a0383cf8fcc9983068598ea6c6f2efcdb9: Status 404 returned error can't find the container with id 594a40bae08892dc3d5b76aaea2113a0383cf8fcc9983068598ea6c6f2efcdb9
Jul 28 20:18:12.922707 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:12.922668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-864kr" event={"ID":"180c0d40-0a50-431e-b082-6ac16adfaf80","Type":"ContainerStarted","Data":"594a40bae08892dc3d5b76aaea2113a0383cf8fcc9983068598ea6c6f2efcdb9"}
Jul 28 20:18:14.934676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:14.934632    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-864kr" event={"ID":"180c0d40-0a50-431e-b082-6ac16adfaf80","Type":"ContainerStarted","Data":"791229e8c1b46eeeb4033413208ddc086912009d9af0706649dd2466953fd6b9"}
Jul 28 20:18:14.935093 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:14.934780    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-864kr"
Jul 28 20:18:14.952650 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:14.952600    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-864kr" podStartSLOduration=2.100861401 podStartE2EDuration="3.952585124s" totalImagesPullingTime="1.851723723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:18:14.951637728 +0000 UTC m=+597.348340885" watchObservedRunningTime="2026-07-28 20:18:14.952585124 +0000 UTC m=+597.349288279"
Jul 28 20:18:18.069120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:18.069006    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:18:18.084070 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:18.071941    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:18:19.964151 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:19.964111    2561 generic.go:356] "Generic (PLEG): container finished" podID="c285b08d-7c13-49a3-82f7-5be298d970db" containerID="0814e8a617489d04e92acdbb8b095f8f20f403ea167648027d2379007200345d" exitCode=0
Jul 28 20:18:19.964699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:19.964190    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz" event={"ID":"c285b08d-7c13-49a3-82f7-5be298d970db","Type":"ContainerDied","Data":"0814e8a617489d04e92acdbb8b095f8f20f403ea167648027d2379007200345d"}
Jul 28 20:18:19.964780 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:19.964726    2561 scope.go:117] "RemoveContainer" containerID="0814e8a617489d04e92acdbb8b095f8f20f403ea167648027d2379007200345d"
Jul 28 20:18:19.965771 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:19.965743    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:18:19.965834 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:19.965815    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:18:19.965869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:19.965857    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:18:20.970890 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:20.970853    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz" event={"ID":"c285b08d-7c13-49a3-82f7-5be298d970db","Type":"ContainerStarted","Data":"9a84e466320fa80f92aba0aa760d18a4cc87c84480eab0edeccb9486e3948929"}
Jul 28 20:18:21.318949 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:21.318915    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:18:21.319154 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:21.319131    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-6jjbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 28 20:18:21.319206 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:21.319187    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz" podUID="c285b08d-7c13-49a3-82f7-5be298d970db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 28 20:18:22.319142 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:22.319101    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-6jjbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 28 20:18:22.319559 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:22.319168    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz" podUID="c285b08d-7c13-49a3-82f7-5be298d970db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 28 20:18:23.319371 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:23.319333    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-6jjbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 28 20:18:23.319779 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:23.319416    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz" podUID="c285b08d-7c13-49a3-82f7-5be298d970db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 28 20:18:24.318826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:24.318786    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-6jjbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 28 20:18:24.319002 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:24.318845    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz" podUID="c285b08d-7c13-49a3-82f7-5be298d970db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 28 20:18:25.321761 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:25.321732    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:18:25.322127 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:25.321987    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:18:25.322578 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:25.322565    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-6jjbz"
Jul 28 20:18:25.942721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:25.942687    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-864kr"
Jul 28 20:18:29.100050 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.100016    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"]
Jul 28 20:18:29.105995 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.105974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.109072 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.109033    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 20:18:29.109273 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.109081    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 20:18:29.109273 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.109188    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 28 20:18:29.109429 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.109285    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xw4fk\""
Jul 28 20:18:29.115205 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.115183    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"]
Jul 28 20:18:29.152849 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.152814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af2aac09-4a78-484f-9174-563a6006ec88-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.153017 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.152901    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.153017 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.152925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.153017 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.152962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnbnq\" (UniqueName: \"kubernetes.io/projected/af2aac09-4a78-484f-9174-563a6006ec88-kube-api-access-rnbnq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.153159 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.153143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.153250 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.153223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.253706 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.253668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.253890 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.253714    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.253890 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.253743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnbnq\" (UniqueName: \"kubernetes.io/projected/af2aac09-4a78-484f-9174-563a6006ec88-kube-api-access-rnbnq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.253890 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.253766    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.253890 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.253802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.254145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.253953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af2aac09-4a78-484f-9174-563a6006ec88-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.254145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.254111    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.254297 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.254156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.254297 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.254172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.256033 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.256012    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af2aac09-4a78-484f-9174-563a6006ec88-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.256387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.256369    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af2aac09-4a78-484f-9174-563a6006ec88-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.261220 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.261200    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnbnq\" (UniqueName: \"kubernetes.io/projected/af2aac09-4a78-484f-9174-563a6006ec88-kube-api-access-rnbnq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx\" (UID: \"af2aac09-4a78-484f-9174-563a6006ec88\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.417393 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.417307    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:29.549770 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.549744    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"]
Jul 28 20:18:29.551749 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:18:29.551723    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf2aac09_4a78_484f_9174_563a6006ec88.slice/crio-b02c14ead5e1648e921962af4a4419cc36843d033d4cf79cbd7c62ad976b6704 WatchSource:0}: Error finding container b02c14ead5e1648e921962af4a4419cc36843d033d4cf79cbd7c62ad976b6704: Status 404 returned error can't find the container with id b02c14ead5e1648e921962af4a4419cc36843d033d4cf79cbd7c62ad976b6704
Jul 28 20:18:29.553029 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:29.553012    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:18:30.019764 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:30.019725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx" event={"ID":"af2aac09-4a78-484f-9174-563a6006ec88","Type":"ContainerStarted","Data":"b02c14ead5e1648e921962af4a4419cc36843d033d4cf79cbd7c62ad976b6704"}
Jul 28 20:18:31.026441 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:31.026406    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx" event={"ID":"af2aac09-4a78-484f-9174-563a6006ec88","Type":"ContainerStarted","Data":"a3bf30ce6a5089be62970ef85beb71e5d13dc4f59ecc04fe3637f2b325b9266f"}
Jul 28 20:18:31.046272 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:31.046211    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx" podStartSLOduration=0.865962543 podStartE2EDuration="2.046195454s" totalImagesPullingTime="1.180232911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:18:31.043761811 +0000 UTC m=+613.440464979" watchObservedRunningTime="2026-07-28 20:18:31.046195454 +0000 UTC m=+613.442898678"
Jul 28 20:18:39.417446 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:39.417404    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:39.417872 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:39.417490    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:39.430125 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:39.430099    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:18:40.079848 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:18:40.079819    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx"
Jul 28 20:23:18.103721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:23:18.103691    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:23:18.106003 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:23:18.105982    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:28:18.139106 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:28:18.139078    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:28:18.143038 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:28:18.143013    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:30:00.139102 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:00.139070    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2"]
Jul 28 20:30:00.142216 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:00.142199    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2"
Jul 28 20:30:00.144426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:00.144406    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 20:30:00.150219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:00.150196    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2"]
Jul 28 20:30:00.153011 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:00.152992    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2"
Jul 28 20:30:00.285920 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:00.285894    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2"]
Jul 28 20:30:00.287727 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:30:00.287704    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bd5c2b_0d86_4071_b076_670a910ef419.slice/crio-f46f4e2390366a7caf9387df08a7c403497aef6cdd2ac69853c6d578a1cccf2d WatchSource:0}: Error finding container f46f4e2390366a7caf9387df08a7c403497aef6cdd2ac69853c6d578a1cccf2d: Status 404 returned error can't find the container with id f46f4e2390366a7caf9387df08a7c403497aef6cdd2ac69853c6d578a1cccf2d
Jul 28 20:30:00.289489 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:00.289473    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:30:00.410702 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:00.410613    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2" event={"ID":"98bd5c2b-0d86-4071-b076-670a910ef419","Type":"ContainerStarted","Data":"f46f4e2390366a7caf9387df08a7c403497aef6cdd2ac69853c6d578a1cccf2d"}
Jul 28 20:30:03.428467 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:03.428428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2" event={"ID":"98bd5c2b-0d86-4071-b076-670a910ef419","Type":"ContainerStarted","Data":"ec64dc651870efd7cb45177c0d3763f2e1b4bb74ca1d95eaeec9ffc9cdc3ae16"}
Jul 28 20:30:03.450004 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:03.449952    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2" podStartSLOduration=1.016439955 podStartE2EDuration="3.449934617s" totalImagesPullingTime="2.433494662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:03.447321286 +0000 UTC m=+1305.844024459" watchObservedRunningTime="2026-07-28 20:30:03.449934617 +0000 UTC m=+1305.846637772"
Jul 28 20:30:04.435447 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:04.435408    2561 generic.go:356] "Generic (PLEG): container finished" podID="98bd5c2b-0d86-4071-b076-670a910ef419" containerID="ec64dc651870efd7cb45177c0d3763f2e1b4bb74ca1d95eaeec9ffc9cdc3ae16" exitCode=0
Jul 28 20:30:04.435833 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:04.435495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2" event={"ID":"98bd5c2b-0d86-4071-b076-670a910ef419","Type":"ContainerDied","Data":"ec64dc651870efd7cb45177c0d3763f2e1b4bb74ca1d95eaeec9ffc9cdc3ae16"}
Jul 28 20:30:05.572883 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:05.572854    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2"
Jul 28 20:30:06.447539 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:06.447458    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2"
Jul 28 20:30:06.447539 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:06.447497    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754510-bmhf2" event={"ID":"98bd5c2b-0d86-4071-b076-670a910ef419","Type":"ContainerDied","Data":"f46f4e2390366a7caf9387df08a7c403497aef6cdd2ac69853c6d578a1cccf2d"}
Jul 28 20:30:06.447539 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:30:06.447540    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f46f4e2390366a7caf9387df08a7c403497aef6cdd2ac69853c6d578a1cccf2d"
Jul 28 20:33:18.173426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:33:18.173396    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:33:18.177809 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:33:18.177783    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:36:19.984724 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:19.984685    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"]
Jul 28 20:36:19.987021 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:19.985030    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98bd5c2b-0d86-4071-b076-670a910ef419" containerName="cleanup"
Jul 28 20:36:19.987021 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:19.985041    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="98bd5c2b-0d86-4071-b076-670a910ef419" containerName="cleanup"
Jul 28 20:36:19.987021 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:19.985103    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="98bd5c2b-0d86-4071-b076-670a910ef419" containerName="cleanup"
Jul 28 20:36:19.987968 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:19.987952    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:19.991057 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:19.991032    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d20ffe25-openshift-default-dockercfg-pfdkg\""
Jul 28 20:36:20.083751 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.083692    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"]
Jul 28 20:36:20.130668 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.130630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-envoy\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.130668 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.130673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-podinfo\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.130868 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.130706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-credential-socket\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.130868 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.130814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69bcea83-4e58-4aea-8f5c-e906f25d8485-istiod-ca-cert\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.130940 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.130864    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-data\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.130940 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.130895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn7x8\" (UniqueName: \"kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-kube-api-access-kn7x8\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.130940 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.130928    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-certs\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.131029 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.130993    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-socket\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.131064 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.131027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-token\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.231641 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.231601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69bcea83-4e58-4aea-8f5c-e906f25d8485-istiod-ca-cert\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.231641 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.231643    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-data\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.231896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.231664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn7x8\" (UniqueName: \"kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-kube-api-access-kn7x8\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.231896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.231682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-certs\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.231896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.231718    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-socket\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.231896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.231750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-token\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.231896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.231801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-envoy\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.232142 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.231934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-podinfo\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.232142 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.232001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-credential-socket\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.232142 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.232101    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-certs\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.232351 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.232204    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-socket\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.232409 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.232376    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-credential-socket\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.232479 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.232458    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69bcea83-4e58-4aea-8f5c-e906f25d8485-istiod-ca-cert\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.232624 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.232607    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-data\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.234010 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.233990    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-envoy\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.234316 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.234299    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-podinfo\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.240432 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.240376    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn7x8\" (UniqueName: \"kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-kube-api-access-kn7x8\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.240432 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.240392    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-token\") pod \"e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") " pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.297580 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.297543    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:20.439639 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.439610    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"]
Jul 28 20:36:20.440322 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:36:20.440293    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bcea83_4e58_4aea_8f5c_e906f25d8485.slice/crio-40f83565dd4288c8c80a8d2f2d654a3ac105c7e91905454f3fa5915da105163a WatchSource:0}: Error finding container 40f83565dd4288c8c80a8d2f2d654a3ac105c7e91905454f3fa5915da105163a: Status 404 returned error can't find the container with id 40f83565dd4288c8c80a8d2f2d654a3ac105c7e91905454f3fa5915da105163a
Jul 28 20:36:20.442479 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.442452    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:36:20.442534 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.442517    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:36:20.442578 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:20.442547    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:36:21.346865 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:21.346822    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" event={"ID":"69bcea83-4e58-4aea-8f5c-e906f25d8485","Type":"ContainerStarted","Data":"01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263"}
Jul 28 20:36:21.347329 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:21.346889    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" event={"ID":"69bcea83-4e58-4aea-8f5c-e906f25d8485","Type":"ContainerStarted","Data":"40f83565dd4288c8c80a8d2f2d654a3ac105c7e91905454f3fa5915da105163a"}
Jul 28 20:36:21.368518 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:21.368462    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" podStartSLOduration=2.368445896 podStartE2EDuration="2.368445896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:36:21.367817129 +0000 UTC m=+1683.764520287" watchObservedRunningTime="2026-07-28 20:36:21.368445896 +0000 UTC m=+1683.765149052"
Jul 28 20:36:22.298423 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:22.298382    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:22.303610 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:22.303585    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:22.352168 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:22.352134    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:22.353280 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:22.353262    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:23.644669 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.644632    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"]
Jul 28 20:36:23.648189 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.648173    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:23.650901 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.650882    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d20ffe25-dockercfg-jldcz\""
Jul 28 20:36:23.651120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.651102    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d20ffe25\""
Jul 28 20:36:23.661217 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.661168    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"]
Jul 28 20:36:23.763153 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.763104    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/010779af-dea3-4b19-90ef-43f94a454e1e-plugins-config-volume\") pod \"payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt\" (UID: \"010779af-dea3-4b19-90ef-43f94a454e1e\") " pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:23.763356 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.763207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w57rg\" (UniqueName: \"kubernetes.io/projected/010779af-dea3-4b19-90ef-43f94a454e1e-kube-api-access-w57rg\") pod \"payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt\" (UID: \"010779af-dea3-4b19-90ef-43f94a454e1e\") " pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:23.864290 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.864214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w57rg\" (UniqueName: \"kubernetes.io/projected/010779af-dea3-4b19-90ef-43f94a454e1e-kube-api-access-w57rg\") pod \"payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt\" (UID: \"010779af-dea3-4b19-90ef-43f94a454e1e\") " pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:23.864477 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.864332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/010779af-dea3-4b19-90ef-43f94a454e1e-plugins-config-volume\") pod \"payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt\" (UID: \"010779af-dea3-4b19-90ef-43f94a454e1e\") " pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:23.865040 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.865023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/010779af-dea3-4b19-90ef-43f94a454e1e-plugins-config-volume\") pod \"payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt\" (UID: \"010779af-dea3-4b19-90ef-43f94a454e1e\") " pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:23.874019 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.873992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w57rg\" (UniqueName: \"kubernetes.io/projected/010779af-dea3-4b19-90ef-43f94a454e1e-kube-api-access-w57rg\") pod \"payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt\" (UID: \"010779af-dea3-4b19-90ef-43f94a454e1e\") " pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:23.959050 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:23.958959    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:24.097285 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:24.097217    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"]
Jul 28 20:36:24.099560 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:36:24.099535    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010779af_dea3_4b19_90ef_43f94a454e1e.slice/crio-dcbd0430f7be61f9fce23d8052a6a8bfbb96e7347f16e36d917b73181c995c9c WatchSource:0}: Error finding container dcbd0430f7be61f9fce23d8052a6a8bfbb96e7347f16e36d917b73181c995c9c: Status 404 returned error can't find the container with id dcbd0430f7be61f9fce23d8052a6a8bfbb96e7347f16e36d917b73181c995c9c
Jul 28 20:36:24.364580 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:24.364533    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt" event={"ID":"010779af-dea3-4b19-90ef-43f94a454e1e","Type":"ContainerStarted","Data":"1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9"}
Jul 28 20:36:24.364762 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:24.364608    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt" event={"ID":"010779af-dea3-4b19-90ef-43f94a454e1e","Type":"ContainerStarted","Data":"dcbd0430f7be61f9fce23d8052a6a8bfbb96e7347f16e36d917b73181c995c9c"}
Jul 28 20:36:24.386360 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:24.386313    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt" podStartSLOduration=1.386296695 podStartE2EDuration="1.386296695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:36:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:36:24.385520519 +0000 UTC m=+1686.782223676" watchObservedRunningTime="2026-07-28 20:36:24.386296695 +0000 UTC m=+1686.782999851"
Jul 28 20:36:25.369851 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:25.369821    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:36.377100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:36.377057    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:38.291212 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:38.290582    2561 patch_prober.go:28] interesting pod/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": read tcp 10.132.0.2:35584->10.132.0.42:15021: read: connection reset by peer" start-of-body=
Jul 28 20:36:38.291212 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:38.290656    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": read tcp 10.132.0.2:35584->10.132.0.42:15021: read: connection reset by peer"
Jul 28 20:36:38.445808 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:38.445778    2561 generic.go:356] "Generic (PLEG): container finished" podID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerID="01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263" exitCode=0
Jul 28 20:36:38.445978 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:38.445860    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" event={"ID":"69bcea83-4e58-4aea-8f5c-e906f25d8485","Type":"ContainerDied","Data":"01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263"}
Jul 28 20:36:38.446282 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:38.446268    2561 scope.go:117] "RemoveContainer" containerID="01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263"
Jul 28 20:36:38.447321 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:38.447296    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:36:38.447386 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:38.447361    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:36:38.447421 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:38.447394    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:36:39.452816 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:39.452785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" event={"ID":"69bcea83-4e58-4aea-8f5c-e906f25d8485","Type":"ContainerStarted","Data":"82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd"}
Jul 28 20:36:40.298947 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:40.298914    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:40.299353 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:40.299269    2561 patch_prober.go:28] interesting pod/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 28 20:36:40.299532 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:40.299506    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 28 20:36:41.298855 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:41.298810    2561 patch_prober.go:28] interesting pod/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 28 20:36:41.299381 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:41.298891    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 28 20:36:42.298360 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:42.298303    2561 patch_prober.go:28] interesting pod/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 28 20:36:42.298666 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:42.298630    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 28 20:36:43.299500 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:43.299019    2561 patch_prober.go:28] interesting pod/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 28 20:36:43.299500 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:43.299091    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 28 20:36:44.301876 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:44.301845    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:44.302297 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:44.302099    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:44.302814 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:44.302796    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:48.348164 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:48.348130    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"]
Jul 28 20:36:48.351988 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:48.351971    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"
Jul 28 20:36:48.354417 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:48.354394    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 20:36:48.354525 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:48.354421    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:36:48.360560 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:48.360528    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"]
Jul 28 20:36:48.382664 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:48.382630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2decfd45-378f-45c1-b95e-dca8f6213a4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt\" (UID: \"2decfd45-378f-45c1-b95e-dca8f6213a4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"
Jul 28 20:36:48.483908 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:48.483865    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2decfd45-378f-45c1-b95e-dca8f6213a4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt\" (UID: \"2decfd45-378f-45c1-b95e-dca8f6213a4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"
Jul 28 20:36:48.484569 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:48.484549    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2decfd45-378f-45c1-b95e-dca8f6213a4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt\" (UID: \"2decfd45-378f-45c1-b95e-dca8f6213a4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"
Jul 28 20:36:48.663072 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:48.662983    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"
Jul 28 20:36:48.797564 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:48.797535    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"]
Jul 28 20:36:48.800661 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:36:48.800636    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2decfd45_378f_45c1_b95e_dca8f6213a4a.slice/crio-0086cc513b96e5bd4853a71a1994a90faf718a2474dfb44680edea414836efb6 WatchSource:0}: Error finding container 0086cc513b96e5bd4853a71a1994a90faf718a2474dfb44680edea414836efb6: Status 404 returned error can't find the container with id 0086cc513b96e5bd4853a71a1994a90faf718a2474dfb44680edea414836efb6
Jul 28 20:36:49.514109 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:49.514071    2561 generic.go:356] "Generic (PLEG): container finished" podID="2decfd45-378f-45c1-b95e-dca8f6213a4a" containerID="2409f1c8dceaee87582225affeab06656177b0647fe527c2e5021f43fbd63a90" exitCode=0
Jul 28 20:36:49.514522 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:49.514125    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt" event={"ID":"2decfd45-378f-45c1-b95e-dca8f6213a4a","Type":"ContainerDied","Data":"2409f1c8dceaee87582225affeab06656177b0647fe527c2e5021f43fbd63a90"}
Jul 28 20:36:49.514522 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:49.514172    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt" event={"ID":"2decfd45-378f-45c1-b95e-dca8f6213a4a","Type":"ContainerStarted","Data":"0086cc513b96e5bd4853a71a1994a90faf718a2474dfb44680edea414836efb6"}
Jul 28 20:36:50.649341 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:50.649317    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"
Jul 28 20:36:50.701116 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:50.701086    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2decfd45-378f-45c1-b95e-dca8f6213a4a-maas-api-service-ca\") pod \"2decfd45-378f-45c1-b95e-dca8f6213a4a\" (UID: \"2decfd45-378f-45c1-b95e-dca8f6213a4a\") "
Jul 28 20:36:50.701507 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:50.701488    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2decfd45-378f-45c1-b95e-dca8f6213a4a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2decfd45-378f-45c1-b95e-dca8f6213a4a" (UID: "2decfd45-378f-45c1-b95e-dca8f6213a4a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:36:50.802667 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:50.802584    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2decfd45-378f-45c1-b95e-dca8f6213a4a-maas-api-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:51.525041 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:51.525016    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"
Jul 28 20:36:51.525332 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:51.525051    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt" event={"ID":"2decfd45-378f-45c1-b95e-dca8f6213a4a","Type":"ContainerDied","Data":"0086cc513b96e5bd4853a71a1994a90faf718a2474dfb44680edea414836efb6"}
Jul 28 20:36:51.525332 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:51.525098    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0086cc513b96e5bd4853a71a1994a90faf718a2474dfb44680edea414836efb6"
Jul 28 20:36:53.529594 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.529563    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"]
Jul 28 20:36:53.530017 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.529785    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt" podUID="010779af-dea3-4b19-90ef-43f94a454e1e" containerName="payload-processing" containerID="cri-o://1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9" gracePeriod=30
Jul 28 20:36:53.761289 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.761251    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"]
Jul 28 20:36:53.763464 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.763440    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d20ffe25-5ktwt"]
Jul 28 20:36:53.784557 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.784500    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:53.829941 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.829909    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/010779af-dea3-4b19-90ef-43f94a454e1e-plugins-config-volume\") pod \"010779af-dea3-4b19-90ef-43f94a454e1e\" (UID: \"010779af-dea3-4b19-90ef-43f94a454e1e\") "
Jul 28 20:36:53.830125 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.830059    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w57rg\" (UniqueName: \"kubernetes.io/projected/010779af-dea3-4b19-90ef-43f94a454e1e-kube-api-access-w57rg\") pod \"010779af-dea3-4b19-90ef-43f94a454e1e\" (UID: \"010779af-dea3-4b19-90ef-43f94a454e1e\") "
Jul 28 20:36:53.830354 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.830332    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010779af-dea3-4b19-90ef-43f94a454e1e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "010779af-dea3-4b19-90ef-43f94a454e1e" (UID: "010779af-dea3-4b19-90ef-43f94a454e1e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:36:53.832244 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.832205    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010779af-dea3-4b19-90ef-43f94a454e1e-kube-api-access-w57rg" (OuterVolumeSpecName: "kube-api-access-w57rg") pod "010779af-dea3-4b19-90ef-43f94a454e1e" (UID: "010779af-dea3-4b19-90ef-43f94a454e1e"). InnerVolumeSpecName "kube-api-access-w57rg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:36:53.894877 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.894838    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"]
Jul 28 20:36:53.895078 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.895052    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy" containerID="cri-o://82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd" gracePeriod=30
Jul 28 20:36:53.931107 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.931074    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w57rg\" (UniqueName: \"kubernetes.io/projected/010779af-dea3-4b19-90ef-43f94a454e1e-kube-api-access-w57rg\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:53.931107 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:53.931102    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/010779af-dea3-4b19-90ef-43f94a454e1e-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:54.077352 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.077263    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2decfd45-378f-45c1-b95e-dca8f6213a4a" path="/var/lib/kubelet/pods/2decfd45-378f-45c1-b95e-dca8f6213a4a/volumes"
Jul 28 20:36:54.546487 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.546455    2561 generic.go:356] "Generic (PLEG): container finished" podID="010779af-dea3-4b19-90ef-43f94a454e1e" containerID="1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9" exitCode=0
Jul 28 20:36:54.546916 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.546503    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"
Jul 28 20:36:54.546916 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.546539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt" event={"ID":"010779af-dea3-4b19-90ef-43f94a454e1e","Type":"ContainerDied","Data":"1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9"}
Jul 28 20:36:54.546916 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.546593    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt" event={"ID":"010779af-dea3-4b19-90ef-43f94a454e1e","Type":"ContainerDied","Data":"dcbd0430f7be61f9fce23d8052a6a8bfbb96e7347f16e36d917b73181c995c9c"}
Jul 28 20:36:54.546916 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.546621    2561 scope.go:117] "RemoveContainer" containerID="1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9"
Jul 28 20:36:54.558632 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.558609    2561 scope.go:117] "RemoveContainer" containerID="1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9"
Jul 28 20:36:54.559089 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:36:54.558989    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9\": container with ID starting with 1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9 not found: ID does not exist" containerID="1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9"
Jul 28 20:36:54.559089 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.559029    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9"} err="failed to get container status \"1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9\": rpc error: code = NotFound desc = could not find container \"1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9\": container with ID starting with 1e6eda21c80be51af10321e472d3251c923cc2dab6b1c9b5863226f652e45aa9 not found: ID does not exist"
Jul 28 20:36:54.568923 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.568896    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"]
Jul 28 20:36:54.573415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.573390    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d20ffe25-75dc5b77b8-8dmwt"]
Jul 28 20:36:54.961127 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.961053    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"]
Jul 28 20:36:54.961543 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.961525    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010779af-dea3-4b19-90ef-43f94a454e1e" containerName="payload-processing"
Jul 28 20:36:54.961599 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.961548    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="010779af-dea3-4b19-90ef-43f94a454e1e" containerName="payload-processing"
Jul 28 20:36:54.961599 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.961562    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2decfd45-378f-45c1-b95e-dca8f6213a4a" containerName="revoke-keys"
Jul 28 20:36:54.961599 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.961571    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2decfd45-378f-45c1-b95e-dca8f6213a4a" containerName="revoke-keys"
Jul 28 20:36:54.961706 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.961645    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2decfd45-378f-45c1-b95e-dca8f6213a4a" containerName="revoke-keys"
Jul 28 20:36:54.961706 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.961656    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="010779af-dea3-4b19-90ef-43f94a454e1e" containerName="payload-processing"
Jul 28 20:36:54.965998 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.965979    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:54.968536 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.968517    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4b47811d-gw-openshift-default-dockercfg-mwrdw\""
Jul 28 20:36:54.977854 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:54.977835    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"]
Jul 28 20:36:55.042215 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.042184    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-envoy\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.042215 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.042218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feb4281b-a9db-445c-ba65-eea0d1fbe229-istiod-ca-cert\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.042446 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.042253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-credential-socket\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.042446 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.042338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-certs\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.042446 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.042379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-token\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.042446 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.042422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6bzd\" (UniqueName: \"kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-kube-api-access-b6bzd\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.042635 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.042450    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-data\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.042635 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.042478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-podinfo\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.042635 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.042577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-socket\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143277 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143210    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6bzd\" (UniqueName: \"kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-kube-api-access-b6bzd\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143480 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-data\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143480 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-podinfo\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143480 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143459    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-socket\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143529    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-envoy\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feb4281b-a9db-445c-ba65-eea0d1fbe229-istiod-ca-cert\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143606    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-credential-socket\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-certs\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143906 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-token\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143906 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143761    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-data\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.143906 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143800    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-socket\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.144056 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.143959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-credential-socket\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.144056 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.144015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-certs\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.144323 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.144304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feb4281b-a9db-445c-ba65-eea0d1fbe229-istiod-ca-cert\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.145661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.145639    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-envoy\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.145884 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.145865    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-podinfo\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.156375 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.156349    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6bzd\" (UniqueName: \"kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-kube-api-access-b6bzd\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.160131 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.160108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-token\") pod \"e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") " pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.277086 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.277060    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:55.415161 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.415125    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"]
Jul 28 20:36:55.416320 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:36:55.416295    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb4281b_a9db_445c_ba65_eea0d1fbe229.slice/crio-6d4d94580fba35c37f06dfa2ea9fd6c478d1d0b185b8cfed2d5fa6854f682512 WatchSource:0}: Error finding container 6d4d94580fba35c37f06dfa2ea9fd6c478d1d0b185b8cfed2d5fa6854f682512: Status 404 returned error can't find the container with id 6d4d94580fba35c37f06dfa2ea9fd6c478d1d0b185b8cfed2d5fa6854f682512
Jul 28 20:36:55.418396 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.418370    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:36:55.418456 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.418424    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:36:55.418498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.418453    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:36:55.555100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.555001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" event={"ID":"feb4281b-a9db-445c-ba65-eea0d1fbe229","Type":"ContainerStarted","Data":"2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d"}
Jul 28 20:36:55.555100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.555071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" event={"ID":"feb4281b-a9db-445c-ba65-eea0d1fbe229","Type":"ContainerStarted","Data":"6d4d94580fba35c37f06dfa2ea9fd6c478d1d0b185b8cfed2d5fa6854f682512"}
Jul 28 20:36:55.602878 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:55.602802    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" podStartSLOduration=1.602785203 podStartE2EDuration="1.602785203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:36:55.602323944 +0000 UTC m=+1717.999027100" watchObservedRunningTime="2026-07-28 20:36:55.602785203 +0000 UTC m=+1717.999488358"
Jul 28 20:36:56.076797 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:56.076752    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="010779af-dea3-4b19-90ef-43f94a454e1e" path="/var/lib/kubelet/pods/010779af-dea3-4b19-90ef-43f94a454e1e/volumes"
Jul 28 20:36:56.278119 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:56.278080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:56.282955 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:56.282924    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:56.560638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:56.560603    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:56.561550 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:56.561533    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:36:58.007872 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.007843    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"]
Jul 28 20:36:58.011363 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.011345    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:36:58.014525 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.014495    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-4b47811d\""
Jul 28 20:36:58.014761 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.014748    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-4b47811d-dockercfg-br85j\""
Jul 28 20:36:58.023410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.023389    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"]
Jul 28 20:36:58.073348 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.073318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/057c751b-9fe5-4c22-a4c6-31620d9c53ee-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl\" (UID: \"057c751b-9fe5-4c22-a4c6-31620d9c53ee\") " pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:36:58.073348 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.073360    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh5t7\" (UniqueName: \"kubernetes.io/projected/057c751b-9fe5-4c22-a4c6-31620d9c53ee-kube-api-access-dh5t7\") pod \"payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl\" (UID: \"057c751b-9fe5-4c22-a4c6-31620d9c53ee\") " pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:36:58.174506 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.174462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh5t7\" (UniqueName: \"kubernetes.io/projected/057c751b-9fe5-4c22-a4c6-31620d9c53ee-kube-api-access-dh5t7\") pod \"payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl\" (UID: \"057c751b-9fe5-4c22-a4c6-31620d9c53ee\") " pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:36:58.174816 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.174799    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/057c751b-9fe5-4c22-a4c6-31620d9c53ee-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl\" (UID: \"057c751b-9fe5-4c22-a4c6-31620d9c53ee\") " pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:36:58.175451 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.175431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/057c751b-9fe5-4c22-a4c6-31620d9c53ee-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl\" (UID: \"057c751b-9fe5-4c22-a4c6-31620d9c53ee\") " pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:36:58.183090 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.183067    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh5t7\" (UniqueName: \"kubernetes.io/projected/057c751b-9fe5-4c22-a4c6-31620d9c53ee-kube-api-access-dh5t7\") pod \"payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl\" (UID: \"057c751b-9fe5-4c22-a4c6-31620d9c53ee\") " pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:36:58.322927 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.322834    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:36:58.467418 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.467394    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"]
Jul 28 20:36:58.470107 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:36:58.470081    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057c751b_9fe5_4c22_a4c6_31620d9c53ee.slice/crio-f149521888c2d0512e41717fecfdc141128f2628c6d4df0e26c93f17ea328d6c WatchSource:0}: Error finding container f149521888c2d0512e41717fecfdc141128f2628c6d4df0e26c93f17ea328d6c: Status 404 returned error can't find the container with id f149521888c2d0512e41717fecfdc141128f2628c6d4df0e26c93f17ea328d6c
Jul 28 20:36:58.574201 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.574109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl" event={"ID":"057c751b-9fe5-4c22-a4c6-31620d9c53ee","Type":"ContainerStarted","Data":"34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1"}
Jul 28 20:36:58.574201 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.574162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl" event={"ID":"057c751b-9fe5-4c22-a4c6-31620d9c53ee","Type":"ContainerStarted","Data":"f149521888c2d0512e41717fecfdc141128f2628c6d4df0e26c93f17ea328d6c"}
Jul 28 20:36:58.591441 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:58.591392    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl" podStartSLOduration=1.591375481 podStartE2EDuration="1.591375481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:36:58.58914717 +0000 UTC m=+1720.985850326" watchObservedRunningTime="2026-07-28 20:36:58.591375481 +0000 UTC m=+1720.988078636"
Jul 28 20:36:59.162705 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.162679    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:59.284497 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284467    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69bcea83-4e58-4aea-8f5c-e906f25d8485-istiod-ca-cert\") pod \"69bcea83-4e58-4aea-8f5c-e906f25d8485\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") "
Jul 28 20:36:59.284650 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284507    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-envoy\") pod \"69bcea83-4e58-4aea-8f5c-e906f25d8485\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") "
Jul 28 20:36:59.284650 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284530    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-certs\") pod \"69bcea83-4e58-4aea-8f5c-e906f25d8485\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") "
Jul 28 20:36:59.284650 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284577    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-credential-socket\") pod \"69bcea83-4e58-4aea-8f5c-e906f25d8485\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") "
Jul 28 20:36:59.284650 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284593    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-data\") pod \"69bcea83-4e58-4aea-8f5c-e906f25d8485\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") "
Jul 28 20:36:59.284650 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284625    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-token\") pod \"69bcea83-4e58-4aea-8f5c-e906f25d8485\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") "
Jul 28 20:36:59.284921 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284655    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn7x8\" (UniqueName: \"kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-kube-api-access-kn7x8\") pod \"69bcea83-4e58-4aea-8f5c-e906f25d8485\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") "
Jul 28 20:36:59.284921 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284687    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-socket\") pod \"69bcea83-4e58-4aea-8f5c-e906f25d8485\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") "
Jul 28 20:36:59.284921 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284723    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-podinfo\") pod \"69bcea83-4e58-4aea-8f5c-e906f25d8485\" (UID: \"69bcea83-4e58-4aea-8f5c-e906f25d8485\") "
Jul 28 20:36:59.284921 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284893    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "69bcea83-4e58-4aea-8f5c-e906f25d8485" (UID: "69bcea83-4e58-4aea-8f5c-e906f25d8485"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:36:59.285185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284919    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69bcea83-4e58-4aea-8f5c-e906f25d8485-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "69bcea83-4e58-4aea-8f5c-e906f25d8485" (UID: "69bcea83-4e58-4aea-8f5c-e906f25d8485"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:36:59.285185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.284923    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "69bcea83-4e58-4aea-8f5c-e906f25d8485" (UID: "69bcea83-4e58-4aea-8f5c-e906f25d8485"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:36:59.285185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.285119    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "69bcea83-4e58-4aea-8f5c-e906f25d8485" (UID: "69bcea83-4e58-4aea-8f5c-e906f25d8485"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:36:59.285185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.285126    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69bcea83-4e58-4aea-8f5c-e906f25d8485-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:59.285185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.285170    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:59.285185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.285184    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:59.285724 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.285697    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-data" (OuterVolumeSpecName: "istio-data") pod "69bcea83-4e58-4aea-8f5c-e906f25d8485" (UID: "69bcea83-4e58-4aea-8f5c-e906f25d8485"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:36:59.287035 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.287007    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-token" (OuterVolumeSpecName: "istio-token") pod "69bcea83-4e58-4aea-8f5c-e906f25d8485" (UID: "69bcea83-4e58-4aea-8f5c-e906f25d8485"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:36:59.287134 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.287061    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "69bcea83-4e58-4aea-8f5c-e906f25d8485" (UID: "69bcea83-4e58-4aea-8f5c-e906f25d8485"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:36:59.287134 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.287085    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "69bcea83-4e58-4aea-8f5c-e906f25d8485" (UID: "69bcea83-4e58-4aea-8f5c-e906f25d8485"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:36:59.287208 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.287129    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-kube-api-access-kn7x8" (OuterVolumeSpecName: "kube-api-access-kn7x8") pod "69bcea83-4e58-4aea-8f5c-e906f25d8485" (UID: "69bcea83-4e58-4aea-8f5c-e906f25d8485"). InnerVolumeSpecName "kube-api-access-kn7x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:36:59.385981 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.385942    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:59.385981 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.385974    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:59.385981 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.385988    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:59.386228 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.386001    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn7x8\" (UniqueName: \"kubernetes.io/projected/69bcea83-4e58-4aea-8f5c-e906f25d8485-kube-api-access-kn7x8\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:59.386228 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.386015    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69bcea83-4e58-4aea-8f5c-e906f25d8485-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:59.386228 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.386028    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69bcea83-4e58-4aea-8f5c-e906f25d8485-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:36:59.582532 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.582498    2561 generic.go:356] "Generic (PLEG): container finished" podID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerID="82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd" exitCode=0
Jul 28 20:36:59.582699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.582545    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"
Jul 28 20:36:59.582699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.582583    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" event={"ID":"69bcea83-4e58-4aea-8f5c-e906f25d8485","Type":"ContainerDied","Data":"82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd"}
Jul 28 20:36:59.582699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.582638    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl" event={"ID":"69bcea83-4e58-4aea-8f5c-e906f25d8485","Type":"ContainerDied","Data":"40f83565dd4288c8c80a8d2f2d654a3ac105c7e91905454f3fa5915da105163a"}
Jul 28 20:36:59.582699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.582668    2561 scope.go:117] "RemoveContainer" containerID="82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd"
Jul 28 20:36:59.583010 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.582990    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:36:59.592040 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.592021    2561 scope.go:117] "RemoveContainer" containerID="01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263"
Jul 28 20:36:59.600327 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.600309    2561 scope.go:117] "RemoveContainer" containerID="82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd"
Jul 28 20:36:59.600586 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:36:59.600568    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd\": container with ID starting with 82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd not found: ID does not exist" containerID="82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd"
Jul 28 20:36:59.600638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.600595    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd"} err="failed to get container status \"82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd\": rpc error: code = NotFound desc = could not find container \"82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd\": container with ID starting with 82b743695d042bf702afbf5d27725c6ae8415c6f6da039bad02f1dc11c9c30cd not found: ID does not exist"
Jul 28 20:36:59.600638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.600613    2561 scope.go:117] "RemoveContainer" containerID="01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263"
Jul 28 20:36:59.600845 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:36:59.600830    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263\": container with ID starting with 01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263 not found: ID does not exist" containerID="01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263"
Jul 28 20:36:59.600895 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.600850    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263"} err="failed to get container status \"01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263\": rpc error: code = NotFound desc = could not find container \"01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263\": container with ID starting with 01e95b91ee8ec6aba36d4f1ec2a6e38713c06c36535078f90047753075ee0263 not found: ID does not exist"
Jul 28 20:36:59.606010 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.605988    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"]
Jul 28 20:36:59.610025 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:36:59.610002    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d20ffe25-openshift-default-5dffd68db4-t7sbl"]
Jul 28 20:37:00.076999 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:00.076956    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" path="/var/lib/kubelet/pods/69bcea83-4e58-4aea-8f5c-e906f25d8485/volumes"
Jul 28 20:37:10.590668 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:10.590634    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:37:11.562539 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:11.562505    2561 patch_prober.go:28] interesting pod/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 28 20:37:11.562749 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:11.562576    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 28 20:37:11.651168 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:11.651090    2561 generic.go:356] "Generic (PLEG): container finished" podID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerID="2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d" exitCode=0
Jul 28 20:37:11.651168 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:11.651126    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" event={"ID":"feb4281b-a9db-445c-ba65-eea0d1fbe229","Type":"ContainerDied","Data":"2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d"}
Jul 28 20:37:11.651600 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:11.651576    2561 scope.go:117] "RemoveContainer" containerID="2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d"
Jul 28 20:37:11.652565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:11.652536    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:37:11.652658 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:11.652617    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:37:11.652727 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:11.652661    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:37:12.666948 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:12.666908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" event={"ID":"feb4281b-a9db-445c-ba65-eea0d1fbe229","Type":"ContainerStarted","Data":"0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699"}
Jul 28 20:37:13.277902 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:13.277864    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:37:13.278081 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:13.278063    2561 patch_prober.go:28] interesting pod/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 28 20:37:13.278128 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:13.278106    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 28 20:37:14.278376 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:14.278338    2561 patch_prober.go:28] interesting pod/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 28 20:37:14.278785 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:14.278394    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 28 20:37:15.278105 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:15.278065    2561 patch_prober.go:28] interesting pod/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 28 20:37:15.278351 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:15.278130    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 28 20:37:16.277819 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:16.277785    2561 patch_prober.go:28] interesting pod/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 28 20:37:16.278257 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:16.277854    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 28 20:37:17.281763 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:17.281732    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:37:17.282134 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:17.282066    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:37:17.282721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:17.282706    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:37:22.157635 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.157600    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"]
Jul 28 20:37:22.158117 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.157959    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy"
Jul 28 20:37:22.158117 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.157971    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy"
Jul 28 20:37:22.158117 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.157980    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy"
Jul 28 20:37:22.158117 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.157985    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy"
Jul 28 20:37:22.158117 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.158050    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy"
Jul 28 20:37:22.158117 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.158058    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="69bcea83-4e58-4aea-8f5c-e906f25d8485" containerName="istio-proxy"
Jul 28 20:37:22.161024 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.161008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"
Jul 28 20:37:22.164115 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.164093    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 20:37:22.164213 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.164142    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:37:22.171583 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.171557    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"]
Jul 28 20:37:22.292038 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.291994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54233d2b-dda6-4249-8879-7cdaa91385bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp\" (UID: \"54233d2b-dda6-4249-8879-7cdaa91385bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"
Jul 28 20:37:22.393152 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.393116    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54233d2b-dda6-4249-8879-7cdaa91385bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp\" (UID: \"54233d2b-dda6-4249-8879-7cdaa91385bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"
Jul 28 20:37:22.393783 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.393760    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54233d2b-dda6-4249-8879-7cdaa91385bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp\" (UID: \"54233d2b-dda6-4249-8879-7cdaa91385bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"
Jul 28 20:37:22.473057 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.472966    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"
Jul 28 20:37:22.812543 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:22.812514    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"]
Jul 28 20:37:22.813833 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:37:22.813805    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54233d2b_dda6_4249_8879_7cdaa91385bd.slice/crio-1965c653897523497b1d65ae11ba8470502eebf156676a32d20b305ba0870ac0 WatchSource:0}: Error finding container 1965c653897523497b1d65ae11ba8470502eebf156676a32d20b305ba0870ac0: Status 404 returned error can't find the container with id 1965c653897523497b1d65ae11ba8470502eebf156676a32d20b305ba0870ac0
Jul 28 20:37:23.732799 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:23.732759    2561 generic.go:356] "Generic (PLEG): container finished" podID="54233d2b-dda6-4249-8879-7cdaa91385bd" containerID="0adbbf58e39438a748e29415b3bb720d319f440a894d3e38cc7591c736fb0468" exitCode=0
Jul 28 20:37:23.733256 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:23.732842    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp" event={"ID":"54233d2b-dda6-4249-8879-7cdaa91385bd","Type":"ContainerDied","Data":"0adbbf58e39438a748e29415b3bb720d319f440a894d3e38cc7591c736fb0468"}
Jul 28 20:37:23.733256 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:23.732920    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp" event={"ID":"54233d2b-dda6-4249-8879-7cdaa91385bd","Type":"ContainerStarted","Data":"1965c653897523497b1d65ae11ba8470502eebf156676a32d20b305ba0870ac0"}
Jul 28 20:37:24.869174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:24.869150    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"
Jul 28 20:37:25.016058 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:25.016027    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54233d2b-dda6-4249-8879-7cdaa91385bd-maas-api-service-ca\") pod \"54233d2b-dda6-4249-8879-7cdaa91385bd\" (UID: \"54233d2b-dda6-4249-8879-7cdaa91385bd\") "
Jul 28 20:37:25.016427 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:25.016399    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54233d2b-dda6-4249-8879-7cdaa91385bd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54233d2b-dda6-4249-8879-7cdaa91385bd" (UID: "54233d2b-dda6-4249-8879-7cdaa91385bd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:37:25.117456 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:25.117418    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54233d2b-dda6-4249-8879-7cdaa91385bd-maas-api-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:25.743806 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:25.743775    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"
Jul 28 20:37:25.743996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:25.743774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp" event={"ID":"54233d2b-dda6-4249-8879-7cdaa91385bd","Type":"ContainerDied","Data":"1965c653897523497b1d65ae11ba8470502eebf156676a32d20b305ba0870ac0"}
Jul 28 20:37:25.743996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:25.743915    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1965c653897523497b1d65ae11ba8470502eebf156676a32d20b305ba0870ac0"
Jul 28 20:37:28.720254 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:28.720201    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"]
Jul 28 20:37:28.720719 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:28.720456    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl" podUID="057c751b-9fe5-4c22-a4c6-31620d9c53ee" containerName="payload-processing" containerID="cri-o://34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1" gracePeriod=30
Jul 28 20:37:28.861486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:28.861444    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"]
Jul 28 20:37:28.864826 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:28.864797    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4b47811d-8qmlp"]
Jul 28 20:37:28.985192 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:28.985112    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:37:29.011473 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.011438    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"]
Jul 28 20:37:29.011715 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.011689    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy" containerID="cri-o://0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699" gracePeriod=30
Jul 28 20:37:29.154887 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.154845    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/057c751b-9fe5-4c22-a4c6-31620d9c53ee-plugins-config-volume\") pod \"057c751b-9fe5-4c22-a4c6-31620d9c53ee\" (UID: \"057c751b-9fe5-4c22-a4c6-31620d9c53ee\") "
Jul 28 20:37:29.155066 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.154962    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh5t7\" (UniqueName: \"kubernetes.io/projected/057c751b-9fe5-4c22-a4c6-31620d9c53ee-kube-api-access-dh5t7\") pod \"057c751b-9fe5-4c22-a4c6-31620d9c53ee\" (UID: \"057c751b-9fe5-4c22-a4c6-31620d9c53ee\") "
Jul 28 20:37:29.155312 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.155277    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/057c751b-9fe5-4c22-a4c6-31620d9c53ee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "057c751b-9fe5-4c22-a4c6-31620d9c53ee" (UID: "057c751b-9fe5-4c22-a4c6-31620d9c53ee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:37:29.155459 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.155424    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/057c751b-9fe5-4c22-a4c6-31620d9c53ee-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:29.157210 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.157188    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/057c751b-9fe5-4c22-a4c6-31620d9c53ee-kube-api-access-dh5t7" (OuterVolumeSpecName: "kube-api-access-dh5t7") pod "057c751b-9fe5-4c22-a4c6-31620d9c53ee" (UID: "057c751b-9fe5-4c22-a4c6-31620d9c53ee"). InnerVolumeSpecName "kube-api-access-dh5t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:37:29.256541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.256502    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh5t7\" (UniqueName: \"kubernetes.io/projected/057c751b-9fe5-4c22-a4c6-31620d9c53ee-kube-api-access-dh5t7\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:29.771292 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.771226    2561 generic.go:356] "Generic (PLEG): container finished" podID="057c751b-9fe5-4c22-a4c6-31620d9c53ee" containerID="34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1" exitCode=0
Jul 28 20:37:29.771696 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.771312    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"
Jul 28 20:37:29.771696 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.771309    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl" event={"ID":"057c751b-9fe5-4c22-a4c6-31620d9c53ee","Type":"ContainerDied","Data":"34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1"}
Jul 28 20:37:29.771696 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.771433    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl" event={"ID":"057c751b-9fe5-4c22-a4c6-31620d9c53ee","Type":"ContainerDied","Data":"f149521888c2d0512e41717fecfdc141128f2628c6d4df0e26c93f17ea328d6c"}
Jul 28 20:37:29.771696 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.771461    2561 scope.go:117] "RemoveContainer" containerID="34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1"
Jul 28 20:37:29.781719 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.781696    2561 scope.go:117] "RemoveContainer" containerID="34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1"
Jul 28 20:37:29.782018 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:37:29.781997    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1\": container with ID starting with 34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1 not found: ID does not exist" containerID="34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1"
Jul 28 20:37:29.782098 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.782030    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1"} err="failed to get container status \"34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1\": rpc error: code = NotFound desc = could not find container \"34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1\": container with ID starting with 34182591e6b43908091d631fcd2654f74f831568f912d19cc503efdf42ddf3c1 not found: ID does not exist"
Jul 28 20:37:29.811883 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.811851    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"]
Jul 28 20:37:29.813838 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.813817    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"]
Jul 28 20:37:29.814143 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.814132    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54233d2b-dda6-4249-8879-7cdaa91385bd" containerName="revoke-keys"
Jul 28 20:37:29.814186 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.814145    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54233d2b-dda6-4249-8879-7cdaa91385bd" containerName="revoke-keys"
Jul 28 20:37:29.814186 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.814156    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="057c751b-9fe5-4c22-a4c6-31620d9c53ee" containerName="payload-processing"
Jul 28 20:37:29.814186 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.814161    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="057c751b-9fe5-4c22-a4c6-31620d9c53ee" containerName="payload-processing"
Jul 28 20:37:29.814298 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.814228    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54233d2b-dda6-4249-8879-7cdaa91385bd" containerName="revoke-keys"
Jul 28 20:37:29.814298 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.814255    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="057c751b-9fe5-4c22-a4c6-31620d9c53ee" containerName="payload-processing"
Jul 28 20:37:29.818820 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.818799    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:29.820926 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.820898    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4b47811d-8598c66d6f-9w9tl"]
Jul 28 20:37:29.821034 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.820963    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ed417440-openshift-default-dockercfg-t6v6p\""
Jul 28 20:37:29.836517 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.836488    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"]
Jul 28 20:37:29.963067 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.963030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-envoy\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:29.963067 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.963069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-certs\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:29.963346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.963095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-podinfo\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:29.963346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.963147    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-token\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:29.963346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.963167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istiod-ca-cert\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:29.963346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.963186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-socket\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:29.963346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.963281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-data\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:29.963346 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.963331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-245zm\" (UniqueName: \"kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-kube-api-access-245zm\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:29.963594 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:29.963405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-credential-socket\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.064592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.064482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-credential-socket\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.064592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.064543    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-envoy\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.064592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.064564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-certs\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.064592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.064587    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-podinfo\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.064944 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.064617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-token\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.064944 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.064670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istiod-ca-cert\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.064944 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.064719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-socket\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.064944 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.064755    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-data\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.064944 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.064794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-245zm\" (UniqueName: \"kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-kube-api-access-245zm\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.065175 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.064942    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-credential-socket\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.065175 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.065001    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-certs\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.065175 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.065072    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-data\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.065175 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.065137    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-socket\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.065395 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.065376    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istiod-ca-cert\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.066900 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.066880    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-envoy\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.067148 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.067132    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-podinfo\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.074159 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.074134    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-245zm\" (UniqueName: \"kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-kube-api-access-245zm\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.074317 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.074137    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-token\") pod \"e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") " pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.078000 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.077971    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="057c751b-9fe5-4c22-a4c6-31620d9c53ee" path="/var/lib/kubelet/pods/057c751b-9fe5-4c22-a4c6-31620d9c53ee/volumes"
Jul 28 20:37:30.078439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.078422    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54233d2b-dda6-4249-8879-7cdaa91385bd" path="/var/lib/kubelet/pods/54233d2b-dda6-4249-8879-7cdaa91385bd/volumes"
Jul 28 20:37:30.128810 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.128775    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:30.266127 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.266099    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"]
Jul 28 20:37:30.267951 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:37:30.267919    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4d6748_a0b9_4c78_914f_1805a3a18a5c.slice/crio-b99076dfcd88f319ff9c6bd7a210589ca10c2282fd35bf9a4b410d342e871421 WatchSource:0}: Error finding container b99076dfcd88f319ff9c6bd7a210589ca10c2282fd35bf9a4b410d342e871421: Status 404 returned error can't find the container with id b99076dfcd88f319ff9c6bd7a210589ca10c2282fd35bf9a4b410d342e871421
Jul 28 20:37:30.269895 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.269866    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:37:30.269975 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.269927    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:37:30.269975 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.269955    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:37:30.779248 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.779202    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" event={"ID":"fe4d6748-a0b9-4c78-914f-1805a3a18a5c","Type":"ContainerStarted","Data":"5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462"}
Jul 28 20:37:30.779628 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.779278    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" event={"ID":"fe4d6748-a0b9-4c78-914f-1805a3a18a5c","Type":"ContainerStarted","Data":"b99076dfcd88f319ff9c6bd7a210589ca10c2282fd35bf9a4b410d342e871421"}
Jul 28 20:37:30.807421 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:30.807369    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" podStartSLOduration=1.8073511770000001 podStartE2EDuration="1.807351177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:37:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:37:30.804996321 +0000 UTC m=+1753.201699478" watchObservedRunningTime="2026-07-28 20:37:30.807351177 +0000 UTC m=+1753.204054332"
Jul 28 20:37:31.130000 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:31.129910    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:31.134899 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:31.134871    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:31.785177 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:31.785147    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:31.786302 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:31.786285    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:32.284603 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:32.284561    2561 patch_prober.go:28] interesting pod/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 28 20:37:32.284773 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:32.284621    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:37:33.233354 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.233319    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"]
Jul 28 20:37:33.236868 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.236852    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:37:33.240527 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.240502    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ed417440\""
Jul 28 20:37:33.240609 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.240574    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ed417440-dockercfg-2sm2l\""
Jul 28 20:37:33.253646 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.253616    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"]
Jul 28 20:37:33.392620 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.392583    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2q9k\" (UniqueName: \"kubernetes.io/projected/f5a6cb64-dc35-4314-8ae6-ca2256817223-kube-api-access-h2q9k\") pod \"payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h\" (UID: \"f5a6cb64-dc35-4314-8ae6-ca2256817223\") " pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:37:33.392794 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.392634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5a6cb64-dc35-4314-8ae6-ca2256817223-plugins-config-volume\") pod \"payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h\" (UID: \"f5a6cb64-dc35-4314-8ae6-ca2256817223\") " pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:37:33.494048 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.493946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2q9k\" (UniqueName: \"kubernetes.io/projected/f5a6cb64-dc35-4314-8ae6-ca2256817223-kube-api-access-h2q9k\") pod \"payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h\" (UID: \"f5a6cb64-dc35-4314-8ae6-ca2256817223\") " pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:37:33.494048 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.494003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5a6cb64-dc35-4314-8ae6-ca2256817223-plugins-config-volume\") pod \"payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h\" (UID: \"f5a6cb64-dc35-4314-8ae6-ca2256817223\") " pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:37:33.494733 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.494715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5a6cb64-dc35-4314-8ae6-ca2256817223-plugins-config-volume\") pod \"payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h\" (UID: \"f5a6cb64-dc35-4314-8ae6-ca2256817223\") " pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:37:33.502770 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.502743    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2q9k\" (UniqueName: \"kubernetes.io/projected/f5a6cb64-dc35-4314-8ae6-ca2256817223-kube-api-access-h2q9k\") pod \"payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h\" (UID: \"f5a6cb64-dc35-4314-8ae6-ca2256817223\") " pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:37:33.550289 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.550257    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:37:33.686777 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.686752    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"]
Jul 28 20:37:33.688610 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:37:33.688585    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a6cb64_dc35_4314_8ae6_ca2256817223.slice/crio-46a2fccc183a36b7cdba60faddddce4ff723aafbd6d2973c2bd09f41b378e77f WatchSource:0}: Error finding container 46a2fccc183a36b7cdba60faddddce4ff723aafbd6d2973c2bd09f41b378e77f: Status 404 returned error can't find the container with id 46a2fccc183a36b7cdba60faddddce4ff723aafbd6d2973c2bd09f41b378e77f
Jul 28 20:37:33.798679 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.798641    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h" event={"ID":"f5a6cb64-dc35-4314-8ae6-ca2256817223","Type":"ContainerStarted","Data":"f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae"}
Jul 28 20:37:33.798877 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.798706    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h" event={"ID":"f5a6cb64-dc35-4314-8ae6-ca2256817223","Type":"ContainerStarted","Data":"46a2fccc183a36b7cdba60faddddce4ff723aafbd6d2973c2bd09f41b378e77f"}
Jul 28 20:37:33.815654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:33.815596    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h" podStartSLOduration=0.815572633 podStartE2EDuration="815.572633ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:37:33.814618083 +0000 UTC m=+1756.211321240" watchObservedRunningTime="2026-07-28 20:37:33.815572633 +0000 UTC m=+1756.212275793"
Jul 28 20:37:34.248536 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.248508    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:37:34.401400 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401311    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-token\") pod \"feb4281b-a9db-445c-ba65-eea0d1fbe229\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") "
Jul 28 20:37:34.401400 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401395    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-envoy\") pod \"feb4281b-a9db-445c-ba65-eea0d1fbe229\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") "
Jul 28 20:37:34.401638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401441    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-socket\") pod \"feb4281b-a9db-445c-ba65-eea0d1fbe229\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") "
Jul 28 20:37:34.401638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401484    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feb4281b-a9db-445c-ba65-eea0d1fbe229-istiod-ca-cert\") pod \"feb4281b-a9db-445c-ba65-eea0d1fbe229\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") "
Jul 28 20:37:34.401638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401507    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-certs\") pod \"feb4281b-a9db-445c-ba65-eea0d1fbe229\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") "
Jul 28 20:37:34.401638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401542    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-podinfo\") pod \"feb4281b-a9db-445c-ba65-eea0d1fbe229\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") "
Jul 28 20:37:34.401638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401569    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6bzd\" (UniqueName: \"kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-kube-api-access-b6bzd\") pod \"feb4281b-a9db-445c-ba65-eea0d1fbe229\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") "
Jul 28 20:37:34.401883 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401688    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-data\") pod \"feb4281b-a9db-445c-ba65-eea0d1fbe229\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") "
Jul 28 20:37:34.401883 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401804    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "feb4281b-a9db-445c-ba65-eea0d1fbe229" (UID: "feb4281b-a9db-445c-ba65-eea0d1fbe229"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:37:34.401883 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401848    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-credential-socket\") pod \"feb4281b-a9db-445c-ba65-eea0d1fbe229\" (UID: \"feb4281b-a9db-445c-ba65-eea0d1fbe229\") "
Jul 28 20:37:34.402031 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.401926    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "feb4281b-a9db-445c-ba65-eea0d1fbe229" (UID: "feb4281b-a9db-445c-ba65-eea0d1fbe229"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:37:34.402160 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.402118    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "feb4281b-a9db-445c-ba65-eea0d1fbe229" (UID: "feb4281b-a9db-445c-ba65-eea0d1fbe229"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:37:34.402404 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.402375    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb4281b-a9db-445c-ba65-eea0d1fbe229-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "feb4281b-a9db-445c-ba65-eea0d1fbe229" (UID: "feb4281b-a9db-445c-ba65-eea0d1fbe229"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:37:34.402531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.402469    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:34.402531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.402492    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:34.402531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.402507    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:34.402731 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.402706    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-data" (OuterVolumeSpecName: "istio-data") pod "feb4281b-a9db-445c-ba65-eea0d1fbe229" (UID: "feb4281b-a9db-445c-ba65-eea0d1fbe229"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:37:34.403930 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.403913    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-token" (OuterVolumeSpecName: "istio-token") pod "feb4281b-a9db-445c-ba65-eea0d1fbe229" (UID: "feb4281b-a9db-445c-ba65-eea0d1fbe229"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:37:34.404048 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.403935    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "feb4281b-a9db-445c-ba65-eea0d1fbe229" (UID: "feb4281b-a9db-445c-ba65-eea0d1fbe229"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:37:34.404303 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.404286    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "feb4281b-a9db-445c-ba65-eea0d1fbe229" (UID: "feb4281b-a9db-445c-ba65-eea0d1fbe229"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:37:34.404371 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.404357    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-kube-api-access-b6bzd" (OuterVolumeSpecName: "kube-api-access-b6bzd") pod "feb4281b-a9db-445c-ba65-eea0d1fbe229" (UID: "feb4281b-a9db-445c-ba65-eea0d1fbe229"). InnerVolumeSpecName "kube-api-access-b6bzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:37:34.503401 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.503369    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feb4281b-a9db-445c-ba65-eea0d1fbe229-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:34.503401 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.503397    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:34.503401 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.503406    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6bzd\" (UniqueName: \"kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-kube-api-access-b6bzd\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:34.503625 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.503417    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:34.503625 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.503425    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:34.503625 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.503433    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feb4281b-a9db-445c-ba65-eea0d1fbe229-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:37:34.806144 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.806108    2561 generic.go:356] "Generic (PLEG): container finished" podID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerID="0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699" exitCode=0
Jul 28 20:37:34.806365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.806182    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"
Jul 28 20:37:34.806365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.806191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" event={"ID":"feb4281b-a9db-445c-ba65-eea0d1fbe229","Type":"ContainerDied","Data":"0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699"}
Jul 28 20:37:34.806365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.806271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn" event={"ID":"feb4281b-a9db-445c-ba65-eea0d1fbe229","Type":"ContainerDied","Data":"6d4d94580fba35c37f06dfa2ea9fd6c478d1d0b185b8cfed2d5fa6854f682512"}
Jul 28 20:37:34.806365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.806307    2561 scope.go:117] "RemoveContainer" containerID="0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699"
Jul 28 20:37:34.806611 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.806590    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:37:34.816121 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.816105    2561 scope.go:117] "RemoveContainer" containerID="2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d"
Jul 28 20:37:34.824772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.824753    2561 scope.go:117] "RemoveContainer" containerID="0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699"
Jul 28 20:37:34.825051 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:37:34.825034    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699\": container with ID starting with 0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699 not found: ID does not exist" containerID="0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699"
Jul 28 20:37:34.825096 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.825059    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699"} err="failed to get container status \"0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699\": rpc error: code = NotFound desc = could not find container \"0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699\": container with ID starting with 0f95e0863ce8ce8af18ed57b20403175fa42019725b469b7881ed8c7649e1699 not found: ID does not exist"
Jul 28 20:37:34.825096 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.825076    2561 scope.go:117] "RemoveContainer" containerID="2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d"
Jul 28 20:37:34.825378 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:37:34.825361    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d\": container with ID starting with 2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d not found: ID does not exist" containerID="2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d"
Jul 28 20:37:34.825417 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.825386    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d"} err="failed to get container status \"2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d\": rpc error: code = NotFound desc = could not find container \"2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d\": container with ID starting with 2a2f31d9d681053f276a860b87d224511f2e6c80aa054f8589a4395489cc178d not found: ID does not exist"
Jul 28 20:37:34.829470 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.829447    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"]
Jul 28 20:37:34.839155 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:34.839129    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4b47811d-gw-openshift-default-55778c94d4-rdnvn"]
Jul 28 20:37:36.077905 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:36.077869    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" path="/var/lib/kubelet/pods/feb4281b-a9db-445c-ba65-eea0d1fbe229/volumes"
Jul 28 20:37:45.815295 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:45.815261    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:37:46.786893 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:46.786860    2561 patch_prober.go:28] interesting pod/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 28 20:37:46.787077 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:46.786924    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 28 20:37:46.876099 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:46.876065    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerID="5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462" exitCode=0
Jul 28 20:37:46.876526 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:46.876145    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" event={"ID":"fe4d6748-a0b9-4c78-914f-1805a3a18a5c","Type":"ContainerDied","Data":"5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462"}
Jul 28 20:37:46.876593 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:46.876580    2561 scope.go:117] "RemoveContainer" containerID="5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462"
Jul 28 20:37:46.877531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:46.877501    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:37:46.877600 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:46.877570    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:37:46.877641 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:46.877618    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:37:47.883562 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:47.883530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" event={"ID":"fe4d6748-a0b9-4c78-914f-1805a3a18a5c","Type":"ContainerStarted","Data":"d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6"}
Jul 28 20:37:48.129651 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:48.129616    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:48.129902 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:48.129884    2561 patch_prober.go:28] interesting pod/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 28 20:37:48.129952 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:48.129925    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 28 20:37:49.129280 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:49.129247    2561 patch_prober.go:28] interesting pod/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 28 20:37:49.129676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:49.129298    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 28 20:37:50.129475 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:50.129439    2561 patch_prober.go:28] interesting pod/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 28 20:37:50.129875 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:50.129497    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 28 20:37:51.129310 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:51.129271    2561 patch_prober.go:28] interesting pod/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 28 20:37:51.129498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:51.129335    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 28 20:37:52.133426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:52.133390    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:52.133798 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:52.133776    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:52.134571 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:52.134555    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:37:58.024156 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.024119    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"]
Jul 28 20:37:58.024657 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.024517    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy"
Jul 28 20:37:58.024657 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.024529    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy"
Jul 28 20:37:58.024657 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.024602    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy"
Jul 28 20:37:58.024657 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.024610    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy"
Jul 28 20:37:58.027612 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.027596    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"
Jul 28 20:37:58.030035 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.030006    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:37:58.030035 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.030020    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 20:37:58.035559 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.035538    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"]
Jul 28 20:37:58.108321 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.108277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/993b0d56-36b3-4db3-8796-3f1745c1a2e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ed417440-sp6vr\" (UID: \"993b0d56-36b3-4db3-8796-3f1745c1a2e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"
Jul 28 20:37:58.209219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.209180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/993b0d56-36b3-4db3-8796-3f1745c1a2e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ed417440-sp6vr\" (UID: \"993b0d56-36b3-4db3-8796-3f1745c1a2e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"
Jul 28 20:37:58.209801 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.209781    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/993b0d56-36b3-4db3-8796-3f1745c1a2e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ed417440-sp6vr\" (UID: \"993b0d56-36b3-4db3-8796-3f1745c1a2e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"
Jul 28 20:37:58.339445 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.339356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"
Jul 28 20:37:58.474550 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.474520    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"]
Jul 28 20:37:58.475694 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:37:58.475666    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993b0d56_36b3_4db3_8796_3f1745c1a2e4.slice/crio-30552c9b369928054f8118a2134bf62d56e2f5028c4bd7335b76077a7a9e4a28 WatchSource:0}: Error finding container 30552c9b369928054f8118a2134bf62d56e2f5028c4bd7335b76077a7a9e4a28: Status 404 returned error can't find the container with id 30552c9b369928054f8118a2134bf62d56e2f5028c4bd7335b76077a7a9e4a28
Jul 28 20:37:58.957661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.957562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr" event={"ID":"993b0d56-36b3-4db3-8796-3f1745c1a2e4","Type":"ContainerStarted","Data":"d3b8c3f8f20658ec16139077693781710f88b440a2a01764115afa088450dd2b"}
Jul 28 20:37:58.957661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.957616    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr" event={"ID":"993b0d56-36b3-4db3-8796-3f1745c1a2e4","Type":"ContainerStarted","Data":"30552c9b369928054f8118a2134bf62d56e2f5028c4bd7335b76077a7a9e4a28"}
Jul 28 20:37:58.974327 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:58.974278    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr" podStartSLOduration=0.974260944 podStartE2EDuration="974.260944ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:37:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:37:58.973451336 +0000 UTC m=+1781.370154492" watchObservedRunningTime="2026-07-28 20:37:58.974260944 +0000 UTC m=+1781.370964100"
Jul 28 20:37:59.964135 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:59.964103    2561 generic.go:356] "Generic (PLEG): container finished" podID="993b0d56-36b3-4db3-8796-3f1745c1a2e4" containerID="d3b8c3f8f20658ec16139077693781710f88b440a2a01764115afa088450dd2b" exitCode=0
Jul 28 20:37:59.964541 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:37:59.964157    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr" event={"ID":"993b0d56-36b3-4db3-8796-3f1745c1a2e4","Type":"ContainerDied","Data":"d3b8c3f8f20658ec16139077693781710f88b440a2a01764115afa088450dd2b"}
Jul 28 20:38:01.100539 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:01.100514    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"
Jul 28 20:38:01.235622 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:01.235539    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/993b0d56-36b3-4db3-8796-3f1745c1a2e4-maas-api-service-ca\") pod \"993b0d56-36b3-4db3-8796-3f1745c1a2e4\" (UID: \"993b0d56-36b3-4db3-8796-3f1745c1a2e4\") "
Jul 28 20:38:01.235906 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:01.235882    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/993b0d56-36b3-4db3-8796-3f1745c1a2e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "993b0d56-36b3-4db3-8796-3f1745c1a2e4" (UID: "993b0d56-36b3-4db3-8796-3f1745c1a2e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:38:01.336957 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:01.336919    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/993b0d56-36b3-4db3-8796-3f1745c1a2e4-maas-api-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:01.975894 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:01.975857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr" event={"ID":"993b0d56-36b3-4db3-8796-3f1745c1a2e4","Type":"ContainerDied","Data":"30552c9b369928054f8118a2134bf62d56e2f5028c4bd7335b76077a7a9e4a28"}
Jul 28 20:38:01.975894 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:01.975893    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"
Jul 28 20:38:01.976094 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:01.975915    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30552c9b369928054f8118a2134bf62d56e2f5028c4bd7335b76077a7a9e4a28"
Jul 28 20:38:03.048824 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.048788    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"]
Jul 28 20:38:03.049341 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.049008    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h" podUID="f5a6cb64-dc35-4314-8ae6-ca2256817223" containerName="payload-processing" containerID="cri-o://f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae" gracePeriod=30
Jul 28 20:38:03.206893 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.206860    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"]
Jul 28 20:38:03.210902 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.210867    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ed417440-sp6vr"]
Jul 28 20:38:03.334661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.334636    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:38:03.456458 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.456420    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2q9k\" (UniqueName: \"kubernetes.io/projected/f5a6cb64-dc35-4314-8ae6-ca2256817223-kube-api-access-h2q9k\") pod \"f5a6cb64-dc35-4314-8ae6-ca2256817223\" (UID: \"f5a6cb64-dc35-4314-8ae6-ca2256817223\") "
Jul 28 20:38:03.456639 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.456534    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5a6cb64-dc35-4314-8ae6-ca2256817223-plugins-config-volume\") pod \"f5a6cb64-dc35-4314-8ae6-ca2256817223\" (UID: \"f5a6cb64-dc35-4314-8ae6-ca2256817223\") "
Jul 28 20:38:03.456918 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.456886    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5a6cb64-dc35-4314-8ae6-ca2256817223-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5a6cb64-dc35-4314-8ae6-ca2256817223" (UID: "f5a6cb64-dc35-4314-8ae6-ca2256817223"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:38:03.458670 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.458650    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5a6cb64-dc35-4314-8ae6-ca2256817223-kube-api-access-h2q9k" (OuterVolumeSpecName: "kube-api-access-h2q9k") pod "f5a6cb64-dc35-4314-8ae6-ca2256817223" (UID: "f5a6cb64-dc35-4314-8ae6-ca2256817223"). InnerVolumeSpecName "kube-api-access-h2q9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:38:03.557317 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.557271    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5a6cb64-dc35-4314-8ae6-ca2256817223-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:03.557317 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.557314    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2q9k\" (UniqueName: \"kubernetes.io/projected/f5a6cb64-dc35-4314-8ae6-ca2256817223-kube-api-access-h2q9k\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:03.989000 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.988961    2561 generic.go:356] "Generic (PLEG): container finished" podID="f5a6cb64-dc35-4314-8ae6-ca2256817223" containerID="f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae" exitCode=0
Jul 28 20:38:03.989174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.989011    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"
Jul 28 20:38:03.989174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.989049    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h" event={"ID":"f5a6cb64-dc35-4314-8ae6-ca2256817223","Type":"ContainerDied","Data":"f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae"}
Jul 28 20:38:03.989174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.989105    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h" event={"ID":"f5a6cb64-dc35-4314-8ae6-ca2256817223","Type":"ContainerDied","Data":"46a2fccc183a36b7cdba60faddddce4ff723aafbd6d2973c2bd09f41b378e77f"}
Jul 28 20:38:03.989174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.989127    2561 scope.go:117] "RemoveContainer" containerID="f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae"
Jul 28 20:38:03.998429 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.998407    2561 scope.go:117] "RemoveContainer" containerID="f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae"
Jul 28 20:38:03.998710 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:38:03.998690    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae\": container with ID starting with f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae not found: ID does not exist" containerID="f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae"
Jul 28 20:38:03.998765 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:03.998719    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae"} err="failed to get container status \"f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae\": rpc error: code = NotFound desc = could not find container \"f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae\": container with ID starting with f65e13305f08a50efeabc73ec5ced2ee2ce5ab3b3b55d9c03c7ed5bf0ba34fae not found: ID does not exist"
Jul 28 20:38:04.014548 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:04.014520    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"]
Jul 28 20:38:04.019651 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:04.019626    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ed417440-65584dddf8-gqz2h"]
Jul 28 20:38:04.077080 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:04.077044    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="993b0d56-36b3-4db3-8796-3f1745c1a2e4" path="/var/lib/kubelet/pods/993b0d56-36b3-4db3-8796-3f1745c1a2e4/volumes"
Jul 28 20:38:04.077476 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:04.077412    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5a6cb64-dc35-4314-8ae6-ca2256817223" path="/var/lib/kubelet/pods/f5a6cb64-dc35-4314-8ae6-ca2256817223/volumes"
Jul 28 20:38:04.389476 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:04.389443    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"]
Jul 28 20:38:04.389712 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:04.389688    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy" containerID="cri-o://d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6" gracePeriod=30
Jul 28 20:38:05.184088 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.184056    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"]
Jul 28 20:38:05.184592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.184573    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5a6cb64-dc35-4314-8ae6-ca2256817223" containerName="payload-processing"
Jul 28 20:38:05.184676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.184595    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a6cb64-dc35-4314-8ae6-ca2256817223" containerName="payload-processing"
Jul 28 20:38:05.184676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.184621    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="993b0d56-36b3-4db3-8796-3f1745c1a2e4" containerName="revoke-keys"
Jul 28 20:38:05.184676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.184630    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="993b0d56-36b3-4db3-8796-3f1745c1a2e4" containerName="revoke-keys"
Jul 28 20:38:05.184676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.184645    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy"
Jul 28 20:38:05.184676 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.184654    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb4281b-a9db-445c-ba65-eea0d1fbe229" containerName="istio-proxy"
Jul 28 20:38:05.184914 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.184760    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5a6cb64-dc35-4314-8ae6-ca2256817223" containerName="payload-processing"
Jul 28 20:38:05.184914 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.184779    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="993b0d56-36b3-4db3-8796-3f1745c1a2e4" containerName="revoke-keys"
Jul 28 20:38:05.189172 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.189147    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.191467 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.191446    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0fbea363-openshift-default-dockercfg-5msxv\""
Jul 28 20:38:05.204527 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.204498    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"]
Jul 28 20:38:05.272021 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.271985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-envoy\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.272192 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.272031    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-socket\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.272192 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.272093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-istio-token\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.272192 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.272140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lmfr\" (UniqueName: \"kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-kube-api-access-2lmfr\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.272192 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.272187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-certs\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.272369 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.272222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05c11e42-dfd0-402c-ba1d-733907edd286-istio-podinfo\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.272369 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.272278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05c11e42-dfd0-402c-ba1d-733907edd286-istiod-ca-cert\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.272369 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.272306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-data\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.272369 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.272330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-credential-socket\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.373328 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373293    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05c11e42-dfd0-402c-ba1d-733907edd286-istio-podinfo\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.373328 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05c11e42-dfd0-402c-ba1d-733907edd286-istiod-ca-cert\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.373566 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373365    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-data\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.373566 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-credential-socket\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.373566 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-envoy\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.373566 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373480    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-socket\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.373566 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-istio-token\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.373566 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lmfr\" (UniqueName: \"kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-kube-api-access-2lmfr\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.373845 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-certs\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.373950 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-certs\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.374023 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.373981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-credential-socket\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.374023 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.374000    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-socket\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.374126 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.374084    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05c11e42-dfd0-402c-ba1d-733907edd286-istiod-ca-cert\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.374201 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.374186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-data\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.375714 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.375696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-envoy\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.375948 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.375931    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05c11e42-dfd0-402c-ba1d-733907edd286-istio-podinfo\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.381762 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.381741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-istio-token\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.381953 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.381937    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lmfr\" (UniqueName: \"kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-kube-api-access-2lmfr\") pod \"e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") " pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.499648 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.499552    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:05.641752 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.641726    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"]
Jul 28 20:38:05.643711 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:38:05.643680    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c11e42_dfd0_402c_ba1d_733907edd286.slice/crio-42593d2755c165c5e96dcfba1f5d636311be84c0447f7722851209e2d0ec8c62 WatchSource:0}: Error finding container 42593d2755c165c5e96dcfba1f5d636311be84c0447f7722851209e2d0ec8c62: Status 404 returned error can't find the container with id 42593d2755c165c5e96dcfba1f5d636311be84c0447f7722851209e2d0ec8c62
Jul 28 20:38:05.646351 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.646311    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:38:05.646418 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.646402    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:38:05.646461 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:05.646445    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:38:06.006850 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:06.006810    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" event={"ID":"05c11e42-dfd0-402c-ba1d-733907edd286","Type":"ContainerStarted","Data":"661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa"}
Jul 28 20:38:06.007043 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:06.006900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" event={"ID":"05c11e42-dfd0-402c-ba1d-733907edd286","Type":"ContainerStarted","Data":"42593d2755c165c5e96dcfba1f5d636311be84c0447f7722851209e2d0ec8c62"}
Jul 28 20:38:06.030498 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:06.030441    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" podStartSLOduration=1.030424482 podStartE2EDuration="1.030424482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:38:06.027159684 +0000 UTC m=+1788.423862868" watchObservedRunningTime="2026-07-28 20:38:06.030424482 +0000 UTC m=+1788.427127704"
Jul 28 20:38:06.500430 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:06.500401    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:06.505292 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:06.505267    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:07.012548 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:07.012516    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:07.013621 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:07.013603    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:07.135815 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:07.135779    2561 patch_prober.go:28] interesting pod/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:38:07.135970 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:07.135834    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:38:08.461338 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.461303    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"]
Jul 28 20:38:08.464897 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.464881    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:08.467400 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.467379    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0fbea363\""
Jul 28 20:38:08.467671 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.467656    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0fbea363-dockercfg-q7nlv\""
Jul 28 20:38:08.477045 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.477024    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"]
Jul 28 20:38:08.606376 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.606347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmtzc\" (UniqueName: \"kubernetes.io/projected/24d29406-c861-478c-964c-9d1a832cf6bc-kube-api-access-gmtzc\") pod \"payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw\" (UID: \"24d29406-c861-478c-964c-9d1a832cf6bc\") " pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:08.606568 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.606387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24d29406-c861-478c-964c-9d1a832cf6bc-plugins-config-volume\") pod \"payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw\" (UID: \"24d29406-c861-478c-964c-9d1a832cf6bc\") " pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:08.706955 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.706912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtzc\" (UniqueName: \"kubernetes.io/projected/24d29406-c861-478c-964c-9d1a832cf6bc-kube-api-access-gmtzc\") pod \"payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw\" (UID: \"24d29406-c861-478c-964c-9d1a832cf6bc\") " pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:08.706955 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.706960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24d29406-c861-478c-964c-9d1a832cf6bc-plugins-config-volume\") pod \"payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw\" (UID: \"24d29406-c861-478c-964c-9d1a832cf6bc\") " pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:08.707674 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.707651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24d29406-c861-478c-964c-9d1a832cf6bc-plugins-config-volume\") pod \"payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw\" (UID: \"24d29406-c861-478c-964c-9d1a832cf6bc\") " pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:08.716580 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.716511    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmtzc\" (UniqueName: \"kubernetes.io/projected/24d29406-c861-478c-964c-9d1a832cf6bc-kube-api-access-gmtzc\") pod \"payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw\" (UID: \"24d29406-c861-478c-964c-9d1a832cf6bc\") " pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:08.775311 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.775279    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:08.927986 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:08.927959    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"]
Jul 28 20:38:08.930046 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:38:08.930019    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d29406_c861_478c_964c_9d1a832cf6bc.slice/crio-87a4ac7a83427112aa0f30b030c4d03e3e83d618338afa37faf2dfad6b2a1946 WatchSource:0}: Error finding container 87a4ac7a83427112aa0f30b030c4d03e3e83d618338afa37faf2dfad6b2a1946: Status 404 returned error can't find the container with id 87a4ac7a83427112aa0f30b030c4d03e3e83d618338afa37faf2dfad6b2a1946
Jul 28 20:38:09.026261 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.026207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw" event={"ID":"24d29406-c861-478c-964c-9d1a832cf6bc","Type":"ContainerStarted","Data":"67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae"}
Jul 28 20:38:09.026412 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.026311    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw" event={"ID":"24d29406-c861-478c-964c-9d1a832cf6bc","Type":"ContainerStarted","Data":"87a4ac7a83427112aa0f30b030c4d03e3e83d618338afa37faf2dfad6b2a1946"}
Jul 28 20:38:09.044426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.044349    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw" podStartSLOduration=1.04432802 podStartE2EDuration="1.04432802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:38:09.043975406 +0000 UTC m=+1791.440678565" watchObservedRunningTime="2026-07-28 20:38:09.04432802 +0000 UTC m=+1791.441031177"
Jul 28 20:38:09.637260 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.637217    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:38:09.717601 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.717506    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-token\") pod \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") "
Jul 28 20:38:09.717601 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.717567    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-socket\") pod \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") "
Jul 28 20:38:09.717601 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.717598    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istiod-ca-cert\") pod \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") "
Jul 28 20:38:09.717888 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.717714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-envoy\") pod \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") "
Jul 28 20:38:09.717888 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.717766    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-credential-socket\") pod \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") "
Jul 28 20:38:09.717888 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.717821    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-245zm\" (UniqueName: \"kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-kube-api-access-245zm\") pod \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") "
Jul 28 20:38:09.717888 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.717874    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-podinfo\") pod \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") "
Jul 28 20:38:09.718138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.717909    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe4d6748-a0b9-4c78-914f-1805a3a18a5c" (UID: "fe4d6748-a0b9-4c78-914f-1805a3a18a5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:38:09.718138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.717971    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-certs\") pod \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") "
Jul 28 20:38:09.718138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.718005    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-data\") pod \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\" (UID: \"fe4d6748-a0b9-4c78-914f-1805a3a18a5c\") "
Jul 28 20:38:09.718138 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.718014    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe4d6748-a0b9-4c78-914f-1805a3a18a5c" (UID: "fe4d6748-a0b9-4c78-914f-1805a3a18a5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:38:09.718374 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.718321    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe4d6748-a0b9-4c78-914f-1805a3a18a5c" (UID: "fe4d6748-a0b9-4c78-914f-1805a3a18a5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:38:09.718374 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.718340    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe4d6748-a0b9-4c78-914f-1805a3a18a5c" (UID: "fe4d6748-a0b9-4c78-914f-1805a3a18a5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:38:09.718533 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.718514    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:09.718615 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.718570    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:09.718615 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.718587    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:09.718615 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.718601    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:09.719171 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.719147    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe4d6748-a0b9-4c78-914f-1805a3a18a5c" (UID: "fe4d6748-a0b9-4c78-914f-1805a3a18a5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:38:09.720385 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.720357    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe4d6748-a0b9-4c78-914f-1805a3a18a5c" (UID: "fe4d6748-a0b9-4c78-914f-1805a3a18a5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:38:09.720523 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.720506    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe4d6748-a0b9-4c78-914f-1805a3a18a5c" (UID: "fe4d6748-a0b9-4c78-914f-1805a3a18a5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:38:09.720593 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.720548    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe4d6748-a0b9-4c78-914f-1805a3a18a5c" (UID: "fe4d6748-a0b9-4c78-914f-1805a3a18a5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:38:09.720665 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.720647    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-kube-api-access-245zm" (OuterVolumeSpecName: "kube-api-access-245zm") pod "fe4d6748-a0b9-4c78-914f-1805a3a18a5c" (UID: "fe4d6748-a0b9-4c78-914f-1805a3a18a5c"). InnerVolumeSpecName "kube-api-access-245zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:38:09.819592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.819554    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:09.819592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.819586    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:09.819592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.819596    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:09.819822 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.819605    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-245zm\" (UniqueName: \"kubernetes.io/projected/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-kube-api-access-245zm\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:09.819822 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:09.819614    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe4d6748-a0b9-4c78-914f-1805a3a18a5c-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:10.033264 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.033210    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerID="d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6" exitCode=0
Jul 28 20:38:10.033421 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.033268    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"
Jul 28 20:38:10.033421 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.033295    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" event={"ID":"fe4d6748-a0b9-4c78-914f-1805a3a18a5c","Type":"ContainerDied","Data":"d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6"}
Jul 28 20:38:10.033421 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.033351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m" event={"ID":"fe4d6748-a0b9-4c78-914f-1805a3a18a5c","Type":"ContainerDied","Data":"b99076dfcd88f319ff9c6bd7a210589ca10c2282fd35bf9a4b410d342e871421"}
Jul 28 20:38:10.033421 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.033378    2561 scope.go:117] "RemoveContainer" containerID="d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6"
Jul 28 20:38:10.033634 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.033583    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:10.045312 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.044867    2561 scope.go:117] "RemoveContainer" containerID="5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462"
Jul 28 20:38:10.054841 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.054823    2561 scope.go:117] "RemoveContainer" containerID="d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6"
Jul 28 20:38:10.055149 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:38:10.055125    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6\": container with ID starting with d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6 not found: ID does not exist" containerID="d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6"
Jul 28 20:38:10.055208 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.055164    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6"} err="failed to get container status \"d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6\": rpc error: code = NotFound desc = could not find container \"d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6\": container with ID starting with d62cb7c5b046e8984cdc4bcb940ac20065f9008b6a0a3697f49b9454fd4529d6 not found: ID does not exist"
Jul 28 20:38:10.055208 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.055189    2561 scope.go:117] "RemoveContainer" containerID="5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462"
Jul 28 20:38:10.055465 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:38:10.055444    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462\": container with ID starting with 5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462 not found: ID does not exist" containerID="5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462"
Jul 28 20:38:10.055523 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.055475    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462"} err="failed to get container status \"5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462\": rpc error: code = NotFound desc = could not find container \"5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462\": container with ID starting with 5611601e7a7f574f7c8645558cfeba32c3f4809a15f9810acadd57e523029462 not found: ID does not exist"
Jul 28 20:38:10.056154 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.056135    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"]
Jul 28 20:38:10.061770 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.061749    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ed417440-openshift-default-bfb7bb87d-6zn4m"]
Jul 28 20:38:10.085222 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:10.085191    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" path="/var/lib/kubelet/pods/fe4d6748-a0b9-4c78-914f-1805a3a18a5c/volumes"
Jul 28 20:38:18.232000 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:18.231976    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:38:18.233551 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:18.233532    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:38:21.042787 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:21.042756    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:22.014558 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:22.014524    2561 patch_prober.go:28] interesting pod/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 28 20:38:22.014758 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:22.014581    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 28 20:38:22.102763 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:22.102728    2561 generic.go:356] "Generic (PLEG): container finished" podID="05c11e42-dfd0-402c-ba1d-733907edd286" containerID="661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa" exitCode=0
Jul 28 20:38:22.103146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:22.102773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" event={"ID":"05c11e42-dfd0-402c-ba1d-733907edd286","Type":"ContainerDied","Data":"661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa"}
Jul 28 20:38:22.103212 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:22.103168    2561 scope.go:117] "RemoveContainer" containerID="661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa"
Jul 28 20:38:22.104118 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:22.104094    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:38:22.104175 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:22.104161    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:38:22.104223 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:22.104201    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:38:23.109672 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:23.109636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" event={"ID":"05c11e42-dfd0-402c-ba1d-733907edd286","Type":"ContainerStarted","Data":"71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1"}
Jul 28 20:38:23.499998 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:23.499966    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:23.500321 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:23.500298    2561 patch_prober.go:28] interesting pod/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 28 20:38:23.500394 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:23.500346    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 28 20:38:24.501001 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:24.500951    2561 patch_prober.go:28] interesting pod/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 28 20:38:24.501522 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:24.501026    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 28 20:38:25.499984 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:25.499942    2561 patch_prober.go:28] interesting pod/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 28 20:38:25.500197 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:25.500025    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 28 20:38:26.501037 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:26.500992    2561 patch_prober.go:28] interesting pod/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 28 20:38:26.501570 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:26.501067    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 28 20:38:27.500996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:27.500537    2561 patch_prober.go:28] interesting pod/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 28 20:38:27.500996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:27.500613    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 28 20:38:28.510754 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:28.510603    2561 patch_prober.go:28] interesting pod/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 28 20:38:28.510754 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:28.510694    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 28 20:38:29.503769 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:29.503737    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:29.504121 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:29.504097    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:29.504673 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:29.504656    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:32.295328 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.295296    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"]
Jul 28 20:38:32.295717 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.295680    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy"
Jul 28 20:38:32.295717 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.295692    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy"
Jul 28 20:38:32.295717 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.295701    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy"
Jul 28 20:38:32.295717 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.295707    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy"
Jul 28 20:38:32.295847 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.295758    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy"
Jul 28 20:38:32.295847 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.295768    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4d6748-a0b9-4c78-914f-1805a3a18a5c" containerName="istio-proxy"
Jul 28 20:38:32.298885 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.298868    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"
Jul 28 20:38:32.301171 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.301128    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:38:32.301337 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.301290    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 20:38:32.307032 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.307009    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"]
Jul 28 20:38:32.322812 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.322781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e635e50f-944d-4ecf-8e39-4dfbe87d7785-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk\" (UID: \"e635e50f-944d-4ecf-8e39-4dfbe87d7785\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"
Jul 28 20:38:32.423309 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.423267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e635e50f-944d-4ecf-8e39-4dfbe87d7785-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk\" (UID: \"e635e50f-944d-4ecf-8e39-4dfbe87d7785\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"
Jul 28 20:38:32.423892 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.423870    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e635e50f-944d-4ecf-8e39-4dfbe87d7785-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk\" (UID: \"e635e50f-944d-4ecf-8e39-4dfbe87d7785\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"
Jul 28 20:38:32.610934 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.610839    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"
Jul 28 20:38:32.958079 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:32.958052    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"]
Jul 28 20:38:32.960352 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:38:32.960325    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode635e50f_944d_4ecf_8e39_4dfbe87d7785.slice/crio-d855bf6869fe158807d8d71a1a6c5fc9a82e33e6c5c7b728aebae61c2e738d30 WatchSource:0}: Error finding container d855bf6869fe158807d8d71a1a6c5fc9a82e33e6c5c7b728aebae61c2e738d30: Status 404 returned error can't find the container with id d855bf6869fe158807d8d71a1a6c5fc9a82e33e6c5c7b728aebae61c2e738d30
Jul 28 20:38:33.162653 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:33.162618    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk" event={"ID":"e635e50f-944d-4ecf-8e39-4dfbe87d7785","Type":"ContainerStarted","Data":"d855bf6869fe158807d8d71a1a6c5fc9a82e33e6c5c7b728aebae61c2e738d30"}
Jul 28 20:38:34.174845 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:34.174809    2561 generic.go:356] "Generic (PLEG): container finished" podID="e635e50f-944d-4ecf-8e39-4dfbe87d7785" containerID="7fd8a206e6d6dc9da603f335c1b67a4b13c644538375c28ff98dc1a18ad9ad75" exitCode=0
Jul 28 20:38:34.175323 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:34.174890    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk" event={"ID":"e635e50f-944d-4ecf-8e39-4dfbe87d7785","Type":"ContainerDied","Data":"7fd8a206e6d6dc9da603f335c1b67a4b13c644538375c28ff98dc1a18ad9ad75"}
Jul 28 20:38:35.313947 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:35.313922    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"
Jul 28 20:38:35.348426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:35.348394    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e635e50f-944d-4ecf-8e39-4dfbe87d7785-maas-api-service-ca\") pod \"e635e50f-944d-4ecf-8e39-4dfbe87d7785\" (UID: \"e635e50f-944d-4ecf-8e39-4dfbe87d7785\") "
Jul 28 20:38:35.348746 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:35.348725    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e635e50f-944d-4ecf-8e39-4dfbe87d7785-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e635e50f-944d-4ecf-8e39-4dfbe87d7785" (UID: "e635e50f-944d-4ecf-8e39-4dfbe87d7785"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:38:35.449874 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:35.449786    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e635e50f-944d-4ecf-8e39-4dfbe87d7785-maas-api-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:36.188579 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:36.188541    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"
Jul 28 20:38:36.188579 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:36.188550    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk" event={"ID":"e635e50f-944d-4ecf-8e39-4dfbe87d7785","Type":"ContainerDied","Data":"d855bf6869fe158807d8d71a1a6c5fc9a82e33e6c5c7b728aebae61c2e738d30"}
Jul 28 20:38:36.188834 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:36.188594    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d855bf6869fe158807d8d71a1a6c5fc9a82e33e6c5c7b728aebae61c2e738d30"
Jul 28 20:38:38.327891 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.327854    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"]
Jul 28 20:38:38.328384 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.328105    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw" podUID="24d29406-c861-478c-964c-9d1a832cf6bc" containerName="payload-processing" containerID="cri-o://67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae" gracePeriod=30
Jul 28 20:38:38.511260 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.509271    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"]
Jul 28 20:38:38.512888 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.512852    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0fbea363-6x8gk"]
Jul 28 20:38:38.591689 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.591626    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:38.669023 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.668983    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"]
Jul 28 20:38:38.669316 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.669290    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy" containerID="cri-o://71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1" gracePeriod=30
Jul 28 20:38:38.677158 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.677127    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24d29406-c861-478c-964c-9d1a832cf6bc-plugins-config-volume\") pod \"24d29406-c861-478c-964c-9d1a832cf6bc\" (UID: \"24d29406-c861-478c-964c-9d1a832cf6bc\") "
Jul 28 20:38:38.677323 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.677170    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmtzc\" (UniqueName: \"kubernetes.io/projected/24d29406-c861-478c-964c-9d1a832cf6bc-kube-api-access-gmtzc\") pod \"24d29406-c861-478c-964c-9d1a832cf6bc\" (UID: \"24d29406-c861-478c-964c-9d1a832cf6bc\") "
Jul 28 20:38:38.677526 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.677503    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24d29406-c861-478c-964c-9d1a832cf6bc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24d29406-c861-478c-964c-9d1a832cf6bc" (UID: "24d29406-c861-478c-964c-9d1a832cf6bc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:38:38.679112 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.679092    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d29406-c861-478c-964c-9d1a832cf6bc-kube-api-access-gmtzc" (OuterVolumeSpecName: "kube-api-access-gmtzc") pod "24d29406-c861-478c-964c-9d1a832cf6bc" (UID: "24d29406-c861-478c-964c-9d1a832cf6bc"). InnerVolumeSpecName "kube-api-access-gmtzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:38:38.778159 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.778125    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmtzc\" (UniqueName: \"kubernetes.io/projected/24d29406-c861-478c-964c-9d1a832cf6bc-kube-api-access-gmtzc\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:38.778159 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:38.778156    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24d29406-c861-478c-964c-9d1a832cf6bc-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:39.205815 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:39.205780    2561 generic.go:356] "Generic (PLEG): container finished" podID="24d29406-c861-478c-964c-9d1a832cf6bc" containerID="67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae" exitCode=0
Jul 28 20:38:39.205994 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:39.205843    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"
Jul 28 20:38:39.205994 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:39.205869    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw" event={"ID":"24d29406-c861-478c-964c-9d1a832cf6bc","Type":"ContainerDied","Data":"67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae"}
Jul 28 20:38:39.205994 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:39.205922    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw" event={"ID":"24d29406-c861-478c-964c-9d1a832cf6bc","Type":"ContainerDied","Data":"87a4ac7a83427112aa0f30b030c4d03e3e83d618338afa37faf2dfad6b2a1946"}
Jul 28 20:38:39.205994 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:39.205945    2561 scope.go:117] "RemoveContainer" containerID="67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae"
Jul 28 20:38:39.214952 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:39.214937    2561 scope.go:117] "RemoveContainer" containerID="67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae"
Jul 28 20:38:39.215230 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:38:39.215208    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae\": container with ID starting with 67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae not found: ID does not exist" containerID="67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae"
Jul 28 20:38:39.215230 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:39.215263    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae"} err="failed to get container status \"67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae\": rpc error: code = NotFound desc = could not find container \"67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae\": container with ID starting with 67d2bdd01f2aca24c2a29d26ae3198280a132988c7f6fc0fefaec31d9e7ba1ae not found: ID does not exist"
Jul 28 20:38:39.232088 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:39.232061    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"]
Jul 28 20:38:39.234018 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:39.233999    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0fbea363-77fccc7cc8-phtsw"]
Jul 28 20:38:40.076012 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:40.075974    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24d29406-c861-478c-964c-9d1a832cf6bc" path="/var/lib/kubelet/pods/24d29406-c861-478c-964c-9d1a832cf6bc/volumes"
Jul 28 20:38:40.076477 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:40.076416    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e635e50f-944d-4ecf-8e39-4dfbe87d7785" path="/var/lib/kubelet/pods/e635e50f-944d-4ecf-8e39-4dfbe87d7785/volumes"
Jul 28 20:38:43.929707 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:43.929642    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:44.027824 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.027797    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-socket\") pod \"05c11e42-dfd0-402c-ba1d-733907edd286\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") "
Jul 28 20:38:44.028025 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.027834    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05c11e42-dfd0-402c-ba1d-733907edd286-istiod-ca-cert\") pod \"05c11e42-dfd0-402c-ba1d-733907edd286\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") "
Jul 28 20:38:44.028025 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.027872    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-credential-socket\") pod \"05c11e42-dfd0-402c-ba1d-733907edd286\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") "
Jul 28 20:38:44.028025 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.027917    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lmfr\" (UniqueName: \"kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-kube-api-access-2lmfr\") pod \"05c11e42-dfd0-402c-ba1d-733907edd286\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") "
Jul 28 20:38:44.028025 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.027955    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05c11e42-dfd0-402c-ba1d-733907edd286-istio-podinfo\") pod \"05c11e42-dfd0-402c-ba1d-733907edd286\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") "
Jul 28 20:38:44.028025 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028001    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-istio-token\") pod \"05c11e42-dfd0-402c-ba1d-733907edd286\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") "
Jul 28 20:38:44.028334 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028035    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-data\") pod \"05c11e42-dfd0-402c-ba1d-733907edd286\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") "
Jul 28 20:38:44.028334 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028136    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05c11e42-dfd0-402c-ba1d-733907edd286" (UID: "05c11e42-dfd0-402c-ba1d-733907edd286"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:38:44.028334 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028149    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-envoy\") pod \"05c11e42-dfd0-402c-ba1d-733907edd286\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") "
Jul 28 20:38:44.028334 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028193    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-certs\") pod \"05c11e42-dfd0-402c-ba1d-733907edd286\" (UID: \"05c11e42-dfd0-402c-ba1d-733907edd286\") "
Jul 28 20:38:44.028334 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028229    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05c11e42-dfd0-402c-ba1d-733907edd286" (UID: "05c11e42-dfd0-402c-ba1d-733907edd286"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:38:44.028590 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028346    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c11e42-dfd0-402c-ba1d-733907edd286-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05c11e42-dfd0-402c-ba1d-733907edd286" (UID: "05c11e42-dfd0-402c-ba1d-733907edd286"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:38:44.028590 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028467    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05c11e42-dfd0-402c-ba1d-733907edd286" (UID: "05c11e42-dfd0-402c-ba1d-733907edd286"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:38:44.028694 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028643    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:44.028694 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028665    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05c11e42-dfd0-402c-ba1d-733907edd286-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:44.028694 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028679    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:44.028822 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.028692    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:44.029043 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.029018    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-data" (OuterVolumeSpecName: "istio-data") pod "05c11e42-dfd0-402c-ba1d-733907edd286" (UID: "05c11e42-dfd0-402c-ba1d-733907edd286"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:38:44.030502 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.030465    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-kube-api-access-2lmfr" (OuterVolumeSpecName: "kube-api-access-2lmfr") pod "05c11e42-dfd0-402c-ba1d-733907edd286" (UID: "05c11e42-dfd0-402c-ba1d-733907edd286"). InnerVolumeSpecName "kube-api-access-2lmfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:38:44.030601 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.030549    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05c11e42-dfd0-402c-ba1d-733907edd286-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05c11e42-dfd0-402c-ba1d-733907edd286" (UID: "05c11e42-dfd0-402c-ba1d-733907edd286"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:38:44.030691 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.030672    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05c11e42-dfd0-402c-ba1d-733907edd286" (UID: "05c11e42-dfd0-402c-ba1d-733907edd286"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:38:44.030739 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.030709    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-istio-token" (OuterVolumeSpecName: "istio-token") pod "05c11e42-dfd0-402c-ba1d-733907edd286" (UID: "05c11e42-dfd0-402c-ba1d-733907edd286"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:38:44.129661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.129620    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:44.129661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.129651    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lmfr\" (UniqueName: \"kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-kube-api-access-2lmfr\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:44.129661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.129661    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05c11e42-dfd0-402c-ba1d-733907edd286-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:44.129661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.129671    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05c11e42-dfd0-402c-ba1d-733907edd286-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:44.129927 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.129679    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05c11e42-dfd0-402c-ba1d-733907edd286-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:38:44.234534 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.234447    2561 generic.go:356] "Generic (PLEG): container finished" podID="05c11e42-dfd0-402c-ba1d-733907edd286" containerID="71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1" exitCode=0
Jul 28 20:38:44.234534 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.234489    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" event={"ID":"05c11e42-dfd0-402c-ba1d-733907edd286","Type":"ContainerDied","Data":"71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1"}
Jul 28 20:38:44.234534 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.234505    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"
Jul 28 20:38:44.234769 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.234537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8" event={"ID":"05c11e42-dfd0-402c-ba1d-733907edd286","Type":"ContainerDied","Data":"42593d2755c165c5e96dcfba1f5d636311be84c0447f7722851209e2d0ec8c62"}
Jul 28 20:38:44.234769 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.234562    2561 scope.go:117] "RemoveContainer" containerID="71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1"
Jul 28 20:38:44.248566 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.248538    2561 scope.go:117] "RemoveContainer" containerID="661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa"
Jul 28 20:38:44.254300 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.254275    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"]
Jul 28 20:38:44.257434 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.257413    2561 scope.go:117] "RemoveContainer" containerID="71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1"
Jul 28 20:38:44.257877 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:38:44.257829    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1\": container with ID starting with 71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1 not found: ID does not exist" containerID="71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1"
Jul 28 20:38:44.257977 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.257879    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1"} err="failed to get container status \"71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1\": rpc error: code = NotFound desc = could not find container \"71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1\": container with ID starting with 71fc9d50922c9575bdaa605e2154568ad8feeeccccb040455e9be2afd6481ef1 not found: ID does not exist"
Jul 28 20:38:44.257977 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.257900    2561 scope.go:117] "RemoveContainer" containerID="661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa"
Jul 28 20:38:44.258348 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:38:44.258276    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa\": container with ID starting with 661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa not found: ID does not exist" containerID="661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa"
Jul 28 20:38:44.258348 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.258314    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa"} err="failed to get container status \"661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa\": rpc error: code = NotFound desc = could not find container \"661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa\": container with ID starting with 661b118d160ca6d01174dfa763eb3704fadc24b8141c3d16ba4001a9fd2e2ffa not found: ID does not exist"
Jul 28 20:38:44.260257 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:44.260221    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0fbea363-openshift-default-9b5b675c6-65cl8"]
Jul 28 20:38:46.076924 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:38:46.076888    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" path="/var/lib/kubelet/pods/05c11e42-dfd0-402c-ba1d-733907edd286/volumes"
Jul 28 20:40:31.200449 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200415    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"]
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200750    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200761    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200776    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e635e50f-944d-4ecf-8e39-4dfbe87d7785" containerName="revoke-keys"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200781    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e635e50f-944d-4ecf-8e39-4dfbe87d7785" containerName="revoke-keys"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200789    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200795    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200801    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d29406-c861-478c-964c-9d1a832cf6bc" containerName="payload-processing"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200806    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d29406-c861-478c-964c-9d1a832cf6bc" containerName="payload-processing"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200862    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200869    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="05c11e42-dfd0-402c-ba1d-733907edd286" containerName="istio-proxy"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200876    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e635e50f-944d-4ecf-8e39-4dfbe87d7785" containerName="revoke-keys"
Jul 28 20:40:31.200942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.200889    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="24d29406-c861-478c-964c-9d1a832cf6bc" containerName="payload-processing"
Jul 28 20:40:31.203757 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.203742    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.206298 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.206276    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fd997c17-openshift-default-dockercfg-xjvlb\""
Jul 28 20:40:31.236558 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.236518    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"]
Jul 28 20:40:31.261609 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.261576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-socket\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.261609 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.261612    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-istio-token\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.261818 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.261632    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fdx9\" (UniqueName: \"kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-kube-api-access-5fdx9\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.261818 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.261725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7092bda4-f253-4bd8-83f0-993555aefc35-istio-podinfo\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.261818 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.261753    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-credential-socket\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.261818 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.261771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-envoy\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.261818 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.261790    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-certs\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.261818 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.261817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-data\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.262011 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.261833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7092bda4-f253-4bd8-83f0-993555aefc35-istiod-ca-cert\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.363175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-socket\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.363220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-istio-token\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.363266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fdx9\" (UniqueName: \"kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-kube-api-access-5fdx9\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.363345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7092bda4-f253-4bd8-83f0-993555aefc35-istio-podinfo\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.363383    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-credential-socket\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.363405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-envoy\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.363435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-certs\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.363481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-data\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.363505    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7092bda4-f253-4bd8-83f0-993555aefc35-istiod-ca-cert\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.364197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7092bda4-f253-4bd8-83f0-993555aefc35-istiod-ca-cert\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.364612    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-socket\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.367923    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7092bda4-f253-4bd8-83f0-993555aefc35-istio-podinfo\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.368956 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.368157    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-credential-socket\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.369820 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.369273    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-data\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.369820 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.369295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-certs\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.370386 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.370367    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-envoy\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.375268 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.375225    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-istio-token\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.375682 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.375664    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fdx9\" (UniqueName: \"kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-kube-api-access-5fdx9\") pod \"e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") " pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.513999 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.513964    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:31.652882 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.652854    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"]
Jul 28 20:40:31.654884 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:40:31.654859    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7092bda4_f253_4bd8_83f0_993555aefc35.slice/crio-5176c3667af046608545b4b68e441e1befd0058045015b404fa5f539cd731635 WatchSource:0}: Error finding container 5176c3667af046608545b4b68e441e1befd0058045015b404fa5f539cd731635: Status 404 returned error can't find the container with id 5176c3667af046608545b4b68e441e1befd0058045015b404fa5f539cd731635
Jul 28 20:40:31.657060 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.657030    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:40:31.657126 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.657100    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:40:31.657163 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.657129    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:40:31.782749 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.782637    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" event={"ID":"7092bda4-f253-4bd8-83f0-993555aefc35","Type":"ContainerStarted","Data":"ec928798ab11fd2d0bd401e6278dc5ba6e83f33a5547a9316ab5f76d0e627774"}
Jul 28 20:40:31.782749 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.782699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" event={"ID":"7092bda4-f253-4bd8-83f0-993555aefc35","Type":"ContainerStarted","Data":"5176c3667af046608545b4b68e441e1befd0058045015b404fa5f539cd731635"}
Jul 28 20:40:31.801904 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:31.801803    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" podStartSLOduration=0.801786635 podStartE2EDuration="801.786635ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:40:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:40:31.800597525 +0000 UTC m=+1934.197300674" watchObservedRunningTime="2026-07-28 20:40:31.801786635 +0000 UTC m=+1934.198489854"
Jul 28 20:40:32.514406 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:32.514371    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:32.519433 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:32.519409    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:32.788425 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:32.788344    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:32.789394 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:32.789376    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:34.937108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.937074    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"]
Jul 28 20:40:34.940833 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.940813    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:40:34.943447 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.943422    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-fd997c17\""
Jul 28 20:40:34.950978 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.950955    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"]
Jul 28 20:40:34.954827 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.954803    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"]
Jul 28 20:40:34.958194 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.958176    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:40:34.961410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.961390    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-fd997c17-dockercfg-dwb79\""
Jul 28 20:40:34.965673 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:40:34.965644    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076d6330_f91f_45f3_939b_a5c24d47886b.slice\": RecentStats: unable to find data in memory cache]"
Jul 28 20:40:34.965859 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:40:34.965839    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076d6330_f91f_45f3_939b_a5c24d47886b.slice\": RecentStats: unable to find data in memory cache]"
Jul 28 20:40:34.972915 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.972894    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"]
Jul 28 20:40:34.998192 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.998164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46165625-afae-4ca7-881e-73c63895f7c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl\" (UID: \"46165625-afae-4ca7-881e-73c63895f7c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:40:34.998358 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.998215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmv98\" (UniqueName: \"kubernetes.io/projected/46165625-afae-4ca7-881e-73c63895f7c8-kube-api-access-hmv98\") pod \"payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl\" (UID: \"46165625-afae-4ca7-881e-73c63895f7c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:40:34.998358 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.998268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7qqw\" (UniqueName: \"kubernetes.io/projected/076d6330-f91f-45f3-939b-a5c24d47886b-kube-api-access-r7qqw\") pod \"payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx\" (UID: \"076d6330-f91f-45f3-939b-a5c24d47886b\") " pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:40:34.998358 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:34.998312    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/076d6330-f91f-45f3-939b-a5c24d47886b-plugins-config-volume\") pod \"payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx\" (UID: \"076d6330-f91f-45f3-939b-a5c24d47886b\") " pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:40:35.098947 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.098906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/076d6330-f91f-45f3-939b-a5c24d47886b-plugins-config-volume\") pod \"payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx\" (UID: \"076d6330-f91f-45f3-939b-a5c24d47886b\") " pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:40:35.099149 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.098965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46165625-afae-4ca7-881e-73c63895f7c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl\" (UID: \"46165625-afae-4ca7-881e-73c63895f7c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:40:35.099149 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.099009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmv98\" (UniqueName: \"kubernetes.io/projected/46165625-afae-4ca7-881e-73c63895f7c8-kube-api-access-hmv98\") pod \"payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl\" (UID: \"46165625-afae-4ca7-881e-73c63895f7c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:40:35.099149 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.099030    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7qqw\" (UniqueName: \"kubernetes.io/projected/076d6330-f91f-45f3-939b-a5c24d47886b-kube-api-access-r7qqw\") pod \"payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx\" (UID: \"076d6330-f91f-45f3-939b-a5c24d47886b\") " pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:40:35.099750 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.099730    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46165625-afae-4ca7-881e-73c63895f7c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl\" (UID: \"46165625-afae-4ca7-881e-73c63895f7c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:40:35.099810 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.099738    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/076d6330-f91f-45f3-939b-a5c24d47886b-plugins-config-volume\") pod \"payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx\" (UID: \"076d6330-f91f-45f3-939b-a5c24d47886b\") " pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:40:35.108317 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.108295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmv98\" (UniqueName: \"kubernetes.io/projected/46165625-afae-4ca7-881e-73c63895f7c8-kube-api-access-hmv98\") pod \"payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl\" (UID: \"46165625-afae-4ca7-881e-73c63895f7c8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:40:35.108430 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.108295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7qqw\" (UniqueName: \"kubernetes.io/projected/076d6330-f91f-45f3-939b-a5c24d47886b-kube-api-access-r7qqw\") pod \"payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx\" (UID: \"076d6330-f91f-45f3-939b-a5c24d47886b\") " pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:40:35.253040 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.253002    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:40:35.269329 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.269291    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:40:35.402150 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.402125    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"]
Jul 28 20:40:35.404714 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:40:35.404684    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46165625_afae_4ca7_881e_73c63895f7c8.slice/crio-6dea8df92ff70848457d73348131a90bbf3380922f0e4e91ea0732927bbbed8a WatchSource:0}: Error finding container 6dea8df92ff70848457d73348131a90bbf3380922f0e4e91ea0732927bbbed8a: Status 404 returned error can't find the container with id 6dea8df92ff70848457d73348131a90bbf3380922f0e4e91ea0732927bbbed8a
Jul 28 20:40:35.426433 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.426407    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"]
Jul 28 20:40:35.427856 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:40:35.427824    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076d6330_f91f_45f3_939b_a5c24d47886b.slice/crio-55c2cd5d6001944b14c84481f015d54d36615dc26dadda425c72263b786178d6 WatchSource:0}: Error finding container 55c2cd5d6001944b14c84481f015d54d36615dc26dadda425c72263b786178d6: Status 404 returned error can't find the container with id 55c2cd5d6001944b14c84481f015d54d36615dc26dadda425c72263b786178d6
Jul 28 20:40:35.807046 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.807006    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx" event={"ID":"076d6330-f91f-45f3-939b-a5c24d47886b","Type":"ContainerStarted","Data":"77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89"}
Jul 28 20:40:35.807220 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.807069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx" event={"ID":"076d6330-f91f-45f3-939b-a5c24d47886b","Type":"ContainerStarted","Data":"55c2cd5d6001944b14c84481f015d54d36615dc26dadda425c72263b786178d6"}
Jul 28 20:40:35.807220 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.807156    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:40:35.808633 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.808614    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl" event={"ID":"46165625-afae-4ca7-881e-73c63895f7c8","Type":"ContainerStarted","Data":"c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e"}
Jul 28 20:40:35.808733 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.808650    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl" event={"ID":"46165625-afae-4ca7-881e-73c63895f7c8","Type":"ContainerStarted","Data":"6dea8df92ff70848457d73348131a90bbf3380922f0e4e91ea0732927bbbed8a"}
Jul 28 20:40:35.808733 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.808694    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:40:35.836893 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.836834    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx" podStartSLOduration=1.836780805 podStartE2EDuration="1.836780805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:40:35.836738634 +0000 UTC m=+1938.233441825" watchObservedRunningTime="2026-07-28 20:40:35.836780805 +0000 UTC m=+1938.233483949"
Jul 28 20:40:35.879014 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:35.878955    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl" podStartSLOduration=1.878939619 podStartE2EDuration="1.878939619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:40:35.873196616 +0000 UTC m=+1938.269899772" watchObservedRunningTime="2026-07-28 20:40:35.878939619 +0000 UTC m=+1938.275642775"
Jul 28 20:40:46.816807 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:46.816773    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:40:46.817325 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:46.816841    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:40:48.100415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:48.099625    2561 patch_prober.go:28] interesting pod/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:55096->10.132.0.54:15021: read: connection reset by peer" start-of-body=
Jul 28 20:40:48.100415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:48.099703    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:55096->10.132.0.54:15021: read: connection reset by peer"
Jul 28 20:40:48.881424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:48.881392    2561 generic.go:356] "Generic (PLEG): container finished" podID="7092bda4-f253-4bd8-83f0-993555aefc35" containerID="ec928798ab11fd2d0bd401e6278dc5ba6e83f33a5547a9316ab5f76d0e627774" exitCode=0
Jul 28 20:40:48.881611 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:48.881449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" event={"ID":"7092bda4-f253-4bd8-83f0-993555aefc35","Type":"ContainerDied","Data":"ec928798ab11fd2d0bd401e6278dc5ba6e83f33a5547a9316ab5f76d0e627774"}
Jul 28 20:40:48.881816 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:48.881804    2561 scope.go:117] "RemoveContainer" containerID="ec928798ab11fd2d0bd401e6278dc5ba6e83f33a5547a9316ab5f76d0e627774"
Jul 28 20:40:48.882871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:48.882746    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:40:48.882871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:48.882815    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:40:48.882871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:48.882848    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:40:49.888726 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:49.888695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" event={"ID":"7092bda4-f253-4bd8-83f0-993555aefc35","Type":"ContainerStarted","Data":"9c7ceaf535a7b16af5adb2462585d6a33c6cceb4f7cea2513641c5392425d7d5"}
Jul 28 20:40:50.514445 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:50.514409    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:50.514679 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:50.514658    2561 patch_prober.go:28] interesting pod/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 28 20:40:50.514726 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:50.514703    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 28 20:40:51.514617 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:51.514575    2561 patch_prober.go:28] interesting pod/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 28 20:40:51.515100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:51.514645    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 28 20:40:52.515061 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:52.515023    2561 patch_prober.go:28] interesting pod/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 28 20:40:52.515493 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:52.515082    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 28 20:40:53.515344 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:53.515304    2561 patch_prober.go:28] interesting pod/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 28 20:40:53.515725 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:53.515360    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 28 20:40:54.518260 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:54.518211    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:54.518692 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:54.518614    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:40:54.519250 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:40:54.519215    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:41:06.219409 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.219375    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"]
Jul 28 20:41:06.223123 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.223105    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"
Jul 28 20:41:06.226289 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.226264    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 20:41:06.226289 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.226269    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:41:06.232224 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.232200    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"]
Jul 28 20:41:06.379971 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.379934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84ea4a40-9ef4-4da5-b211-9a2b29932424-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs\" (UID: \"84ea4a40-9ef4-4da5-b211-9a2b29932424\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"
Jul 28 20:41:06.480470 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.480377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84ea4a40-9ef4-4da5-b211-9a2b29932424-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs\" (UID: \"84ea4a40-9ef4-4da5-b211-9a2b29932424\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"
Jul 28 20:41:06.481061 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.481026    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84ea4a40-9ef4-4da5-b211-9a2b29932424-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs\" (UID: \"84ea4a40-9ef4-4da5-b211-9a2b29932424\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"
Jul 28 20:41:06.534326 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.534297    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"
Jul 28 20:41:06.681540 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.681511    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"]
Jul 28 20:41:06.684101 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:41:06.684071    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ea4a40_9ef4_4da5_b211_9a2b29932424.slice/crio-4dcc75eae943ca385b8d95ae77e6d73df41a66a85af890adc577519a0268c4f5 WatchSource:0}: Error finding container 4dcc75eae943ca385b8d95ae77e6d73df41a66a85af890adc577519a0268c4f5: Status 404 returned error can't find the container with id 4dcc75eae943ca385b8d95ae77e6d73df41a66a85af890adc577519a0268c4f5
Jul 28 20:41:06.990940 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:06.990908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs" event={"ID":"84ea4a40-9ef4-4da5-b211-9a2b29932424","Type":"ContainerStarted","Data":"4dcc75eae943ca385b8d95ae77e6d73df41a66a85af890adc577519a0268c4f5"}
Jul 28 20:41:07.997803 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:07.997765    2561 generic.go:356] "Generic (PLEG): container finished" podID="84ea4a40-9ef4-4da5-b211-9a2b29932424" containerID="1cbd8c2b9b2b1d8cad702f455d5045ad339be9d4a35666e3ce274c89da0c29bb" exitCode=0
Jul 28 20:41:07.998209 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:07.997823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs" event={"ID":"84ea4a40-9ef4-4da5-b211-9a2b29932424","Type":"ContainerDied","Data":"1cbd8c2b9b2b1d8cad702f455d5045ad339be9d4a35666e3ce274c89da0c29bb"}
Jul 28 20:41:09.137704 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:09.137677    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"
Jul 28 20:41:09.307399 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:09.307306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84ea4a40-9ef4-4da5-b211-9a2b29932424-maas-api-service-ca\") pod \"84ea4a40-9ef4-4da5-b211-9a2b29932424\" (UID: \"84ea4a40-9ef4-4da5-b211-9a2b29932424\") "
Jul 28 20:41:09.307683 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:09.307660    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ea4a40-9ef4-4da5-b211-9a2b29932424-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "84ea4a40-9ef4-4da5-b211-9a2b29932424" (UID: "84ea4a40-9ef4-4da5-b211-9a2b29932424"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:41:09.408942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:09.408905    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84ea4a40-9ef4-4da5-b211-9a2b29932424-maas-api-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:10.009833 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:10.009794    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"
Jul 28 20:41:10.010004 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:10.009829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs" event={"ID":"84ea4a40-9ef4-4da5-b211-9a2b29932424","Type":"ContainerDied","Data":"4dcc75eae943ca385b8d95ae77e6d73df41a66a85af890adc577519a0268c4f5"}
Jul 28 20:41:10.010004 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:10.009881    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dcc75eae943ca385b8d95ae77e6d73df41a66a85af890adc577519a0268c4f5"
Jul 28 20:41:16.953679 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:16.953639    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"]
Jul 28 20:41:16.954273 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:16.954207    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx" podUID="076d6330-f91f-45f3-939b-a5c24d47886b" containerName="payload-processing" containerID="cri-o://77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89" gracePeriod=30
Jul 28 20:41:16.964360 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:16.964332    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"]
Jul 28 20:41:16.964550 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:16.964530    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl" podUID="46165625-afae-4ca7-881e-73c63895f7c8" containerName="payload-pre-processing" containerID="cri-o://c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e" gracePeriod=30
Jul 28 20:41:17.188715 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.188670    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"]
Jul 28 20:41:17.192370 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.192339    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fd997c17-kr6qs"]
Jul 28 20:41:17.226222 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.226199    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:41:17.256248 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.256207    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:41:17.276209 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.276174    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7qqw\" (UniqueName: \"kubernetes.io/projected/076d6330-f91f-45f3-939b-a5c24d47886b-kube-api-access-r7qqw\") pod \"076d6330-f91f-45f3-939b-a5c24d47886b\" (UID: \"076d6330-f91f-45f3-939b-a5c24d47886b\") "
Jul 28 20:41:17.276409 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.276267    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46165625-afae-4ca7-881e-73c63895f7c8-plugins-config-volume\") pod \"46165625-afae-4ca7-881e-73c63895f7c8\" (UID: \"46165625-afae-4ca7-881e-73c63895f7c8\") "
Jul 28 20:41:17.276409 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.276343    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmv98\" (UniqueName: \"kubernetes.io/projected/46165625-afae-4ca7-881e-73c63895f7c8-kube-api-access-hmv98\") pod \"46165625-afae-4ca7-881e-73c63895f7c8\" (UID: \"46165625-afae-4ca7-881e-73c63895f7c8\") "
Jul 28 20:41:17.276409 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.276401    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/076d6330-f91f-45f3-939b-a5c24d47886b-plugins-config-volume\") pod \"076d6330-f91f-45f3-939b-a5c24d47886b\" (UID: \"076d6330-f91f-45f3-939b-a5c24d47886b\") "
Jul 28 20:41:17.276737 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.276698    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46165625-afae-4ca7-881e-73c63895f7c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "46165625-afae-4ca7-881e-73c63895f7c8" (UID: "46165625-afae-4ca7-881e-73c63895f7c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:41:17.276829 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.276775    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/076d6330-f91f-45f3-939b-a5c24d47886b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "076d6330-f91f-45f3-939b-a5c24d47886b" (UID: "076d6330-f91f-45f3-939b-a5c24d47886b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:41:17.278448 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.278427    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076d6330-f91f-45f3-939b-a5c24d47886b-kube-api-access-r7qqw" (OuterVolumeSpecName: "kube-api-access-r7qqw") pod "076d6330-f91f-45f3-939b-a5c24d47886b" (UID: "076d6330-f91f-45f3-939b-a5c24d47886b"). InnerVolumeSpecName "kube-api-access-r7qqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:41:17.278585 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.278457    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46165625-afae-4ca7-881e-73c63895f7c8-kube-api-access-hmv98" (OuterVolumeSpecName: "kube-api-access-hmv98") pod "46165625-afae-4ca7-881e-73c63895f7c8" (UID: "46165625-afae-4ca7-881e-73c63895f7c8"). InnerVolumeSpecName "kube-api-access-hmv98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:41:17.377536 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.377498    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46165625-afae-4ca7-881e-73c63895f7c8-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:17.377536 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.377529    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmv98\" (UniqueName: \"kubernetes.io/projected/46165625-afae-4ca7-881e-73c63895f7c8-kube-api-access-hmv98\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:17.377536 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.377543    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/076d6330-f91f-45f3-939b-a5c24d47886b-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:17.377785 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:17.377554    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7qqw\" (UniqueName: \"kubernetes.io/projected/076d6330-f91f-45f3-939b-a5c24d47886b-kube-api-access-r7qqw\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:18.054677 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.054642    2561 generic.go:356] "Generic (PLEG): container finished" podID="46165625-afae-4ca7-881e-73c63895f7c8" containerID="c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e" exitCode=0
Jul 28 20:41:18.055125 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.054698    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"
Jul 28 20:41:18.055125 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.054730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl" event={"ID":"46165625-afae-4ca7-881e-73c63895f7c8","Type":"ContainerDied","Data":"c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e"}
Jul 28 20:41:18.055125 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.054790    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl" event={"ID":"46165625-afae-4ca7-881e-73c63895f7c8","Type":"ContainerDied","Data":"6dea8df92ff70848457d73348131a90bbf3380922f0e4e91ea0732927bbbed8a"}
Jul 28 20:41:18.055125 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.054813    2561 scope.go:117] "RemoveContainer" containerID="c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e"
Jul 28 20:41:18.056283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.056261    2561 generic.go:356] "Generic (PLEG): container finished" podID="076d6330-f91f-45f3-939b-a5c24d47886b" containerID="77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89" exitCode=0
Jul 28 20:41:18.056371 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.056307    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"
Jul 28 20:41:18.056434 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.056310    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx" event={"ID":"076d6330-f91f-45f3-939b-a5c24d47886b","Type":"ContainerDied","Data":"77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89"}
Jul 28 20:41:18.056496 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.056452    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx" event={"ID":"076d6330-f91f-45f3-939b-a5c24d47886b","Type":"ContainerDied","Data":"55c2cd5d6001944b14c84481f015d54d36615dc26dadda425c72263b786178d6"}
Jul 28 20:41:18.064599 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.064570    2561 scope.go:117] "RemoveContainer" containerID="c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e"
Jul 28 20:41:18.064914 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:41:18.064883    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e\": container with ID starting with c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e not found: ID does not exist" containerID="c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e"
Jul 28 20:41:18.065003 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.064928    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e"} err="failed to get container status \"c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e\": rpc error: code = NotFound desc = could not find container \"c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e\": container with ID starting with c5597c11b2b9e272850bbb898fd628fd3409619c43d8992b67710ec024a5e93e not found: ID does not exist"
Jul 28 20:41:18.065003 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.064951    2561 scope.go:117] "RemoveContainer" containerID="77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89"
Jul 28 20:41:18.078836 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.078813    2561 scope.go:117] "RemoveContainer" containerID="77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89"
Jul 28 20:41:18.079516 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:41:18.079482    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89\": container with ID starting with 77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89 not found: ID does not exist" containerID="77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89"
Jul 28 20:41:18.079624 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.079525    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89"} err="failed to get container status \"77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89\": rpc error: code = NotFound desc = could not find container \"77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89\": container with ID starting with 77218267f0f090b2d0ec436cdaaebdcf970a949db41307d10decfe1d7a138d89 not found: ID does not exist"
Jul 28 20:41:18.082731 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.082711    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84ea4a40-9ef4-4da5-b211-9a2b29932424" path="/var/lib/kubelet/pods/84ea4a40-9ef4-4da5-b211-9a2b29932424/volumes"
Jul 28 20:41:18.088973 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.088950    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"]
Jul 28 20:41:18.094185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.094165    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fd997c17-5f8696ccd8-m7vnl"]
Jul 28 20:41:18.106042 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.106013    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"]
Jul 28 20:41:18.111118 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:18.111092    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fd997c17-66ff6f48db-r62nx"]
Jul 28 20:41:20.075778 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:20.075745    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="076d6330-f91f-45f3-939b-a5c24d47886b" path="/var/lib/kubelet/pods/076d6330-f91f-45f3-939b-a5c24d47886b/volumes"
Jul 28 20:41:20.076267 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:20.076079    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46165625-afae-4ca7-881e-73c63895f7c8" path="/var/lib/kubelet/pods/46165625-afae-4ca7-881e-73c63895f7c8/volumes"
Jul 28 20:41:23.929016 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:23.928980    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"]
Jul 28 20:41:23.929495 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:23.929328    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy" containerID="cri-o://9c7ceaf535a7b16af5adb2462585d6a33c6cceb4f7cea2513641c5392425d7d5" gracePeriod=30
Jul 28 20:41:24.521421 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:24.521380    2561 patch_prober.go:28] interesting pod/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:41:24.521595 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:24.521441    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:41:29.117166 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.117128    2561 generic.go:356] "Generic (PLEG): container finished" podID="7092bda4-f253-4bd8-83f0-993555aefc35" containerID="9c7ceaf535a7b16af5adb2462585d6a33c6cceb4f7cea2513641c5392425d7d5" exitCode=0
Jul 28 20:41:29.117618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.117222    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" event={"ID":"7092bda4-f253-4bd8-83f0-993555aefc35","Type":"ContainerDied","Data":"9c7ceaf535a7b16af5adb2462585d6a33c6cceb4f7cea2513641c5392425d7d5"}
Jul 28 20:41:29.117618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.117330    2561 scope.go:117] "RemoveContainer" containerID="ec928798ab11fd2d0bd401e6278dc5ba6e83f33a5547a9316ab5f76d0e627774"
Jul 28 20:41:29.193021 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.192956    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:41:29.288340 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288308    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-certs\") pod \"7092bda4-f253-4bd8-83f0-993555aefc35\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") "
Jul 28 20:41:29.288531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288352    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-data\") pod \"7092bda4-f253-4bd8-83f0-993555aefc35\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") "
Jul 28 20:41:29.288531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288369    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7092bda4-f253-4bd8-83f0-993555aefc35-istiod-ca-cert\") pod \"7092bda4-f253-4bd8-83f0-993555aefc35\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") "
Jul 28 20:41:29.288531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288389    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7092bda4-f253-4bd8-83f0-993555aefc35-istio-podinfo\") pod \"7092bda4-f253-4bd8-83f0-993555aefc35\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") "
Jul 28 20:41:29.288531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288427    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-envoy\") pod \"7092bda4-f253-4bd8-83f0-993555aefc35\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") "
Jul 28 20:41:29.288531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288448    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-credential-socket\") pod \"7092bda4-f253-4bd8-83f0-993555aefc35\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") "
Jul 28 20:41:29.288531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288467    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-istio-token\") pod \"7092bda4-f253-4bd8-83f0-993555aefc35\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") "
Jul 28 20:41:29.288531 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288513    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-socket\") pod \"7092bda4-f253-4bd8-83f0-993555aefc35\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") "
Jul 28 20:41:29.288869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288573    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fdx9\" (UniqueName: \"kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-kube-api-access-5fdx9\") pod \"7092bda4-f253-4bd8-83f0-993555aefc35\" (UID: \"7092bda4-f253-4bd8-83f0-993555aefc35\") "
Jul 28 20:41:29.288869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288672    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7092bda4-f253-4bd8-83f0-993555aefc35" (UID: "7092bda4-f253-4bd8-83f0-993555aefc35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:41:29.288869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288856    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:29.289010 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288886    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7092bda4-f253-4bd8-83f0-993555aefc35" (UID: "7092bda4-f253-4bd8-83f0-993555aefc35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:41:29.289010 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.288799    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7092bda4-f253-4bd8-83f0-993555aefc35-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7092bda4-f253-4bd8-83f0-993555aefc35" (UID: "7092bda4-f253-4bd8-83f0-993555aefc35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:41:29.289125 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.289023    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7092bda4-f253-4bd8-83f0-993555aefc35" (UID: "7092bda4-f253-4bd8-83f0-993555aefc35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:41:29.289213 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.289186    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-data" (OuterVolumeSpecName: "istio-data") pod "7092bda4-f253-4bd8-83f0-993555aefc35" (UID: "7092bda4-f253-4bd8-83f0-993555aefc35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:41:29.290883 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.290855    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7092bda4-f253-4bd8-83f0-993555aefc35-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7092bda4-f253-4bd8-83f0-993555aefc35" (UID: "7092bda4-f253-4bd8-83f0-993555aefc35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:41:29.290987 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.290922    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7092bda4-f253-4bd8-83f0-993555aefc35" (UID: "7092bda4-f253-4bd8-83f0-993555aefc35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:41:29.290987 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.290921    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-kube-api-access-5fdx9" (OuterVolumeSpecName: "kube-api-access-5fdx9") pod "7092bda4-f253-4bd8-83f0-993555aefc35" (UID: "7092bda4-f253-4bd8-83f0-993555aefc35"). InnerVolumeSpecName "kube-api-access-5fdx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:41:29.290987 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.290960    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-istio-token" (OuterVolumeSpecName: "istio-token") pod "7092bda4-f253-4bd8-83f0-993555aefc35" (UID: "7092bda4-f253-4bd8-83f0-993555aefc35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:41:29.392486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.390189    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:29.392486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.390226    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fdx9\" (UniqueName: \"kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-kube-api-access-5fdx9\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:29.392486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.390275    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:29.392486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.390297    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7092bda4-f253-4bd8-83f0-993555aefc35-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:29.392486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.390310    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7092bda4-f253-4bd8-83f0-993555aefc35-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:29.392486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.390323    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:29.392486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.390337    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7092bda4-f253-4bd8-83f0-993555aefc35-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:29.392486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:29.390354    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7092bda4-f253-4bd8-83f0-993555aefc35-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:41:30.124852 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:30.124827    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"
Jul 28 20:41:30.125229 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:30.124823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn" event={"ID":"7092bda4-f253-4bd8-83f0-993555aefc35","Type":"ContainerDied","Data":"5176c3667af046608545b4b68e441e1befd0058045015b404fa5f539cd731635"}
Jul 28 20:41:30.125229 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:30.124951    2561 scope.go:117] "RemoveContainer" containerID="9c7ceaf535a7b16af5adb2462585d6a33c6cceb4f7cea2513641c5392425d7d5"
Jul 28 20:41:30.167408 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:30.167379    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"]
Jul 28 20:41:30.172005 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:30.171979    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fd997c17-openshift-default-7d687cc8c6-f86cn"]
Jul 28 20:41:32.076394 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:32.076359    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" path="/var/lib/kubelet/pods/7092bda4-f253-4bd8-83f0-993555aefc35/volumes"
Jul 28 20:41:44.584961 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.584926    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"]
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585283    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="076d6330-f91f-45f3-939b-a5c24d47886b" containerName="payload-processing"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585296    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="076d6330-f91f-45f3-939b-a5c24d47886b" containerName="payload-processing"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585306    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46165625-afae-4ca7-881e-73c63895f7c8" containerName="payload-pre-processing"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585311    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="46165625-afae-4ca7-881e-73c63895f7c8" containerName="payload-pre-processing"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585320    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585328    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585341    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585346    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585365    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ea4a40-9ef4-4da5-b211-9a2b29932424" containerName="revoke-keys"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585370    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ea4a40-9ef4-4da5-b211-9a2b29932424" containerName="revoke-keys"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585427    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="84ea4a40-9ef4-4da5-b211-9a2b29932424" containerName="revoke-keys"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585437    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="076d6330-f91f-45f3-939b-a5c24d47886b" containerName="payload-processing"
Jul 28 20:41:44.585439 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585443    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="46165625-afae-4ca7-881e-73c63895f7c8" containerName="payload-pre-processing"
Jul 28 20:41:44.585830 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585449    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy"
Jul 28 20:41:44.585830 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.585455    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7092bda4-f253-4bd8-83f0-993555aefc35" containerName="istio-proxy"
Jul 28 20:41:44.590122 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.590106    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.592755 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.592736    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0cb82b97-openshift-default-dockercfg-qns7k\""
Jul 28 20:41:44.608936 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.608909    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"]
Jul 28 20:41:44.728898 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.728863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsz74\" (UniqueName: \"kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-kube-api-access-lsz74\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.728898 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.728901    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-socket\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.729120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.728918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-token\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.729120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.728942    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-envoy\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.729120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.728987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-data\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.729120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.729049    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-podinfo\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.729120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.729093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istiod-ca-cert\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.729120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.729117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-credential-socket\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.729344 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.729176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-certs\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.829949 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.829907    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istiod-ca-cert\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.829949 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.829953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-credential-socket\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.829995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-certs\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsz74\" (UniqueName: \"kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-kube-api-access-lsz74\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-socket\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-token\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-envoy\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-data\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-podinfo\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830695 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830646    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-socket\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830695 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830676    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-certs\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830873 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830747    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istiod-ca-cert\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830873 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830762    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-credential-socket\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.830873 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.830854    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-data\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.832592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.832575    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-envoy\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.832679 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.832663    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-podinfo\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.837691 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.837630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-token\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.837955 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.837934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsz74\" (UniqueName: \"kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-kube-api-access-lsz74\") pod \"e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") " pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:44.900881 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:44.900842    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:45.037685 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:45.037658    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"]
Jul 28 20:41:45.039613 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:41:45.039589    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8b7d2f_c31c_4009_8206_44bf0dc29f5b.slice/crio-025e7190a7dafd57730b72adb1c63f87ad52c9f7860dc047919e3439c9ed8f3f WatchSource:0}: Error finding container 025e7190a7dafd57730b72adb1c63f87ad52c9f7860dc047919e3439c9ed8f3f: Status 404 returned error can't find the container with id 025e7190a7dafd57730b72adb1c63f87ad52c9f7860dc047919e3439c9ed8f3f
Jul 28 20:41:45.042052 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:45.042020    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:41:45.042132 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:45.042083    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:41:45.042132 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:45.042109    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:41:45.207141 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:45.207103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" event={"ID":"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b","Type":"ContainerStarted","Data":"4733ce6fdef33e25be7422ea21c5b736b3a0ec66d13f1a2f3f3ff502919fcca6"}
Jul 28 20:41:45.207331 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:45.207166    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" event={"ID":"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b","Type":"ContainerStarted","Data":"025e7190a7dafd57730b72adb1c63f87ad52c9f7860dc047919e3439c9ed8f3f"}
Jul 28 20:41:45.231588 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:45.231537    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" podStartSLOduration=1.231519952 podStartE2EDuration="1.231519952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:41:45.228603493 +0000 UTC m=+2007.625306681" watchObservedRunningTime="2026-07-28 20:41:45.231519952 +0000 UTC m=+2007.628223174"
Jul 28 20:41:45.901690 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:45.901652    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:46.907265 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:46.907225    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:47.218355 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:47.218268    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:47.219299 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:47.219285    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:41:48.428756 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.428724    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"]
Jul 28 20:41:48.432404 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.432385    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:41:48.435838 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.435812    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0cb82b97\""
Jul 28 20:41:48.435944 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.435841    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0cb82b97-dockercfg-rch96\""
Jul 28 20:41:48.460780 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.460752    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"]
Jul 28 20:41:48.489103 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.489078    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"]
Jul 28 20:41:48.492411 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.492394    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:41:48.512792 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.512759    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"]
Jul 28 20:41:48.564987 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.564948    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d72e540-a7de-40d1-aff5-465627160312-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8\" (UID: \"5d72e540-a7de-40d1-aff5-465627160312\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:41:48.565175 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.565027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt7cd\" (UniqueName: \"kubernetes.io/projected/5d72e540-a7de-40d1-aff5-465627160312-kube-api-access-xt7cd\") pod \"payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8\" (UID: \"5d72e540-a7de-40d1-aff5-465627160312\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:41:48.665727 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.665691    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d72e540-a7de-40d1-aff5-465627160312-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8\" (UID: \"5d72e540-a7de-40d1-aff5-465627160312\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:41:48.665945 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.665755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eadba93e-c3ec-4455-a2ac-9a1f396066fb-plugins-config-volume\") pod \"payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9\" (UID: \"eadba93e-c3ec-4455-a2ac-9a1f396066fb\") " pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:41:48.665945 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.665782    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgqjk\" (UniqueName: \"kubernetes.io/projected/eadba93e-c3ec-4455-a2ac-9a1f396066fb-kube-api-access-bgqjk\") pod \"payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9\" (UID: \"eadba93e-c3ec-4455-a2ac-9a1f396066fb\") " pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:41:48.665945 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.665893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt7cd\" (UniqueName: \"kubernetes.io/projected/5d72e540-a7de-40d1-aff5-465627160312-kube-api-access-xt7cd\") pod \"payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8\" (UID: \"5d72e540-a7de-40d1-aff5-465627160312\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:41:48.666529 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.666504    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d72e540-a7de-40d1-aff5-465627160312-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8\" (UID: \"5d72e540-a7de-40d1-aff5-465627160312\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:41:48.674524 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.674500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt7cd\" (UniqueName: \"kubernetes.io/projected/5d72e540-a7de-40d1-aff5-465627160312-kube-api-access-xt7cd\") pod \"payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8\" (UID: \"5d72e540-a7de-40d1-aff5-465627160312\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:41:48.743150 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.743059    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:41:48.766663 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.766630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eadba93e-c3ec-4455-a2ac-9a1f396066fb-plugins-config-volume\") pod \"payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9\" (UID: \"eadba93e-c3ec-4455-a2ac-9a1f396066fb\") " pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:41:48.766800 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.766668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgqjk\" (UniqueName: \"kubernetes.io/projected/eadba93e-c3ec-4455-a2ac-9a1f396066fb-kube-api-access-bgqjk\") pod \"payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9\" (UID: \"eadba93e-c3ec-4455-a2ac-9a1f396066fb\") " pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:41:48.767340 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.767323    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eadba93e-c3ec-4455-a2ac-9a1f396066fb-plugins-config-volume\") pod \"payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9\" (UID: \"eadba93e-c3ec-4455-a2ac-9a1f396066fb\") " pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:41:48.775081 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.775059    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgqjk\" (UniqueName: \"kubernetes.io/projected/eadba93e-c3ec-4455-a2ac-9a1f396066fb-kube-api-access-bgqjk\") pod \"payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9\" (UID: \"eadba93e-c3ec-4455-a2ac-9a1f396066fb\") " pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:41:48.806140 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.806094    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:41:48.886223 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.886195    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"]
Jul 28 20:41:48.887447 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:41:48.887398    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d72e540_a7de_40d1_aff5_465627160312.slice/crio-3266b27de41f1d479436408527601aa82a8996e670a61fb65a7547536580c833 WatchSource:0}: Error finding container 3266b27de41f1d479436408527601aa82a8996e670a61fb65a7547536580c833: Status 404 returned error can't find the container with id 3266b27de41f1d479436408527601aa82a8996e670a61fb65a7547536580c833
Jul 28 20:41:48.964158 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:48.964131    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"]
Jul 28 20:41:48.966047 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:41:48.966024    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeadba93e_c3ec_4455_a2ac_9a1f396066fb.slice/crio-ed59479b4205bc045f6c55dc7b4574bbd70338f3772df1d85ed4f8df5d6bdc44 WatchSource:0}: Error finding container ed59479b4205bc045f6c55dc7b4574bbd70338f3772df1d85ed4f8df5d6bdc44: Status 404 returned error can't find the container with id ed59479b4205bc045f6c55dc7b4574bbd70338f3772df1d85ed4f8df5d6bdc44
Jul 28 20:41:49.229787 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:49.229748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9" event={"ID":"eadba93e-c3ec-4455-a2ac-9a1f396066fb","Type":"ContainerStarted","Data":"ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9"}
Jul 28 20:41:49.229985 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:49.229815    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:41:49.229985 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:49.229836    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9" event={"ID":"eadba93e-c3ec-4455-a2ac-9a1f396066fb","Type":"ContainerStarted","Data":"ed59479b4205bc045f6c55dc7b4574bbd70338f3772df1d85ed4f8df5d6bdc44"}
Jul 28 20:41:49.231493 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:49.231464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8" event={"ID":"5d72e540-a7de-40d1-aff5-465627160312","Type":"ContainerStarted","Data":"6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e"}
Jul 28 20:41:49.231615 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:49.231524    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:41:49.231615 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:49.231547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8" event={"ID":"5d72e540-a7de-40d1-aff5-465627160312","Type":"ContainerStarted","Data":"3266b27de41f1d479436408527601aa82a8996e670a61fb65a7547536580c833"}
Jul 28 20:41:49.249276 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:49.249163    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9" podStartSLOduration=1.24914805 podStartE2EDuration="1.24914805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:41:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:41:49.246817482 +0000 UTC m=+2011.643520668" watchObservedRunningTime="2026-07-28 20:41:49.24914805 +0000 UTC m=+2011.645851205"
Jul 28 20:41:49.269815 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:41:49.269764    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8" podStartSLOduration=1.269749097 podStartE2EDuration="1.269749097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:41:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:41:49.267210434 +0000 UTC m=+2011.663913603" watchObservedRunningTime="2026-07-28 20:41:49.269749097 +0000 UTC m=+2011.666452252"
Jul 28 20:42:00.240480 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:00.240404    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:42:00.240480 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:00.240486    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:42:00.295466 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:00.295432    2561 generic.go:356] "Generic (PLEG): container finished" podID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerID="4733ce6fdef33e25be7422ea21c5b736b3a0ec66d13f1a2f3f3ff502919fcca6" exitCode=0
Jul 28 20:42:00.295637 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:00.295504    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" event={"ID":"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b","Type":"ContainerDied","Data":"4733ce6fdef33e25be7422ea21c5b736b3a0ec66d13f1a2f3f3ff502919fcca6"}
Jul 28 20:42:00.295933 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:00.295917    2561 scope.go:117] "RemoveContainer" containerID="4733ce6fdef33e25be7422ea21c5b736b3a0ec66d13f1a2f3f3ff502919fcca6"
Jul 28 20:42:00.297028 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:00.296999    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:42:00.297107 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:00.297081    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:42:00.297146 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:00.297131    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:42:01.307335 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:01.307296    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" event={"ID":"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b","Type":"ContainerStarted","Data":"002e4ffb9d3ad639c87b45ded6afa6cc90c2fd36971dce9893b21a0ab71dc06b"}
Jul 28 20:42:01.903799 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:01.903760    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:42:01.908395 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:01.908361    2561 patch_prober.go:28] interesting pod/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 28 20:42:01.908642 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:01.908612    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 28 20:42:02.219135 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:02.219021    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:42:02.902326 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:02.902283    2561 patch_prober.go:28] interesting pod/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 28 20:42:02.903444 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:02.903406    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 28 20:42:03.902332 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:03.902287    2561 patch_prober.go:28] interesting pod/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 28 20:42:03.902846 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:03.902356    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 28 20:42:04.901508 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:04.901470    2561 patch_prober.go:28] interesting pod/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 28 20:42:04.901814 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:04.901784    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 28 20:42:05.905108 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:05.905078    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:42:05.906078 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:05.906059    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:42:46.765060 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:46.765024    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"]
Jul 28 20:42:46.768572 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:46.768555    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"
Jul 28 20:42:46.771282 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:46.771263    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 20:42:46.772321 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:46.772299    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:42:46.776743 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:46.776721    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"]
Jul 28 20:42:46.887425 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:46.887382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04aff41c-16c0-45d1-80c0-3d3f3573f3dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq\" (UID: \"04aff41c-16c0-45d1-80c0-3d3f3573f3dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"
Jul 28 20:42:46.988744 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:46.988705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04aff41c-16c0-45d1-80c0-3d3f3573f3dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq\" (UID: \"04aff41c-16c0-45d1-80c0-3d3f3573f3dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"
Jul 28 20:42:46.989403 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:46.989382    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04aff41c-16c0-45d1-80c0-3d3f3573f3dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq\" (UID: \"04aff41c-16c0-45d1-80c0-3d3f3573f3dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"
Jul 28 20:42:47.081583 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:47.081497    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"
Jul 28 20:42:47.229304 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:47.229265    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"]
Jul 28 20:42:47.233567 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:42:47.233538    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04aff41c_16c0_45d1_80c0_3d3f3573f3dc.slice/crio-b5d6af5c111b3ad90c669973411b9e70f00f5d7fbfa392b7b90471dec8ce8915 WatchSource:0}: Error finding container b5d6af5c111b3ad90c669973411b9e70f00f5d7fbfa392b7b90471dec8ce8915: Status 404 returned error can't find the container with id b5d6af5c111b3ad90c669973411b9e70f00f5d7fbfa392b7b90471dec8ce8915
Jul 28 20:42:47.564032 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:47.563997    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq" event={"ID":"04aff41c-16c0-45d1-80c0-3d3f3573f3dc","Type":"ContainerStarted","Data":"3c9ed78211ed59f4b144fd9dfb428842aa825b322aad74ad4e4855d05efe6798"}
Jul 28 20:42:47.564246 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:47.564070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq" event={"ID":"04aff41c-16c0-45d1-80c0-3d3f3573f3dc","Type":"ContainerStarted","Data":"b5d6af5c111b3ad90c669973411b9e70f00f5d7fbfa392b7b90471dec8ce8915"}
Jul 28 20:42:47.583190 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:47.583136    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq" podStartSLOduration=1.583120971 podStartE2EDuration="1.583120971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:42:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:42:47.580329847 +0000 UTC m=+2069.977033006" watchObservedRunningTime="2026-07-28 20:42:47.583120971 +0000 UTC m=+2069.979824124"
Jul 28 20:42:48.570417 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:48.570379    2561 generic.go:356] "Generic (PLEG): container finished" podID="04aff41c-16c0-45d1-80c0-3d3f3573f3dc" containerID="3c9ed78211ed59f4b144fd9dfb428842aa825b322aad74ad4e4855d05efe6798" exitCode=0
Jul 28 20:42:48.570841 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:48.570464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq" event={"ID":"04aff41c-16c0-45d1-80c0-3d3f3573f3dc","Type":"ContainerDied","Data":"3c9ed78211ed59f4b144fd9dfb428842aa825b322aad74ad4e4855d05efe6798"}
Jul 28 20:42:49.714446 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:49.714419    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"
Jul 28 20:42:49.815571 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:49.815535    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04aff41c-16c0-45d1-80c0-3d3f3573f3dc-maas-api-service-ca\") pod \"04aff41c-16c0-45d1-80c0-3d3f3573f3dc\" (UID: \"04aff41c-16c0-45d1-80c0-3d3f3573f3dc\") "
Jul 28 20:42:49.815901 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:49.815877    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04aff41c-16c0-45d1-80c0-3d3f3573f3dc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "04aff41c-16c0-45d1-80c0-3d3f3573f3dc" (UID: "04aff41c-16c0-45d1-80c0-3d3f3573f3dc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:42:49.916967 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:49.916869    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04aff41c-16c0-45d1-80c0-3d3f3573f3dc-maas-api-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:42:50.582680 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:50.582647    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"
Jul 28 20:42:50.582680 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:50.582674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq" event={"ID":"04aff41c-16c0-45d1-80c0-3d3f3573f3dc","Type":"ContainerDied","Data":"b5d6af5c111b3ad90c669973411b9e70f00f5d7fbfa392b7b90471dec8ce8915"}
Jul 28 20:42:50.582898 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:42:50.582721    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5d6af5c111b3ad90c669973411b9e70f00f5d7fbfa392b7b90471dec8ce8915"
Jul 28 20:43:02.349457 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.349416    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"]
Jul 28 20:43:02.349850 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.349673    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9" podUID="eadba93e-c3ec-4455-a2ac-9a1f396066fb" containerName="payload-processing" containerID="cri-o://ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9" gracePeriod=30
Jul 28 20:43:02.356885 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.356856    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"]
Jul 28 20:43:02.357341 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.357096    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8" podUID="5d72e540-a7de-40d1-aff5-465627160312" containerName="payload-pre-processing" containerID="cri-o://6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e" gracePeriod=30
Jul 28 20:43:02.516426 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.516357    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"]
Jul 28 20:43:02.520211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.520166    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cb82b97-sdvxq"]
Jul 28 20:43:02.615320 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.615252    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:43:02.626120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.626091    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgqjk\" (UniqueName: \"kubernetes.io/projected/eadba93e-c3ec-4455-a2ac-9a1f396066fb-kube-api-access-bgqjk\") pod \"eadba93e-c3ec-4455-a2ac-9a1f396066fb\" (UID: \"eadba93e-c3ec-4455-a2ac-9a1f396066fb\") "
Jul 28 20:43:02.626315 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.626153    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eadba93e-c3ec-4455-a2ac-9a1f396066fb-plugins-config-volume\") pod \"eadba93e-c3ec-4455-a2ac-9a1f396066fb\" (UID: \"eadba93e-c3ec-4455-a2ac-9a1f396066fb\") "
Jul 28 20:43:02.626619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.626592    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eadba93e-c3ec-4455-a2ac-9a1f396066fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eadba93e-c3ec-4455-a2ac-9a1f396066fb" (UID: "eadba93e-c3ec-4455-a2ac-9a1f396066fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:43:02.628106 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.628082    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eadba93e-c3ec-4455-a2ac-9a1f396066fb-kube-api-access-bgqjk" (OuterVolumeSpecName: "kube-api-access-bgqjk") pod "eadba93e-c3ec-4455-a2ac-9a1f396066fb" (UID: "eadba93e-c3ec-4455-a2ac-9a1f396066fb"). InnerVolumeSpecName "kube-api-access-bgqjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:43:02.643371 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.643348    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:43:02.649783 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.649755    2561 generic.go:356] "Generic (PLEG): container finished" podID="eadba93e-c3ec-4455-a2ac-9a1f396066fb" containerID="ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9" exitCode=0
Jul 28 20:43:02.649921 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.649807    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"
Jul 28 20:43:02.649921 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.649832    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9" event={"ID":"eadba93e-c3ec-4455-a2ac-9a1f396066fb","Type":"ContainerDied","Data":"ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9"}
Jul 28 20:43:02.649921 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.649885    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9" event={"ID":"eadba93e-c3ec-4455-a2ac-9a1f396066fb","Type":"ContainerDied","Data":"ed59479b4205bc045f6c55dc7b4574bbd70338f3772df1d85ed4f8df5d6bdc44"}
Jul 28 20:43:02.649921 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.649905    2561 scope.go:117] "RemoveContainer" containerID="ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9"
Jul 28 20:43:02.651259 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.651220    2561 generic.go:356] "Generic (PLEG): container finished" podID="5d72e540-a7de-40d1-aff5-465627160312" containerID="6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e" exitCode=0
Jul 28 20:43:02.651387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.651270    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"
Jul 28 20:43:02.651387 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.651267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8" event={"ID":"5d72e540-a7de-40d1-aff5-465627160312","Type":"ContainerDied","Data":"6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e"}
Jul 28 20:43:02.651512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.651401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8" event={"ID":"5d72e540-a7de-40d1-aff5-465627160312","Type":"ContainerDied","Data":"3266b27de41f1d479436408527601aa82a8996e670a61fb65a7547536580c833"}
Jul 28 20:43:02.659600 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.659542    2561 scope.go:117] "RemoveContainer" containerID="ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9"
Jul 28 20:43:02.660072 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:43:02.660046    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9\": container with ID starting with ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9 not found: ID does not exist" containerID="ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9"
Jul 28 20:43:02.660185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.660083    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9"} err="failed to get container status \"ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9\": rpc error: code = NotFound desc = could not find container \"ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9\": container with ID starting with ffbb42f6d22f7145af776df2120975676853561496bb7b150e77169c780f2fa9 not found: ID does not exist"
Jul 28 20:43:02.660185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.660107    2561 scope.go:117] "RemoveContainer" containerID="6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e"
Jul 28 20:43:02.670748 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.670726    2561 scope.go:117] "RemoveContainer" containerID="6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e"
Jul 28 20:43:02.671212 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:43:02.671175    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e\": container with ID starting with 6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e not found: ID does not exist" containerID="6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e"
Jul 28 20:43:02.671345 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.671224    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e"} err="failed to get container status \"6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e\": rpc error: code = NotFound desc = could not find container \"6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e\": container with ID starting with 6dac4a9df29e364b44b5384adc55ff4169b24fd3256470b063f5d7f33df7ee9e not found: ID does not exist"
Jul 28 20:43:02.674202 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.674179    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"]
Jul 28 20:43:02.677000 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.676979    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cb82b97-65df47b746-gmvd9"]
Jul 28 20:43:02.726880 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.726842    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d72e540-a7de-40d1-aff5-465627160312-plugins-config-volume\") pod \"5d72e540-a7de-40d1-aff5-465627160312\" (UID: \"5d72e540-a7de-40d1-aff5-465627160312\") "
Jul 28 20:43:02.726880 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.726884    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt7cd\" (UniqueName: \"kubernetes.io/projected/5d72e540-a7de-40d1-aff5-465627160312-kube-api-access-xt7cd\") pod \"5d72e540-a7de-40d1-aff5-465627160312\" (UID: \"5d72e540-a7de-40d1-aff5-465627160312\") "
Jul 28 20:43:02.727140 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.727074    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgqjk\" (UniqueName: \"kubernetes.io/projected/eadba93e-c3ec-4455-a2ac-9a1f396066fb-kube-api-access-bgqjk\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:43:02.727140 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.727087    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eadba93e-c3ec-4455-a2ac-9a1f396066fb-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:43:02.727287 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.727263    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d72e540-a7de-40d1-aff5-465627160312-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d72e540-a7de-40d1-aff5-465627160312" (UID: "5d72e540-a7de-40d1-aff5-465627160312"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:43:02.729039 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.729017    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d72e540-a7de-40d1-aff5-465627160312-kube-api-access-xt7cd" (OuterVolumeSpecName: "kube-api-access-xt7cd") pod "5d72e540-a7de-40d1-aff5-465627160312" (UID: "5d72e540-a7de-40d1-aff5-465627160312"). InnerVolumeSpecName "kube-api-access-xt7cd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:43:02.828507 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.828470    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d72e540-a7de-40d1-aff5-465627160312-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:43:02.828507 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.828502    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt7cd\" (UniqueName: \"kubernetes.io/projected/5d72e540-a7de-40d1-aff5-465627160312-kube-api-access-xt7cd\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:43:02.973044 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.973010    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"]
Jul 28 20:43:02.977192 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:02.977162    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cb82b97-7dcd98b64-4mwl8"]
Jul 28 20:43:04.076193 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:04.076158    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04aff41c-16c0-45d1-80c0-3d3f3573f3dc" path="/var/lib/kubelet/pods/04aff41c-16c0-45d1-80c0-3d3f3573f3dc/volumes"
Jul 28 20:43:04.076596 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:04.076532    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d72e540-a7de-40d1-aff5-465627160312" path="/var/lib/kubelet/pods/5d72e540-a7de-40d1-aff5-465627160312/volumes"
Jul 28 20:43:04.076836 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:04.076823    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eadba93e-c3ec-4455-a2ac-9a1f396066fb" path="/var/lib/kubelet/pods/eadba93e-c3ec-4455-a2ac-9a1f396066fb/volumes"
Jul 28 20:43:18.274288 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:18.274257    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:43:18.276819 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:18.276801    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:43:18.300767 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:18.300738    2561 scope.go:117] "RemoveContainer" containerID="2409f1c8dceaee87582225affeab06656177b0647fe527c2e5021f43fbd63a90"
Jul 28 20:43:54.744597 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:54.744557    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"]
Jul 28 20:43:54.745066 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:54.744821    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy" containerID="cri-o://002e4ffb9d3ad639c87b45ded6afa6cc90c2fd36971dce9893b21a0ab71dc06b" gracePeriod=30
Jul 28 20:43:59.967267 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:59.967199    2561 generic.go:356] "Generic (PLEG): container finished" podID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerID="002e4ffb9d3ad639c87b45ded6afa6cc90c2fd36971dce9893b21a0ab71dc06b" exitCode=0
Jul 28 20:43:59.967748 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:59.967266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" event={"ID":"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b","Type":"ContainerDied","Data":"002e4ffb9d3ad639c87b45ded6afa6cc90c2fd36971dce9893b21a0ab71dc06b"}
Jul 28 20:43:59.967748 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:43:59.967357    2561 scope.go:117] "RemoveContainer" containerID="4733ce6fdef33e25be7422ea21c5b736b3a0ec66d13f1a2f3f3ff502919fcca6"
Jul 28 20:44:00.027183 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.027160    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:44:00.134960 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.134924    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-credential-socket\") pod \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") "
Jul 28 20:44:00.135295 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.134981    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsz74\" (UniqueName: \"kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-kube-api-access-lsz74\") pod \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") "
Jul 28 20:44:00.135295 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.134999    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-socket\") pod \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") "
Jul 28 20:44:00.135295 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135021    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istiod-ca-cert\") pod \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") "
Jul 28 20:44:00.135295 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135038    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-token\") pod \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") "
Jul 28 20:44:00.135295 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135064    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-envoy\") pod \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") "
Jul 28 20:44:00.135295 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135198    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-podinfo\") pod \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") "
Jul 28 20:44:00.135630 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135317    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-data\") pod \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") "
Jul 28 20:44:00.135630 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135333    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" (UID: "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:44:00.135630 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135343    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" (UID: "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:44:00.135630 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135377    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-certs\") pod \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\" (UID: \"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b\") "
Jul 28 20:44:00.135630 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135582    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" (UID: "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:44:00.135880 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135676    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:44:00.135880 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135695    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:44:00.135880 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135711    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:44:00.135880 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.135782    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" (UID: "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:44:00.136360 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.136335    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" (UID: "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:44:00.137368 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.137347    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-kube-api-access-lsz74" (OuterVolumeSpecName: "kube-api-access-lsz74") pod "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" (UID: "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b"). InnerVolumeSpecName "kube-api-access-lsz74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:44:00.137457 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.137436    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" (UID: "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:44:00.137700 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.137680    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" (UID: "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:44:00.137700 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.137698    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" (UID: "7e8b7d2f-c31c-4009-8206-44bf0dc29f5b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:44:00.236684 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.236654    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:44:00.236684 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.236680    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:44:00.236684 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.236688    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:44:00.236684 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.236697    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:44:00.236966 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.236706    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsz74\" (UniqueName: \"kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-kube-api-access-lsz74\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:44:00.236966 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.236714    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:44:00.973643 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.973601    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52" event={"ID":"7e8b7d2f-c31c-4009-8206-44bf0dc29f5b","Type":"ContainerDied","Data":"025e7190a7dafd57730b72adb1c63f87ad52c9f7860dc047919e3439c9ed8f3f"}
Jul 28 20:44:00.974082 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.973679    2561 scope.go:117] "RemoveContainer" containerID="002e4ffb9d3ad639c87b45ded6afa6cc90c2fd36971dce9893b21a0ab71dc06b"
Jul 28 20:44:00.974082 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.973752    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"
Jul 28 20:44:00.999213 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:00.999181    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"]
Jul 28 20:44:01.005527 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:01.005501    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0cb82b97-openshift-default-569f7479b8-ftt52"]
Jul 28 20:44:02.076709 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:02.076674    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" path="/var/lib/kubelet/pods/7e8b7d2f-c31c-4009-8206-44bf0dc29f5b/volumes"
Jul 28 20:44:18.329398 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:18.329312    2561 scope.go:117] "RemoveContainer" containerID="d3b8c3f8f20658ec16139077693781710f88b440a2a01764115afa088450dd2b"
Jul 28 20:44:18.337621 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:18.337605    2561 scope.go:117] "RemoveContainer" containerID="0adbbf58e39438a748e29415b3bb720d319f440a894d3e38cc7591c736fb0468"
Jul 28 20:44:53.375048 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375014    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"]
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375366    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04aff41c-16c0-45d1-80c0-3d3f3573f3dc" containerName="revoke-keys"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375377    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04aff41c-16c0-45d1-80c0-3d3f3573f3dc" containerName="revoke-keys"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375389    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375394    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375403    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d72e540-a7de-40d1-aff5-465627160312" containerName="payload-pre-processing"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375409    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d72e540-a7de-40d1-aff5-465627160312" containerName="payload-pre-processing"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375414    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375419    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375427    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eadba93e-c3ec-4455-a2ac-9a1f396066fb" containerName="payload-processing"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375432    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eadba93e-c3ec-4455-a2ac-9a1f396066fb" containerName="payload-processing"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375483    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="04aff41c-16c0-45d1-80c0-3d3f3573f3dc" containerName="revoke-keys"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375490    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375497    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d72e540-a7de-40d1-aff5-465627160312" containerName="payload-pre-processing"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375504    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e8b7d2f-c31c-4009-8206-44bf0dc29f5b" containerName="istio-proxy"
Jul 28 20:44:53.375515 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.375511    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eadba93e-c3ec-4455-a2ac-9a1f396066fb" containerName="payload-processing"
Jul 28 20:44:53.378486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.378471    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.381637 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.381616    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d82230-openshift-default-dockercfg-g5d4m\""
Jul 28 20:44:53.391856 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.391835    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"]
Jul 28 20:44:53.399174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.399140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9c2r\" (UniqueName: \"kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-kube-api-access-k9c2r\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.399307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.399183    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-credential-socket\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.399307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.399210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd6ef6e0-9bee-4505-9efe-90815433366d-istiod-ca-cert\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.399307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.399293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-data\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.399423 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.399334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-certs\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.399423 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.399350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-token\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.399423 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.399370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-envoy\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.399519 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.399466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-socket\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.399519 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.399486    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-podinfo\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500280 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-socket\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500280 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-podinfo\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500554 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9c2r\" (UniqueName: \"kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-kube-api-access-k9c2r\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500554 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500343    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-credential-socket\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500554 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd6ef6e0-9bee-4505-9efe-90815433366d-istiod-ca-cert\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500554 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500396    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-data\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500554 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-certs\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500554 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500455    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-token\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500554 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-envoy\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500892 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-socket\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500892 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500760    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-credential-socket\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.500892 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-certs\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.501017 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.500934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-data\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.501104 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.501083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd6ef6e0-9bee-4505-9efe-90815433366d-istiod-ca-cert\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.502803 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.502772    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-envoy\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.502924 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.502904    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-podinfo\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.508523 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.508503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-token\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.508635 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.508617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9c2r\" (UniqueName: \"kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-kube-api-access-k9c2r\") pod \"e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") " pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.689690 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.689599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:53.834256 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.834213    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"]
Jul 28 20:44:53.836147 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:44:53.836115    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6ef6e0_9bee_4505_9efe_90815433366d.slice/crio-61668f82fae5df7ec92d194444ab776fa2ea00733003768e8079461257b184fe WatchSource:0}: Error finding container 61668f82fae5df7ec92d194444ab776fa2ea00733003768e8079461257b184fe: Status 404 returned error can't find the container with id 61668f82fae5df7ec92d194444ab776fa2ea00733003768e8079461257b184fe
Jul 28 20:44:53.838825 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.838793    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:44:53.838938 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.838870    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:44:53.838938 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:53.838913    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:44:54.249544 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:54.249505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" event={"ID":"dd6ef6e0-9bee-4505-9efe-90815433366d","Type":"ContainerStarted","Data":"d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f"}
Jul 28 20:44:54.249730 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:54.249569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" event={"ID":"dd6ef6e0-9bee-4505-9efe-90815433366d","Type":"ContainerStarted","Data":"61668f82fae5df7ec92d194444ab776fa2ea00733003768e8079461257b184fe"}
Jul 28 20:44:54.276988 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:54.276936    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" podStartSLOduration=1.27692035 podStartE2EDuration="1.27692035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:44:54.273038912 +0000 UTC m=+2196.669742069" watchObservedRunningTime="2026-07-28 20:44:54.27692035 +0000 UTC m=+2196.673623585"
Jul 28 20:44:54.690450 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:54.690411    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:54.695074 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:54.695050    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:55.256226 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:55.256196    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:55.257151 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:55.257133    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:44:57.225449 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.225410    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"]
Jul 28 20:44:57.228946 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.228929    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:44:57.231877 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.231852    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-d82230\""
Jul 28 20:44:57.244368 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.244339    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"]
Jul 28 20:44:57.332399 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.332358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200af2e4-64fc-4a4a-a38c-7b679abfdf35-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx\" (UID: \"200af2e4-64fc-4a4a-a38c-7b679abfdf35\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:44:57.332399 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.332400    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbv88\" (UniqueName: \"kubernetes.io/projected/200af2e4-64fc-4a4a-a38c-7b679abfdf35-kube-api-access-bbv88\") pod \"payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx\" (UID: \"200af2e4-64fc-4a4a-a38c-7b679abfdf35\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:44:57.433436 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.433400    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200af2e4-64fc-4a4a-a38c-7b679abfdf35-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx\" (UID: \"200af2e4-64fc-4a4a-a38c-7b679abfdf35\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:44:57.433436 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.433436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbv88\" (UniqueName: \"kubernetes.io/projected/200af2e4-64fc-4a4a-a38c-7b679abfdf35-kube-api-access-bbv88\") pod \"payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx\" (UID: \"200af2e4-64fc-4a4a-a38c-7b679abfdf35\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:44:57.434204 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.434178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200af2e4-64fc-4a4a-a38c-7b679abfdf35-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx\" (UID: \"200af2e4-64fc-4a4a-a38c-7b679abfdf35\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:44:57.442352 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.442328    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbv88\" (UniqueName: \"kubernetes.io/projected/200af2e4-64fc-4a4a-a38c-7b679abfdf35-kube-api-access-bbv88\") pod \"payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx\" (UID: \"200af2e4-64fc-4a4a-a38c-7b679abfdf35\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:44:57.539635 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.539599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:44:57.674691 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:57.674668    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"]
Jul 28 20:44:57.676704 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:44:57.676673    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200af2e4_64fc_4a4a_a38c_7b679abfdf35.slice/crio-62e46a0b6e5fa557ad5341e77c77843c40be2a56d8bca5726f5c5533c01eec85 WatchSource:0}: Error finding container 62e46a0b6e5fa557ad5341e77c77843c40be2a56d8bca5726f5c5533c01eec85: Status 404 returned error can't find the container with id 62e46a0b6e5fa557ad5341e77c77843c40be2a56d8bca5726f5c5533c01eec85
Jul 28 20:44:58.273425 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:58.273385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx" event={"ID":"200af2e4-64fc-4a4a-a38c-7b679abfdf35","Type":"ContainerStarted","Data":"e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913"}
Jul 28 20:44:58.273815 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:58.273451    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx" event={"ID":"200af2e4-64fc-4a4a-a38c-7b679abfdf35","Type":"ContainerStarted","Data":"62e46a0b6e5fa557ad5341e77c77843c40be2a56d8bca5726f5c5533c01eec85"}
Jul 28 20:44:58.273815 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:58.273556    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:44:58.292684 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:44:58.292632    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx" podStartSLOduration=1.2926175579999999 podStartE2EDuration="1.292617558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:44:58.289561567 +0000 UTC m=+2200.686264723" watchObservedRunningTime="2026-07-28 20:44:58.292617558 +0000 UTC m=+2200.689320713"
Jul 28 20:45:00.139280 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.139222    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc"]
Jul 28 20:45:00.142853 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.142834    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8"]
Jul 28 20:45:00.142991 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.142966    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc"
Jul 28 20:45:00.145445 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.145428    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 20:45:00.145810 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.145796    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8"
Jul 28 20:45:00.150678 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.150649    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8"]
Jul 28 20:45:00.155246 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.155207    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc"]
Jul 28 20:45:00.156006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.155985    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc"
Jul 28 20:45:00.167527 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.167507    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8"
Jul 28 20:45:00.311556 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.311518    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc"]
Jul 28 20:45:00.313866 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:45:00.313837    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb39d93_bc08_4e9a_83c8_a94c50335167.slice/crio-bcf9924f9653c475f4950e48c73e421ece91fa87e2dfb82af9bc2fd7a31fe3b1 WatchSource:0}: Error finding container bcf9924f9653c475f4950e48c73e421ece91fa87e2dfb82af9bc2fd7a31fe3b1: Status 404 returned error can't find the container with id bcf9924f9653c475f4950e48c73e421ece91fa87e2dfb82af9bc2fd7a31fe3b1
Jul 28 20:45:00.337935 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:00.337901    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8"]
Jul 28 20:45:00.341054 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:45:00.341027    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4060a535_1782_4a46_8f5a_c3645fc1d7ea.slice/crio-2bc637d248634c238fbba2272be8d22e2985f2ef810716aaae37ae19515e6573 WatchSource:0}: Error finding container 2bc637d248634c238fbba2272be8d22e2985f2ef810716aaae37ae19515e6573: Status 404 returned error can't find the container with id 2bc637d248634c238fbba2272be8d22e2985f2ef810716aaae37ae19515e6573
Jul 28 20:45:01.298486 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:01.298447    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8" event={"ID":"4060a535-1782-4a46-8f5a-c3645fc1d7ea","Type":"ContainerStarted","Data":"f83f6a0e43bdca5b2539f19ab0e71445221fb66b518b585e7c51bc45aaa592c2"}
Jul 28 20:45:01.298913 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:01.298510    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8" event={"ID":"4060a535-1782-4a46-8f5a-c3645fc1d7ea","Type":"ContainerStarted","Data":"2bc637d248634c238fbba2272be8d22e2985f2ef810716aaae37ae19515e6573"}
Jul 28 20:45:01.300168 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:01.300140    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerID="001b66597ab412a6ccdbc855215b1c7d2d191ac9a1a8bed565ace2c834e82bd4" exitCode=7
Jul 28 20:45:01.300325 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:01.300182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc" event={"ID":"dfb39d93-bc08-4e9a-83c8-a94c50335167","Type":"ContainerDied","Data":"001b66597ab412a6ccdbc855215b1c7d2d191ac9a1a8bed565ace2c834e82bd4"}
Jul 28 20:45:01.300325 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:01.300224    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc" event={"ID":"dfb39d93-bc08-4e9a-83c8-a94c50335167","Type":"ContainerStarted","Data":"bcf9924f9653c475f4950e48c73e421ece91fa87e2dfb82af9bc2fd7a31fe3b1"}
Jul 28 20:45:01.300447 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:01.300387    2561 scope.go:117] "RemoveContainer" containerID="001b66597ab412a6ccdbc855215b1c7d2d191ac9a1a8bed565ace2c834e82bd4"
Jul 28 20:45:01.315776 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:01.315733    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8" podStartSLOduration=1.31571569 podStartE2EDuration="1.31571569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:01.314063648 +0000 UTC m=+2203.710766831" watchObservedRunningTime="2026-07-28 20:45:01.31571569 +0000 UTC m=+2203.712418845"
Jul 28 20:45:02.306618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:02.306583    2561 generic.go:356] "Generic (PLEG): container finished" podID="4060a535-1782-4a46-8f5a-c3645fc1d7ea" containerID="f83f6a0e43bdca5b2539f19ab0e71445221fb66b518b585e7c51bc45aaa592c2" exitCode=0
Jul 28 20:45:02.307042 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:02.306652    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8" event={"ID":"4060a535-1782-4a46-8f5a-c3645fc1d7ea","Type":"ContainerDied","Data":"f83f6a0e43bdca5b2539f19ab0e71445221fb66b518b585e7c51bc45aaa592c2"}
Jul 28 20:45:02.308422 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:02.308397    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerID="756d3bbd600283d73e36ded800f0d39721c218faba91c71e2733c463febeea69" exitCode=7
Jul 28 20:45:02.308526 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:02.308456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc" event={"ID":"dfb39d93-bc08-4e9a-83c8-a94c50335167","Type":"ContainerDied","Data":"756d3bbd600283d73e36ded800f0d39721c218faba91c71e2733c463febeea69"}
Jul 28 20:45:02.308526 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:02.308496    2561 scope.go:117] "RemoveContainer" containerID="001b66597ab412a6ccdbc855215b1c7d2d191ac9a1a8bed565ace2c834e82bd4"
Jul 28 20:45:02.308634 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:02.308618    2561 scope.go:117] "RemoveContainer" containerID="756d3bbd600283d73e36ded800f0d39721c218faba91c71e2733c463febeea69"
Jul 28 20:45:02.308887 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:45:02.308869    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc_odh-ai-gateway-infra(dfb39d93-bc08-4e9a-83c8-a94c50335167)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167"
Jul 28 20:45:03.318721 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:03.318690    2561 scope.go:117] "RemoveContainer" containerID="756d3bbd600283d73e36ded800f0d39721c218faba91c71e2733c463febeea69"
Jul 28 20:45:03.319222 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:45:03.318953    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc_odh-ai-gateway-infra(dfb39d93-bc08-4e9a-83c8-a94c50335167)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167"
Jul 28 20:45:03.468466 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:03.468441    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8"
Jul 28 20:45:04.325932 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:04.325901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8" event={"ID":"4060a535-1782-4a46-8f5a-c3645fc1d7ea","Type":"ContainerDied","Data":"2bc637d248634c238fbba2272be8d22e2985f2ef810716aaae37ae19515e6573"}
Jul 28 20:45:04.325932 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:04.325928    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754525-msjj8"
Jul 28 20:45:04.326367 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:04.325951    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bc637d248634c238fbba2272be8d22e2985f2ef810716aaae37ae19515e6573"
Jul 28 20:45:09.285427 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:09.285395    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:45:10.257711 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:10.257675    2561 patch_prober.go:28] interesting pod/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 20:45:10.257920 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:10.257747    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 20:45:10.363526 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:10.363490    2561 generic.go:356] "Generic (PLEG): container finished" podID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerID="d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f" exitCode=0
Jul 28 20:45:10.363933 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:10.363564    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" event={"ID":"dd6ef6e0-9bee-4505-9efe-90815433366d","Type":"ContainerDied","Data":"d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f"}
Jul 28 20:45:10.363978 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:10.363956    2561 scope.go:117] "RemoveContainer" containerID="d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f"
Jul 28 20:45:10.364924 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:10.364899    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:45:10.364980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:10.364963    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:45:10.365031 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:10.365018    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:45:11.370599 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:11.370569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" event={"ID":"dd6ef6e0-9bee-4505-9efe-90815433366d","Type":"ContainerStarted","Data":"fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304"}
Jul 28 20:45:11.690895 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:11.690791    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:45:11.691318 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:11.691194    2561 patch_prober.go:28] interesting pod/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 20:45:11.691513 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:11.691486    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 20:45:12.690662 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:12.690627    2561 patch_prober.go:28] interesting pod/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 20:45:12.691272 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:12.691222    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 20:45:13.690283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:13.690211    2561 patch_prober.go:28] interesting pod/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 20:45:13.690495 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:13.690311    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 20:45:14.690325 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:14.690287    2561 patch_prober.go:28] interesting pod/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 28 20:45:14.691397 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:14.690965    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 28 20:45:15.693780 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:15.693746    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:45:15.694265 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:15.694118    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:45:15.694878 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:15.694857    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:45:16.071291 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:16.071222    2561 scope.go:117] "RemoveContainer" containerID="756d3bbd600283d73e36ded800f0d39721c218faba91c71e2733c463febeea69"
Jul 28 20:45:17.403805 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:17.403720    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerID="2ab75858115db2d6de238b3882b9a4328e87acca09bc8e4b084ea81b30ce8a4c" exitCode=0
Jul 28 20:45:17.403805 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:17.403790    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc" event={"ID":"dfb39d93-bc08-4e9a-83c8-a94c50335167","Type":"ContainerDied","Data":"2ab75858115db2d6de238b3882b9a4328e87acca09bc8e4b084ea81b30ce8a4c"}
Jul 28 20:45:17.404347 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:17.403852    2561 scope.go:117] "RemoveContainer" containerID="756d3bbd600283d73e36ded800f0d39721c218faba91c71e2733c463febeea69"
Jul 28 20:45:18.364537 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:18.364507    2561 scope.go:117] "RemoveContainer" containerID="7fd8a206e6d6dc9da603f335c1b67a4b13c644538375c28ff98dc1a18ad9ad75"
Jul 28 20:45:18.436176 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:18.436136    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc"]
Jul 28 20:45:18.549216 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:18.549192    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc"
Jul 28 20:45:19.423471 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:19.423441    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc"
Jul 28 20:45:19.423471 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:19.423445    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc" event={"ID":"dfb39d93-bc08-4e9a-83c8-a94c50335167","Type":"ContainerDied","Data":"bcf9924f9653c475f4950e48c73e421ece91fa87e2dfb82af9bc2fd7a31fe3b1"}
Jul 28 20:45:19.423726 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:19.423532    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcf9924f9653c475f4950e48c73e421ece91fa87e2dfb82af9bc2fd7a31fe3b1"
Jul 28 20:45:19.453366 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:19.453333    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc"]
Jul 28 20:45:19.462671 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:19.462646    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d82230-29754525-pw8cc"]
Jul 28 20:45:20.075922 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:20.075886    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167" path="/var/lib/kubelet/pods/dfb39d93-bc08-4e9a-83c8-a94c50335167/volumes"
Jul 28 20:45:21.992114 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992082    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"]
Jul 28 20:45:21.992528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992453    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4060a535-1782-4a46-8f5a-c3645fc1d7ea" containerName="cleanup"
Jul 28 20:45:21.992528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992465    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4060a535-1782-4a46-8f5a-c3645fc1d7ea" containerName="cleanup"
Jul 28 20:45:21.992528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992481    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerName="cleanup"
Jul 28 20:45:21.992528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992487    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerName="cleanup"
Jul 28 20:45:21.992528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992493    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerName="cleanup"
Jul 28 20:45:21.992528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992499    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerName="cleanup"
Jul 28 20:45:21.992528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992510    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerName="cleanup"
Jul 28 20:45:21.992528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992516    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerName="cleanup"
Jul 28 20:45:21.992779 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992567    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4060a535-1782-4a46-8f5a-c3645fc1d7ea" containerName="cleanup"
Jul 28 20:45:21.992779 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992576    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerName="cleanup"
Jul 28 20:45:21.992779 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992582    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerName="cleanup"
Jul 28 20:45:21.992779 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.992588    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb39d93-bc08-4e9a-83c8-a94c50335167" containerName="cleanup"
Jul 28 20:45:21.995876 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.995858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:21.998763 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:21.998745    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a7eeff-openshift-default-dockercfg-xnpzs\""
Jul 28 20:45:22.012154 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.012129    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"]
Jul 28 20:45:22.073158 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.073117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-data\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.073158 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.073159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istiod-ca-cert\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.073442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.073186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-socket\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.073442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.073229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-credential-socket\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.073442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.073288    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-podinfo\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.073442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.073337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmmdx\" (UniqueName: \"kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-kube-api-access-nmmdx\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.073442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.073364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-token\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.073442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.073405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-certs\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.073442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.073434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-envoy\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.174582 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.174542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-certs\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.174582 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.174584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-envoy\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.174856 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.174621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-data\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.174856 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.174649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istiod-ca-cert\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.174856 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.174679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-socket\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.174856 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.174725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-credential-socket\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.174856 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.174777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-podinfo\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.174856 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.174832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmmdx\" (UniqueName: \"kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-kube-api-access-nmmdx\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.175174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.174880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-token\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.175174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.174973    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-certs\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.175174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.175123    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-socket\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.175174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.175140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-data\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.175428 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.175348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-credential-socket\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.175511 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.175488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istiod-ca-cert\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.176969 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.176945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-envoy\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.177251 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.177216    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-podinfo\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.183636 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.183610    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-token\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.184050 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.184028    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmmdx\" (UniqueName: \"kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-kube-api-access-nmmdx\") pod \"e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") " pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.305806 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.305773    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:22.453443 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.453413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"]
Jul 28 20:45:22.454655 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:45:22.454630    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64bdbb20_a8f5_46d6_8d2c_d25aaf6bbadb.slice/crio-89d59a85bf3dbb1c5a652e9af92bbe6daf154017e9c015d6eaf479a4e668f479 WatchSource:0}: Error finding container 89d59a85bf3dbb1c5a652e9af92bbe6daf154017e9c015d6eaf479a4e668f479: Status 404 returned error can't find the container with id 89d59a85bf3dbb1c5a652e9af92bbe6daf154017e9c015d6eaf479a4e668f479
Jul 28 20:45:22.456931 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.456900    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:45:22.457036 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.456968    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:45:22.457036 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:22.456997    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:45:23.446324 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:23.446286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" event={"ID":"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb","Type":"ContainerStarted","Data":"6847250c56907cc10df25e39a20f91b64044aea76d38da491e78b9fceadcbb48"}
Jul 28 20:45:23.446844 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:23.446353    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" event={"ID":"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb","Type":"ContainerStarted","Data":"89d59a85bf3dbb1c5a652e9af92bbe6daf154017e9c015d6eaf479a4e668f479"}
Jul 28 20:45:23.467769 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:23.467720    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" podStartSLOduration=2.467703373 podStartE2EDuration="2.467703373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:23.465150414 +0000 UTC m=+2225.861853569" watchObservedRunningTime="2026-07-28 20:45:23.467703373 +0000 UTC m=+2225.864406528"
Jul 28 20:45:24.306185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:24.306151    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:24.310982 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:24.310961    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:24.452224 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:24.452196    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:24.453170 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:24.453151    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:26.599863 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.599829    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"]
Jul 28 20:45:26.604023 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.603992    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:45:26.606785 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.606759    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-a7eeff\""
Jul 28 20:45:26.607057 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.606874    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-a7eeff-dockercfg-hz6st\""
Jul 28 20:45:26.616754 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.616713    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"]
Jul 28 20:45:26.721365 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.721329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82zlc\" (UniqueName: \"kubernetes.io/projected/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-kube-api-access-82zlc\") pod \"payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm\" (UID: \"5d249160-8f43-4d0b-9d93-0fc725ff0a3d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:45:26.721553 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.721481    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm\" (UID: \"5d249160-8f43-4d0b-9d93-0fc725ff0a3d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:45:26.822966 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.822928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm\" (UID: \"5d249160-8f43-4d0b-9d93-0fc725ff0a3d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:45:26.823139 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.822978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82zlc\" (UniqueName: \"kubernetes.io/projected/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-kube-api-access-82zlc\") pod \"payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm\" (UID: \"5d249160-8f43-4d0b-9d93-0fc725ff0a3d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:45:26.823661 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.823641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm\" (UID: \"5d249160-8f43-4d0b-9d93-0fc725ff0a3d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:45:26.831466 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.831443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82zlc\" (UniqueName: \"kubernetes.io/projected/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-kube-api-access-82zlc\") pod \"payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm\" (UID: \"5d249160-8f43-4d0b-9d93-0fc725ff0a3d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:45:26.922384 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:26.922296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:45:27.088574 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:45:27.088528    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d249160_8f43_4d0b_9d93_0fc725ff0a3d.slice/crio-ee88bdbd5e6d69d93c1496d7fd5c4e7c76dd800984222f6ddff76eaa370a4324 WatchSource:0}: Error finding container ee88bdbd5e6d69d93c1496d7fd5c4e7c76dd800984222f6ddff76eaa370a4324: Status 404 returned error can't find the container with id ee88bdbd5e6d69d93c1496d7fd5c4e7c76dd800984222f6ddff76eaa370a4324
Jul 28 20:45:27.091417 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:27.091393    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"]
Jul 28 20:45:27.469830 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:27.469794    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm" event={"ID":"5d249160-8f43-4d0b-9d93-0fc725ff0a3d","Type":"ContainerStarted","Data":"0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31"}
Jul 28 20:45:27.469980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:27.469853    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:45:27.469980 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:27.469870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm" event={"ID":"5d249160-8f43-4d0b-9d93-0fc725ff0a3d","Type":"ContainerStarted","Data":"ee88bdbd5e6d69d93c1496d7fd5c4e7c76dd800984222f6ddff76eaa370a4324"}
Jul 28 20:45:27.488897 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:27.488841    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm" podStartSLOduration=1.488827215 podStartE2EDuration="1.488827215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:45:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:45:27.486481308 +0000 UTC m=+2229.883184464" watchObservedRunningTime="2026-07-28 20:45:27.488827215 +0000 UTC m=+2229.885530370"
Jul 28 20:45:38.477282 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:38.477224    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:45:40.332136 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:40.330768    2561 patch_prober.go:28] interesting pod/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": read tcp 10.132.0.2:50996->10.132.0.66:15021: read: connection reset by peer" start-of-body=
Jul 28 20:45:40.332136 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:40.330866    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": read tcp 10.132.0.2:50996->10.132.0.66:15021: read: connection reset by peer"
Jul 28 20:45:40.549848 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:40.549733    2561 generic.go:356] "Generic (PLEG): container finished" podID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerID="6847250c56907cc10df25e39a20f91b64044aea76d38da491e78b9fceadcbb48" exitCode=0
Jul 28 20:45:40.549848 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:40.549814    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" event={"ID":"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb","Type":"ContainerDied","Data":"6847250c56907cc10df25e39a20f91b64044aea76d38da491e78b9fceadcbb48"}
Jul 28 20:45:40.550310 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:40.550294    2561 scope.go:117] "RemoveContainer" containerID="6847250c56907cc10df25e39a20f91b64044aea76d38da491e78b9fceadcbb48"
Jul 28 20:45:40.551337 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:40.551310    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:45:40.551436 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:40.551402    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:45:40.551501 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:40.551457    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:45:41.556656 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:41.556624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" event={"ID":"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb","Type":"ContainerStarted","Data":"fed05f44176f613fe0766be816efac294a251b6c11b471bf71102e9efa63f90c"}
Jul 28 20:45:42.306348 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:42.306288    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:42.306687 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:42.306662    2561 patch_prober.go:28] interesting pod/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 28 20:45:42.306861 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:42.306832    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 28 20:45:43.307295 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:43.307224    2561 patch_prober.go:28] interesting pod/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 28 20:45:43.307929 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:43.307893    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 28 20:45:44.306819 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:44.306771    2561 patch_prober.go:28] interesting pod/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 28 20:45:44.307039 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:44.306855    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 28 20:45:45.306208 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:45.306162    2561 patch_prober.go:28] interesting pod/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 28 20:45:45.306742 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:45.306219    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 28 20:45:46.309710 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:46.309679    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:46.310150 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:46.309960    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:45:46.310605 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:45:46.310587    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:47:16.526742 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:16.526655    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"]
Jul 28 20:47:16.530073 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:16.530055    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"
Jul 28 20:47:16.534162 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:16.534138    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:47:16.534327 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:16.534228    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 20:47:16.541836 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:16.541805    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"]
Jul 28 20:47:16.630086 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:16.630049    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/662b9326-76ef-42e7-bc62-9c638b52d3a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d82230-cpthc\" (UID: \"662b9326-76ef-42e7-bc62-9c638b52d3a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"
Jul 28 20:47:16.731310 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:16.731268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/662b9326-76ef-42e7-bc62-9c638b52d3a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d82230-cpthc\" (UID: \"662b9326-76ef-42e7-bc62-9c638b52d3a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"
Jul 28 20:47:16.731863 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:16.731845    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/662b9326-76ef-42e7-bc62-9c638b52d3a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d82230-cpthc\" (UID: \"662b9326-76ef-42e7-bc62-9c638b52d3a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"
Jul 28 20:47:16.840370 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:16.840277    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"
Jul 28 20:47:16.976037 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:16.976011    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"]
Jul 28 20:47:16.977726 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:47:16.977698    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662b9326_76ef_42e7_bc62_9c638b52d3a7.slice/crio-066884be18785040cfe833aa092c96e19f8eaadc09550e7e32b182a44226d6b4 WatchSource:0}: Error finding container 066884be18785040cfe833aa092c96e19f8eaadc09550e7e32b182a44226d6b4: Status 404 returned error can't find the container with id 066884be18785040cfe833aa092c96e19f8eaadc09550e7e32b182a44226d6b4
Jul 28 20:47:17.065526 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:17.065489    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc" event={"ID":"662b9326-76ef-42e7-bc62-9c638b52d3a7","Type":"ContainerStarted","Data":"066884be18785040cfe833aa092c96e19f8eaadc09550e7e32b182a44226d6b4"}
Jul 28 20:47:18.073078 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:18.073033    2561 generic.go:356] "Generic (PLEG): container finished" podID="662b9326-76ef-42e7-bc62-9c638b52d3a7" containerID="e6800844bdd80875e15ecf7f918537846952353e5583dca955d5497237aba428" exitCode=0
Jul 28 20:47:18.076850 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:18.076823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc" event={"ID":"662b9326-76ef-42e7-bc62-9c638b52d3a7","Type":"ContainerDied","Data":"e6800844bdd80875e15ecf7f918537846952353e5583dca955d5497237aba428"}
Jul 28 20:47:18.396502 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:18.396414    2561 scope.go:117] "RemoveContainer" containerID="1cbd8c2b9b2b1d8cad702f455d5045ad339be9d4a35666e3ce274c89da0c29bb"
Jul 28 20:47:19.214133 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:19.214108    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"
Jul 28 20:47:19.250591 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:19.250565    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/662b9326-76ef-42e7-bc62-9c638b52d3a7-maas-api-service-ca\") pod \"662b9326-76ef-42e7-bc62-9c638b52d3a7\" (UID: \"662b9326-76ef-42e7-bc62-9c638b52d3a7\") "
Jul 28 20:47:19.250917 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:19.250895    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/662b9326-76ef-42e7-bc62-9c638b52d3a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "662b9326-76ef-42e7-bc62-9c638b52d3a7" (UID: "662b9326-76ef-42e7-bc62-9c638b52d3a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:47:19.351559 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:19.351463    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/662b9326-76ef-42e7-bc62-9c638b52d3a7-maas-api-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:20.086772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:20.086750    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"
Jul 28 20:47:20.086772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:20.086761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc" event={"ID":"662b9326-76ef-42e7-bc62-9c638b52d3a7","Type":"ContainerDied","Data":"066884be18785040cfe833aa092c96e19f8eaadc09550e7e32b182a44226d6b4"}
Jul 28 20:47:20.086929 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:20.086799    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="066884be18785040cfe833aa092c96e19f8eaadc09550e7e32b182a44226d6b4"
Jul 28 20:47:27.363099 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.363066    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"]
Jul 28 20:47:27.363592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.363289    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx" podUID="200af2e4-64fc-4a4a-a38c-7b679abfdf35" containerName="payload-processing" containerID="cri-o://e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913" gracePeriod=30
Jul 28 20:47:27.618261 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.618177    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:47:27.691779 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.691745    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"]
Jul 28 20:47:27.697589 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.697559    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d82230-cpthc"]
Jul 28 20:47:27.729323 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.729285    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200af2e4-64fc-4a4a-a38c-7b679abfdf35-plugins-config-volume\") pod \"200af2e4-64fc-4a4a-a38c-7b679abfdf35\" (UID: \"200af2e4-64fc-4a4a-a38c-7b679abfdf35\") "
Jul 28 20:47:27.729511 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.729336    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbv88\" (UniqueName: \"kubernetes.io/projected/200af2e4-64fc-4a4a-a38c-7b679abfdf35-kube-api-access-bbv88\") pod \"200af2e4-64fc-4a4a-a38c-7b679abfdf35\" (UID: \"200af2e4-64fc-4a4a-a38c-7b679abfdf35\") "
Jul 28 20:47:27.729715 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.729692    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200af2e4-64fc-4a4a-a38c-7b679abfdf35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "200af2e4-64fc-4a4a-a38c-7b679abfdf35" (UID: "200af2e4-64fc-4a4a-a38c-7b679abfdf35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:47:27.731631 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.731607    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200af2e4-64fc-4a4a-a38c-7b679abfdf35-kube-api-access-bbv88" (OuterVolumeSpecName: "kube-api-access-bbv88") pod "200af2e4-64fc-4a4a-a38c-7b679abfdf35" (UID: "200af2e4-64fc-4a4a-a38c-7b679abfdf35"). InnerVolumeSpecName "kube-api-access-bbv88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:47:27.830645 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.830614    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200af2e4-64fc-4a4a-a38c-7b679abfdf35-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:27.830645 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:27.830642    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbv88\" (UniqueName: \"kubernetes.io/projected/200af2e4-64fc-4a4a-a38c-7b679abfdf35-kube-api-access-bbv88\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:28.077179 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:28.077143    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="662b9326-76ef-42e7-bc62-9c638b52d3a7" path="/var/lib/kubelet/pods/662b9326-76ef-42e7-bc62-9c638b52d3a7/volumes"
Jul 28 20:47:28.130592 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:28.130559    2561 generic.go:356] "Generic (PLEG): container finished" podID="200af2e4-64fc-4a4a-a38c-7b679abfdf35" containerID="e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913" exitCode=0
Jul 28 20:47:28.130765 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:28.130615    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"
Jul 28 20:47:28.130765 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:28.130653    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx" event={"ID":"200af2e4-64fc-4a4a-a38c-7b679abfdf35","Type":"ContainerDied","Data":"e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913"}
Jul 28 20:47:28.130765 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:28.130709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx" event={"ID":"200af2e4-64fc-4a4a-a38c-7b679abfdf35","Type":"ContainerDied","Data":"62e46a0b6e5fa557ad5341e77c77843c40be2a56d8bca5726f5c5533c01eec85"}
Jul 28 20:47:28.130765 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:28.130732    2561 scope.go:117] "RemoveContainer" containerID="e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913"
Jul 28 20:47:28.139701 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:28.139681    2561 scope.go:117] "RemoveContainer" containerID="e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913"
Jul 28 20:47:28.139964 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:47:28.139945    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913\": container with ID starting with e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913 not found: ID does not exist" containerID="e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913"
Jul 28 20:47:28.140027 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:28.139977    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913"} err="failed to get container status \"e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913\": rpc error: code = NotFound desc = could not find container \"e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913\": container with ID starting with e237c6dd87c6f5150ff852d7232934f9588508544956ee2133d68c968ff73913 not found: ID does not exist"
Jul 28 20:47:28.154219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:28.154195    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"]
Jul 28 20:47:28.157149 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:28.157129    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d82230-57d9c5cc96-6pprx"]
Jul 28 20:47:30.077040 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:30.077001    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="200af2e4-64fc-4a4a-a38c-7b679abfdf35" path="/var/lib/kubelet/pods/200af2e4-64fc-4a4a-a38c-7b679abfdf35/volumes"
Jul 28 20:47:34.880006 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:34.879975    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"]
Jul 28 20:47:34.880499 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:34.880320    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy" containerID="cri-o://fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304" gracePeriod=30
Jul 28 20:47:35.280073 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.280038    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"]
Jul 28 20:47:35.280415 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.280401    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200af2e4-64fc-4a4a-a38c-7b679abfdf35" containerName="payload-processing"
Jul 28 20:47:35.280472 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.280416    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="200af2e4-64fc-4a4a-a38c-7b679abfdf35" containerName="payload-processing"
Jul 28 20:47:35.280472 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.280433    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="662b9326-76ef-42e7-bc62-9c638b52d3a7" containerName="revoke-keys"
Jul 28 20:47:35.280472 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.280438    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="662b9326-76ef-42e7-bc62-9c638b52d3a7" containerName="revoke-keys"
Jul 28 20:47:35.280566 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.280499    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="200af2e4-64fc-4a4a-a38c-7b679abfdf35" containerName="payload-processing"
Jul 28 20:47:35.280566 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.280510    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="662b9326-76ef-42e7-bc62-9c638b52d3a7" containerName="revoke-keys"
Jul 28 20:47:35.285015 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.284997    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"
Jul 28 20:47:35.287727 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.287704    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 20:47:35.287849 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.287731    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:47:35.294215 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.294185    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"]
Jul 28 20:47:35.400302 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.400224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0986c449-d7a3-4fbb-97f0-466fac0cbe32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk\" (UID: \"0986c449-d7a3-4fbb-97f0-466fac0cbe32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"
Jul 28 20:47:35.501678 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.501646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0986c449-d7a3-4fbb-97f0-466fac0cbe32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk\" (UID: \"0986c449-d7a3-4fbb-97f0-466fac0cbe32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"
Jul 28 20:47:35.502212 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.502195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0986c449-d7a3-4fbb-97f0-466fac0cbe32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk\" (UID: \"0986c449-d7a3-4fbb-97f0-466fac0cbe32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"
Jul 28 20:47:35.596202 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.596120    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"
Jul 28 20:47:35.732949 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:35.732922    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"]
Jul 28 20:47:35.735053 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:47:35.735030    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0986c449_d7a3_4fbb_97f0_466fac0cbe32.slice/crio-7c8692c0c7ee2f75b698313549818e6d2a3e6ff140ded222570a663b2103c5ac WatchSource:0}: Error finding container 7c8692c0c7ee2f75b698313549818e6d2a3e6ff140ded222570a663b2103c5ac: Status 404 returned error can't find the container with id 7c8692c0c7ee2f75b698313549818e6d2a3e6ff140ded222570a663b2103c5ac
Jul 28 20:47:36.179876 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:36.179784    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk" event={"ID":"0986c449-d7a3-4fbb-97f0-466fac0cbe32","Type":"ContainerStarted","Data":"b33875cbaa90eb2ac0074be071f52eabe22c6fce8999987eb687523f423d5fd0"}
Jul 28 20:47:36.179876 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:36.179836    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk" event={"ID":"0986c449-d7a3-4fbb-97f0-466fac0cbe32","Type":"ContainerStarted","Data":"7c8692c0c7ee2f75b698313549818e6d2a3e6ff140ded222570a663b2103c5ac"}
Jul 28 20:47:36.200679 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:36.200632    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk" podStartSLOduration=1.200614939 podStartE2EDuration="1.200614939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:36.200205153 +0000 UTC m=+2358.596908335" watchObservedRunningTime="2026-07-28 20:47:36.200614939 +0000 UTC m=+2358.597318095"
Jul 28 20:47:37.187546 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:37.187513    2561 generic.go:356] "Generic (PLEG): container finished" podID="0986c449-d7a3-4fbb-97f0-466fac0cbe32" containerID="b33875cbaa90eb2ac0074be071f52eabe22c6fce8999987eb687523f423d5fd0" exitCode=0
Jul 28 20:47:37.187982 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:37.187569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk" event={"ID":"0986c449-d7a3-4fbb-97f0-466fac0cbe32","Type":"ContainerDied","Data":"b33875cbaa90eb2ac0074be071f52eabe22c6fce8999987eb687523f423d5fd0"}
Jul 28 20:47:38.327051 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:38.327027    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"
Jul 28 20:47:38.428489 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:38.428457    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0986c449-d7a3-4fbb-97f0-466fac0cbe32-maas-api-service-ca\") pod \"0986c449-d7a3-4fbb-97f0-466fac0cbe32\" (UID: \"0986c449-d7a3-4fbb-97f0-466fac0cbe32\") "
Jul 28 20:47:38.428758 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:38.428736    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0986c449-d7a3-4fbb-97f0-466fac0cbe32-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0986c449-d7a3-4fbb-97f0-466fac0cbe32" (UID: "0986c449-d7a3-4fbb-97f0-466fac0cbe32"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:47:38.529260 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:38.529198    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0986c449-d7a3-4fbb-97f0-466fac0cbe32-maas-api-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:39.199507 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:39.199468    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"
Jul 28 20:47:39.199507 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:39.199503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk" event={"ID":"0986c449-d7a3-4fbb-97f0-466fac0cbe32","Type":"ContainerDied","Data":"7c8692c0c7ee2f75b698313549818e6d2a3e6ff140ded222570a663b2103c5ac"}
Jul 28 20:47:39.199726 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:39.199548    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c8692c0c7ee2f75b698313549818e6d2a3e6ff140ded222570a663b2103c5ac"
Jul 28 20:47:40.140412 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.140339    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:47:40.207219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.207176    2561 generic.go:356] "Generic (PLEG): container finished" podID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerID="fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304" exitCode=0
Jul 28 20:47:40.207442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.207256    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"
Jul 28 20:47:40.207442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.207280    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" event={"ID":"dd6ef6e0-9bee-4505-9efe-90815433366d","Type":"ContainerDied","Data":"fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304"}
Jul 28 20:47:40.207442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.207350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj" event={"ID":"dd6ef6e0-9bee-4505-9efe-90815433366d","Type":"ContainerDied","Data":"61668f82fae5df7ec92d194444ab776fa2ea00733003768e8079461257b184fe"}
Jul 28 20:47:40.207442 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.207385    2561 scope.go:117] "RemoveContainer" containerID="fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304"
Jul 28 20:47:40.216704 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.216686    2561 scope.go:117] "RemoveContainer" containerID="d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f"
Jul 28 20:47:40.225003 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.224981    2561 scope.go:117] "RemoveContainer" containerID="fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304"
Jul 28 20:47:40.225310 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:47:40.225290    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304\": container with ID starting with fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304 not found: ID does not exist" containerID="fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304"
Jul 28 20:47:40.225382 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.225321    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304"} err="failed to get container status \"fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304\": rpc error: code = NotFound desc = could not find container \"fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304\": container with ID starting with fbabc8a5a41d71592a3972363a64a0b57dd2611218edba4771552b0104334304 not found: ID does not exist"
Jul 28 20:47:40.225382 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.225341    2561 scope.go:117] "RemoveContainer" containerID="d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f"
Jul 28 20:47:40.225625 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:47:40.225602    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f\": container with ID starting with d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f not found: ID does not exist" containerID="d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f"
Jul 28 20:47:40.225680 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.225632    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f"} err="failed to get container status \"d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f\": rpc error: code = NotFound desc = could not find container \"d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f\": container with ID starting with d8b329518ba6083049f87401bd4bdfa5388b9ed11b0296f14b5707fa149d951f not found: ID does not exist"
Jul 28 20:47:40.243946 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.243917    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-envoy\") pod \"dd6ef6e0-9bee-4505-9efe-90815433366d\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") "
Jul 28 20:47:40.244050 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.243957    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-data\") pod \"dd6ef6e0-9bee-4505-9efe-90815433366d\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") "
Jul 28 20:47:40.244050 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244002    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-token\") pod \"dd6ef6e0-9bee-4505-9efe-90815433366d\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") "
Jul 28 20:47:40.244122 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244051    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9c2r\" (UniqueName: \"kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-kube-api-access-k9c2r\") pod \"dd6ef6e0-9bee-4505-9efe-90815433366d\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") "
Jul 28 20:47:40.244122 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244091    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-podinfo\") pod \"dd6ef6e0-9bee-4505-9efe-90815433366d\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") "
Jul 28 20:47:40.244245 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244117    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-certs\") pod \"dd6ef6e0-9bee-4505-9efe-90815433366d\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") "
Jul 28 20:47:40.244245 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244144    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-socket\") pod \"dd6ef6e0-9bee-4505-9efe-90815433366d\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") "
Jul 28 20:47:40.244245 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244205    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd6ef6e0-9bee-4505-9efe-90815433366d-istiod-ca-cert\") pod \"dd6ef6e0-9bee-4505-9efe-90815433366d\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") "
Jul 28 20:47:40.244410 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244312    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-credential-socket\") pod \"dd6ef6e0-9bee-4505-9efe-90815433366d\" (UID: \"dd6ef6e0-9bee-4505-9efe-90815433366d\") "
Jul 28 20:47:40.244490 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244466    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd6ef6e0-9bee-4505-9efe-90815433366d" (UID: "dd6ef6e0-9bee-4505-9efe-90815433366d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:47:40.244660 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244602    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd6ef6e0-9bee-4505-9efe-90815433366d" (UID: "dd6ef6e0-9bee-4505-9efe-90815433366d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:47:40.244759 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd6ef6e0-9bee-4505-9efe-90815433366d" (UID: "dd6ef6e0-9bee-4505-9efe-90815433366d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:47:40.244759 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244686    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:40.244872 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.244858    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd6ef6e0-9bee-4505-9efe-90815433366d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd6ef6e0-9bee-4505-9efe-90815433366d" (UID: "dd6ef6e0-9bee-4505-9efe-90815433366d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:47:40.245030 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.245005    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd6ef6e0-9bee-4505-9efe-90815433366d" (UID: "dd6ef6e0-9bee-4505-9efe-90815433366d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:47:40.246390 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.246364    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd6ef6e0-9bee-4505-9efe-90815433366d" (UID: "dd6ef6e0-9bee-4505-9efe-90815433366d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:47:40.246390 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.246370    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-kube-api-access-k9c2r" (OuterVolumeSpecName: "kube-api-access-k9c2r") pod "dd6ef6e0-9bee-4505-9efe-90815433366d" (UID: "dd6ef6e0-9bee-4505-9efe-90815433366d"). InnerVolumeSpecName "kube-api-access-k9c2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:47:40.246390 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.246384    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd6ef6e0-9bee-4505-9efe-90815433366d" (UID: "dd6ef6e0-9bee-4505-9efe-90815433366d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:47:40.246533 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.246371    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd6ef6e0-9bee-4505-9efe-90815433366d" (UID: "dd6ef6e0-9bee-4505-9efe-90815433366d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:47:40.345748 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.345717    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd6ef6e0-9bee-4505-9efe-90815433366d-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:40.345748 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.345743    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:40.345748 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.345752    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:40.345985 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.345763    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:40.345985 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.345770    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:40.345985 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.345779    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9c2r\" (UniqueName: \"kubernetes.io/projected/dd6ef6e0-9bee-4505-9efe-90815433366d-kube-api-access-k9c2r\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:40.345985 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.345787    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd6ef6e0-9bee-4505-9efe-90815433366d-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:40.345985 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.345795    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd6ef6e0-9bee-4505-9efe-90815433366d-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:40.534059 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.534027    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"]
Jul 28 20:47:40.539041 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:40.539013    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d82230-openshift-default-644b58cf6-zjmhj"]
Jul 28 20:47:42.076769 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:42.076735    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" path="/var/lib/kubelet/pods/dd6ef6e0-9bee-4505-9efe-90815433366d/volumes"
Jul 28 20:47:45.903716 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:45.903674    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"]
Jul 28 20:47:45.904181 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:45.904059    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm" podUID="5d249160-8f43-4d0b-9d93-0fc725ff0a3d" containerName="payload-processing" containerID="cri-o://0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31" gracePeriod=30
Jul 28 20:47:46.116618 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.116546    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"]
Jul 28 20:47:46.118327 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.118301    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a7eeff-kb2tk"]
Jul 28 20:47:46.167441 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.167382    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:47:46.241425 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.241390    2561 generic.go:356] "Generic (PLEG): container finished" podID="5d249160-8f43-4d0b-9d93-0fc725ff0a3d" containerID="0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31" exitCode=0
Jul 28 20:47:46.241565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.241437    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"
Jul 28 20:47:46.241565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.241474    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm" event={"ID":"5d249160-8f43-4d0b-9d93-0fc725ff0a3d","Type":"ContainerDied","Data":"0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31"}
Jul 28 20:47:46.241565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.241529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm" event={"ID":"5d249160-8f43-4d0b-9d93-0fc725ff0a3d","Type":"ContainerDied","Data":"ee88bdbd5e6d69d93c1496d7fd5c4e7c76dd800984222f6ddff76eaa370a4324"}
Jul 28 20:47:46.241565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.241552    2561 scope.go:117] "RemoveContainer" containerID="0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31"
Jul 28 20:47:46.250061 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.250046    2561 scope.go:117] "RemoveContainer" containerID="0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31"
Jul 28 20:47:46.250290 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:47:46.250272    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31\": container with ID starting with 0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31 not found: ID does not exist" containerID="0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31"
Jul 28 20:47:46.250357 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.250299    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31"} err="failed to get container status \"0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31\": rpc error: code = NotFound desc = could not find container \"0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31\": container with ID starting with 0024f6b9de1a6e128fed24d2d67fc2b1adb8e30a915dd957bb56a0be40b39c31 not found: ID does not exist"
Jul 28 20:47:46.299324 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.299292    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82zlc\" (UniqueName: \"kubernetes.io/projected/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-kube-api-access-82zlc\") pod \"5d249160-8f43-4d0b-9d93-0fc725ff0a3d\" (UID: \"5d249160-8f43-4d0b-9d93-0fc725ff0a3d\") "
Jul 28 20:47:46.299459 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.299333    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-plugins-config-volume\") pod \"5d249160-8f43-4d0b-9d93-0fc725ff0a3d\" (UID: \"5d249160-8f43-4d0b-9d93-0fc725ff0a3d\") "
Jul 28 20:47:46.299761 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.299741    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d249160-8f43-4d0b-9d93-0fc725ff0a3d" (UID: "5d249160-8f43-4d0b-9d93-0fc725ff0a3d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:47:46.301513 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.301493    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-kube-api-access-82zlc" (OuterVolumeSpecName: "kube-api-access-82zlc") pod "5d249160-8f43-4d0b-9d93-0fc725ff0a3d" (UID: "5d249160-8f43-4d0b-9d93-0fc725ff0a3d"). InnerVolumeSpecName "kube-api-access-82zlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:47:46.400871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.400829    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:46.400871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.400862    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82zlc\" (UniqueName: \"kubernetes.io/projected/5d249160-8f43-4d0b-9d93-0fc725ff0a3d-kube-api-access-82zlc\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:46.567032 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.566995    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"]
Jul 28 20:47:46.569164 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:46.569138    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a7eeff-667bd5d788-2tkjm"]
Jul 28 20:47:48.076567 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:48.076534    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0986c449-d7a3-4fbb-97f0-466fac0cbe32" path="/var/lib/kubelet/pods/0986c449-d7a3-4fbb-97f0-466fac0cbe32/volumes"
Jul 28 20:47:48.077013 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:48.076866    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d249160-8f43-4d0b-9d93-0fc725ff0a3d" path="/var/lib/kubelet/pods/5d249160-8f43-4d0b-9d93-0fc725ff0a3d/volumes"
Jul 28 20:47:53.149147 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:53.149117    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"]
Jul 28 20:47:53.149569 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:53.149338    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy" containerID="cri-o://fed05f44176f613fe0766be816efac294a251b6c11b471bf71102e9efa63f90c" gracePeriod=30
Jul 28 20:47:54.132414 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132377    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"]
Jul 28 20:47:54.132728 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132715    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy"
Jul 28 20:47:54.132775 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132729    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy"
Jul 28 20:47:54.132775 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132738    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy"
Jul 28 20:47:54.132775 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132744    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy"
Jul 28 20:47:54.132775 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132760    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0986c449-d7a3-4fbb-97f0-466fac0cbe32" containerName="revoke-keys"
Jul 28 20:47:54.132775 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132766    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0986c449-d7a3-4fbb-97f0-466fac0cbe32" containerName="revoke-keys"
Jul 28 20:47:54.132775 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132773    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d249160-8f43-4d0b-9d93-0fc725ff0a3d" containerName="payload-processing"
Jul 28 20:47:54.132958 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132779    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d249160-8f43-4d0b-9d93-0fc725ff0a3d" containerName="payload-processing"
Jul 28 20:47:54.132958 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132826    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy"
Jul 28 20:47:54.132958 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132834    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d249160-8f43-4d0b-9d93-0fc725ff0a3d" containerName="payload-processing"
Jul 28 20:47:54.132958 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132840    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0986c449-d7a3-4fbb-97f0-466fac0cbe32" containerName="revoke-keys"
Jul 28 20:47:54.132958 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.132846    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd6ef6e0-9bee-4505-9efe-90815433366d" containerName="istio-proxy"
Jul 28 20:47:54.135711 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.135694    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.140099 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.140077    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-65eee9-openshift-default-dockercfg-zj78r\""
Jul 28 20:47:54.154145 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.154115    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"]
Jul 28 20:47:54.270534 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.270494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-envoy\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.270534 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.270534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgqnr\" (UniqueName: \"kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-kube-api-access-pgqnr\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.270813 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.270556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-socket\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.270813 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.270665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-istio-token\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.270813 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.270718    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7469bede-59a4-4914-a912-916549215751-istio-podinfo\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.270813 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.270756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-certs\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.270976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.270818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-credential-socket\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.270976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.270860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-data\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.270976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.270895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7469bede-59a4-4914-a912-916549215751-istiod-ca-cert\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372057 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7469bede-59a4-4914-a912-916549215751-istio-podinfo\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372057 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-certs\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372345 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-credential-socket\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372345 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-data\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372345 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7469bede-59a4-4914-a912-916549215751-istiod-ca-cert\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372345 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372160    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-envoy\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372345 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgqnr\" (UniqueName: \"kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-kube-api-access-pgqnr\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372598 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-socket\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372598 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-istio-token\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372598 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372547    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-certs\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372773 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372750    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-credential-socket\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372825 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372798    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-socket\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.372953 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372933    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-data\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.373004 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.372945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7469bede-59a4-4914-a912-916549215751-istiod-ca-cert\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.374491 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.374471    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-envoy\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.374718 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.374700    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7469bede-59a4-4914-a912-916549215751-istio-podinfo\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.384298 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.384213    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgqnr\" (UniqueName: \"kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-kube-api-access-pgqnr\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.384704 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.384686    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-istio-token\") pod \"e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8\" (UID: \"7469bede-59a4-4914-a912-916549215751\") " pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.445340 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.445304    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:54.590131 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.590106    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"]
Jul 28 20:47:54.592015 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:47:54.591984    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7469bede_59a4_4914_a912_916549215751.slice/crio-c8207222ba05518a50364bfb89d25344c6de785ca0fb09d4cb96f24a09dd7b25 WatchSource:0}: Error finding container c8207222ba05518a50364bfb89d25344c6de785ca0fb09d4cb96f24a09dd7b25: Status 404 returned error can't find the container with id c8207222ba05518a50364bfb89d25344c6de785ca0fb09d4cb96f24a09dd7b25
Jul 28 20:47:54.594044 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.594012    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:47:54.594120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.594073    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:47:54.594120 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:54.594104    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:47:55.295004 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:55.294972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" event={"ID":"7469bede-59a4-4914-a912-916549215751","Type":"ContainerStarted","Data":"5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535"}
Jul 28 20:47:55.295433 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:55.295022    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" event={"ID":"7469bede-59a4-4914-a912-916549215751","Type":"ContainerStarted","Data":"c8207222ba05518a50364bfb89d25344c6de785ca0fb09d4cb96f24a09dd7b25"}
Jul 28 20:47:55.366185 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:55.366132    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" podStartSLOduration=1.36611528 podStartE2EDuration="1.36611528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:47:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:47:55.358671832 +0000 UTC m=+2377.755374987" watchObservedRunningTime="2026-07-28 20:47:55.36611528 +0000 UTC m=+2377.762818436"
Jul 28 20:47:55.445797 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:55.445768    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:55.450654 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:55.450630    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:56.300448 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:56.300416    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:56.301320 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:56.301301    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:47:58.312555 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.312517    2561 generic.go:356] "Generic (PLEG): container finished" podID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerID="fed05f44176f613fe0766be816efac294a251b6c11b471bf71102e9efa63f90c" exitCode=0
Jul 28 20:47:58.312967 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.312589    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" event={"ID":"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb","Type":"ContainerDied","Data":"fed05f44176f613fe0766be816efac294a251b6c11b471bf71102e9efa63f90c"}
Jul 28 20:47:58.312967 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.312650    2561 scope.go:117] "RemoveContainer" containerID="6847250c56907cc10df25e39a20f91b64044aea76d38da491e78b9fceadcbb48"
Jul 28 20:47:58.398677 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.398653    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:47:58.509132 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509105    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-data\") pod \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") "
Jul 28 20:47:58.509314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509144    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-envoy\") pod \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") "
Jul 28 20:47:58.509314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509171    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmmdx\" (UniqueName: \"kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-kube-api-access-nmmdx\") pod \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") "
Jul 28 20:47:58.509314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509198    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-podinfo\") pod \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") "
Jul 28 20:47:58.509314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509222    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-token\") pod \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") "
Jul 28 20:47:58.509314 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509277    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istiod-ca-cert\") pod \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") "
Jul 28 20:47:58.509548 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509351    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-credential-socket\") pod \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") "
Jul 28 20:47:58.509548 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509401    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-socket\") pod \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") "
Jul 28 20:47:58.509548 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509454    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-certs\") pod \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\" (UID: \"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb\") "
Jul 28 20:47:58.509782 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509677    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" (UID: "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:47:58.509782 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509773    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:58.509889 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509781    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" (UID: "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:47:58.509935 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.509887    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" (UID: "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:47:58.510019 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.510000    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" (UID: "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:47:58.510280 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.510259    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-data" (OuterVolumeSpecName: "istio-data") pod "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" (UID: "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:47:58.511586 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.511559    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-kube-api-access-nmmdx" (OuterVolumeSpecName: "kube-api-access-nmmdx") pod "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" (UID: "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb"). InnerVolumeSpecName "kube-api-access-nmmdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:47:58.511696 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.511654    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-token" (OuterVolumeSpecName: "istio-token") pod "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" (UID: "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:47:58.511831 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.511808    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" (UID: "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:47:58.511831 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.511825    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" (UID: "64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:47:58.602712 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.602675    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"]
Jul 28 20:47:58.603025 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.603012    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy"
Jul 28 20:47:58.603087 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.603026    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy"
Jul 28 20:47:58.603132 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.603090    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy"
Jul 28 20:47:58.603132 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.603097    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy"
Jul 28 20:47:58.607433 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.607410    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:47:58.610226 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.610034    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-65eee9-dockercfg-7ldmd\""
Jul 28 20:47:58.610226 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.610101    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-65eee9\""
Jul 28 20:47:58.610455 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.610430    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:58.610455 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.610453    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:58.610622 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.610466    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmmdx\" (UniqueName: \"kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-kube-api-access-nmmdx\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:58.610622 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.610479    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:58.610622 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.610492    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:58.610622 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.610503    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:58.610622 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.610511    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:58.610622 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.610520    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:47:58.648155 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.648125    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"]
Jul 28 20:47:58.711313 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.711280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbw85\" (UniqueName: \"kubernetes.io/projected/c9084009-152e-4c87-b68b-4c16c3e59c10-kube-api-access-hbw85\") pod \"payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh\" (UID: \"c9084009-152e-4c87-b68b-4c16c3e59c10\") " pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:47:58.711470 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.711320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9084009-152e-4c87-b68b-4c16c3e59c10-plugins-config-volume\") pod \"payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh\" (UID: \"c9084009-152e-4c87-b68b-4c16c3e59c10\") " pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:47:58.812512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.812408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbw85\" (UniqueName: \"kubernetes.io/projected/c9084009-152e-4c87-b68b-4c16c3e59c10-kube-api-access-hbw85\") pod \"payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh\" (UID: \"c9084009-152e-4c87-b68b-4c16c3e59c10\") " pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:47:58.812512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.812449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9084009-152e-4c87-b68b-4c16c3e59c10-plugins-config-volume\") pod \"payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh\" (UID: \"c9084009-152e-4c87-b68b-4c16c3e59c10\") " pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:47:58.813102 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.813082    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9084009-152e-4c87-b68b-4c16c3e59c10-plugins-config-volume\") pod \"payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh\" (UID: \"c9084009-152e-4c87-b68b-4c16c3e59c10\") " pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:47:58.824076 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.824053    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbw85\" (UniqueName: \"kubernetes.io/projected/c9084009-152e-4c87-b68b-4c16c3e59c10-kube-api-access-hbw85\") pod \"payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh\" (UID: \"c9084009-152e-4c87-b68b-4c16c3e59c10\") " pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:47:58.919069 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:58.919036    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:47:59.272516 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:59.272482    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"]
Jul 28 20:47:59.275693 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:47:59.275658    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9084009_152e_4c87_b68b_4c16c3e59c10.slice/crio-7afe5ed2ce18a55f61d7e1921515324b60e351efd986e8d818e95f41b204c56f WatchSource:0}: Error finding container 7afe5ed2ce18a55f61d7e1921515324b60e351efd986e8d818e95f41b204c56f: Status 404 returned error can't find the container with id 7afe5ed2ce18a55f61d7e1921515324b60e351efd986e8d818e95f41b204c56f
Jul 28 20:47:59.323624 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:59.323589    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh" event={"ID":"c9084009-152e-4c87-b68b-4c16c3e59c10","Type":"ContainerStarted","Data":"7afe5ed2ce18a55f61d7e1921515324b60e351efd986e8d818e95f41b204c56f"}
Jul 28 20:47:59.324890 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:59.324868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f" event={"ID":"64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb","Type":"ContainerDied","Data":"89d59a85bf3dbb1c5a652e9af92bbe6daf154017e9c015d6eaf479a4e668f479"}
Jul 28 20:47:59.325014 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:59.324909    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"
Jul 28 20:47:59.325014 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:59.324916    2561 scope.go:117] "RemoveContainer" containerID="fed05f44176f613fe0766be816efac294a251b6c11b471bf71102e9efa63f90c"
Jul 28 20:47:59.351013 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:59.350989    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"]
Jul 28 20:47:59.358644 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:47:59.358616    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a7eeff-openshift-default-dd4cd8dbd-j762f"]
Jul 28 20:48:00.077005 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:00.076971    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" path="/var/lib/kubelet/pods/64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb/volumes"
Jul 28 20:48:00.340579 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:00.340492    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh" event={"ID":"c9084009-152e-4c87-b68b-4c16c3e59c10","Type":"ContainerStarted","Data":"bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e"}
Jul 28 20:48:00.340953 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:00.340581    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:48:00.362260 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:00.362171    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh" podStartSLOduration=2.362157237 podStartE2EDuration="2.362157237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:47:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:00.360697267 +0000 UTC m=+2382.757400422" watchObservedRunningTime="2026-07-28 20:48:00.362157237 +0000 UTC m=+2382.758860393"
Jul 28 20:48:10.398969 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:10.398936    2561 generic.go:356] "Generic (PLEG): container finished" podID="7469bede-59a4-4914-a912-916549215751" containerID="5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535" exitCode=0
Jul 28 20:48:10.399414 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:10.399001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" event={"ID":"7469bede-59a4-4914-a912-916549215751","Type":"ContainerDied","Data":"5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535"}
Jul 28 20:48:10.399414 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:10.399410    2561 scope.go:117] "RemoveContainer" containerID="5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535"
Jul 28 20:48:10.400377 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:10.400348    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:48:10.400454 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:10.400415    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:48:10.400454 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:10.400444    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:48:11.300363 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:11.300325    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:48:11.349593 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:11.349567    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:48:11.413259 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:11.412357    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" event={"ID":"7469bede-59a4-4914-a912-916549215751","Type":"ContainerStarted","Data":"059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5"}
Jul 28 20:48:11.446500 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:11.446467    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:48:11.447421 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:11.447400    2561 patch_prober.go:28] interesting pod/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 28 20:48:11.447512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:11.447454    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 28 20:48:12.446680 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:12.446646    2561 patch_prober.go:28] interesting pod/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 28 20:48:12.447092 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:12.446701    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 28 20:48:13.446758 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:13.446719    2561 patch_prober.go:28] interesting pod/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 28 20:48:13.447162 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:13.446788    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 28 20:48:14.445873 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:14.445837    2561 patch_prober.go:28] interesting pod/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 28 20:48:14.446062 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:14.445890    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 28 20:48:15.449440 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:15.449409    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:48:15.449864 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:15.449667    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:48:15.450355 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:15.450340    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:48:18.312675 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:18.312651    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:48:18.317762 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:18.317738    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:48:23.444307 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.444262    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"]
Jul 28 20:48:23.444759 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.444613    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy"
Jul 28 20:48:23.444759 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.444623    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64bdbb20-a8f5-46d6-8d2c-d25aaf6bbadb" containerName="istio-proxy"
Jul 28 20:48:23.448869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.448851    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.451669 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.451646    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-42ff09-openshift-default-dockercfg-mjslx\""
Jul 28 20:48:23.479678 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.479649    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"]
Jul 28 20:48:23.511036 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.511004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-envoy\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.511219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.511044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-socket\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.511219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.511070    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-certs\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.511219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.511098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0734d745-9166-40da-bd70-7b1cc424b4d7-istiod-ca-cert\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.511219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.511131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-data\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.511219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.511156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-token\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.511219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.511208    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-credential-socket\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.511521 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.511287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2nq5\" (UniqueName: \"kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-kube-api-access-p2nq5\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.511521 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.511325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-podinfo\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.612490 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.612450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-data\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.612490 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.612500    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-token\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.612755 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.612622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-credential-socket\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.612755 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.612660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2nq5\" (UniqueName: \"kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-kube-api-access-p2nq5\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.612755 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.612689    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-podinfo\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.612755 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.612734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-envoy\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.612976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.612762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-socket\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.612976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.612807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-certs\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.612976 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.612830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0734d745-9166-40da-bd70-7b1cc424b4d7-istiod-ca-cert\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.613195 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.613035    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-credential-socket\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.613195 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.613116    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-socket\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.613195 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.613164    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-data\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.613392 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.613192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-certs\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.613520 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.613498    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0734d745-9166-40da-bd70-7b1cc424b4d7-istiod-ca-cert\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.615162 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.615140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-envoy\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.615397 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.615374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-podinfo\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.648268 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.648198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2nq5\" (UniqueName: \"kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-kube-api-access-p2nq5\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.648432 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.648354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-token\") pod \"e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") " pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.758812 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.758784    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:23.947785 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.947756    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"]
Jul 28 20:48:23.949634 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:48:23.949613    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0734d745_9166_40da_bd70_7b1cc424b4d7.slice/crio-e21d875e5fbb4f845b378e0922906c152a829f4c85c2eb954e24fa1c1fd7804c WatchSource:0}: Error finding container e21d875e5fbb4f845b378e0922906c152a829f4c85c2eb954e24fa1c1fd7804c: Status 404 returned error can't find the container with id e21d875e5fbb4f845b378e0922906c152a829f4c85c2eb954e24fa1c1fd7804c
Jul 28 20:48:23.951852 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.951816    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:48:23.951934 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.951875    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:48:23.951934 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:23.951903    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:48:24.482697 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:24.482661    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" event={"ID":"0734d745-9166-40da-bd70-7b1cc424b4d7","Type":"ContainerStarted","Data":"f79b5b90b59e2780efb2d66bf755806052f67de2fe1cacb5e61eef8dccbc87b6"}
Jul 28 20:48:24.483336 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:24.482721    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" event={"ID":"0734d745-9166-40da-bd70-7b1cc424b4d7","Type":"ContainerStarted","Data":"e21d875e5fbb4f845b378e0922906c152a829f4c85c2eb954e24fa1c1fd7804c"}
Jul 28 20:48:24.531777 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:24.531723    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" podStartSLOduration=1.531706637 podStartE2EDuration="1.531706637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:24.531653289 +0000 UTC m=+2406.928356444" watchObservedRunningTime="2026-07-28 20:48:24.531706637 +0000 UTC m=+2406.928409793"
Jul 28 20:48:24.759632 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:24.759603    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:25.765427 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:25.765396    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:26.493889 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:26.493850    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:26.494925 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:26.494907    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:29.788325 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.788291    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"]
Jul 28 20:48:29.791867 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.791847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:48:29.794372 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.794351    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-42ff09-dockercfg-8mm4f\""
Jul 28 20:48:29.794626 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.794605    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-42ff09\""
Jul 28 20:48:29.837832 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.837801    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"]
Jul 28 20:48:29.872369 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.872329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw5w7\" (UniqueName: \"kubernetes.io/projected/0ab01e06-c24d-49ed-8857-8810657c5d9a-kube-api-access-rw5w7\") pod \"payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f\" (UID: \"0ab01e06-c24d-49ed-8857-8810657c5d9a\") " pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:48:29.872567 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.872412    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ab01e06-c24d-49ed-8857-8810657c5d9a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f\" (UID: \"0ab01e06-c24d-49ed-8857-8810657c5d9a\") " pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:48:29.972996 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.972956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw5w7\" (UniqueName: \"kubernetes.io/projected/0ab01e06-c24d-49ed-8857-8810657c5d9a-kube-api-access-rw5w7\") pod \"payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f\" (UID: \"0ab01e06-c24d-49ed-8857-8810657c5d9a\") " pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:48:29.973186 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.973014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ab01e06-c24d-49ed-8857-8810657c5d9a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f\" (UID: \"0ab01e06-c24d-49ed-8857-8810657c5d9a\") " pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:48:29.973742 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.973724    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ab01e06-c24d-49ed-8857-8810657c5d9a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f\" (UID: \"0ab01e06-c24d-49ed-8857-8810657c5d9a\") " pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:48:29.983267 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:29.983223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw5w7\" (UniqueName: \"kubernetes.io/projected/0ab01e06-c24d-49ed-8857-8810657c5d9a-kube-api-access-rw5w7\") pod \"payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f\" (UID: \"0ab01e06-c24d-49ed-8857-8810657c5d9a\") " pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:48:30.102449 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:30.102360    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:48:30.261472 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:30.261438    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"]
Jul 28 20:48:30.265848 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:48:30.265821    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab01e06_c24d_49ed_8857_8810657c5d9a.slice/crio-fec165995ecf19d6f69f21117cba2e9a9e528e24a4d8fcc8eecb23505f879c12 WatchSource:0}: Error finding container fec165995ecf19d6f69f21117cba2e9a9e528e24a4d8fcc8eecb23505f879c12: Status 404 returned error can't find the container with id fec165995ecf19d6f69f21117cba2e9a9e528e24a4d8fcc8eecb23505f879c12
Jul 28 20:48:30.520022 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:30.519984    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f" event={"ID":"0ab01e06-c24d-49ed-8857-8810657c5d9a","Type":"ContainerStarted","Data":"da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52"}
Jul 28 20:48:30.520210 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:30.520042    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f" event={"ID":"0ab01e06-c24d-49ed-8857-8810657c5d9a","Type":"ContainerStarted","Data":"fec165995ecf19d6f69f21117cba2e9a9e528e24a4d8fcc8eecb23505f879c12"}
Jul 28 20:48:30.520210 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:30.520083    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:48:30.556894 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:30.556749    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f" podStartSLOduration=1.556728175 podStartE2EDuration="1.556728175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:30.552220701 +0000 UTC m=+2412.948923879" watchObservedRunningTime="2026-07-28 20:48:30.556728175 +0000 UTC m=+2412.953431331"
Jul 28 20:48:41.528324 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:41.528285    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:48:42.535400 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:42.535361    2561 patch_prober.go:28] interesting pod/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 20:48:42.535813 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:42.535438    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 20:48:43.598753 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:43.598647    2561 generic.go:356] "Generic (PLEG): container finished" podID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerID="f79b5b90b59e2780efb2d66bf755806052f67de2fe1cacb5e61eef8dccbc87b6" exitCode=0
Jul 28 20:48:43.598753 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:43.598722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" event={"ID":"0734d745-9166-40da-bd70-7b1cc424b4d7","Type":"ContainerDied","Data":"f79b5b90b59e2780efb2d66bf755806052f67de2fe1cacb5e61eef8dccbc87b6"}
Jul 28 20:48:43.599211 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:43.599116    2561 scope.go:117] "RemoveContainer" containerID="f79b5b90b59e2780efb2d66bf755806052f67de2fe1cacb5e61eef8dccbc87b6"
Jul 28 20:48:43.600106 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:43.600082    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:48:43.600172 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:43.600145    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:48:43.600207 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:43.600179    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:48:44.616752 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:44.616701    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" event={"ID":"0734d745-9166-40da-bd70-7b1cc424b4d7","Type":"ContainerStarted","Data":"debaec007a67b6aabe6e1c0354ec81f58f89b3f04874b559380b0ec89891fad3"}
Jul 28 20:48:44.759630 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:44.759596    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:44.759815 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:44.759759    2561 patch_prober.go:28] interesting pod/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 28 20:48:44.759873 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:44.759824    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 28 20:48:45.759988 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:45.759951    2561 patch_prober.go:28] interesting pod/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 28 20:48:45.760444 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:45.760020    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 28 20:48:46.759589 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:46.759550    2561 patch_prober.go:28] interesting pod/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 28 20:48:46.759786 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:46.759607    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 28 20:48:47.759851 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:47.759814    2561 patch_prober.go:28] interesting pod/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 28 20:48:47.760214 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:47.759887    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 28 20:48:48.763109 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:48.763078    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:48.763610 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:48.763473    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:48:48.764198 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:48:48.764180    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:49:05.104690 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.104661    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"]
Jul 28 20:49:05.105221 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.104930    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh" podUID="c9084009-152e-4c87-b68b-4c16c3e59c10" containerName="payload-processing" containerID="cri-o://bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e" gracePeriod=30
Jul 28 20:49:05.373286 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.373221    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:49:05.473925 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.473896    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9084009-152e-4c87-b68b-4c16c3e59c10-plugins-config-volume\") pod \"c9084009-152e-4c87-b68b-4c16c3e59c10\" (UID: \"c9084009-152e-4c87-b68b-4c16c3e59c10\") "
Jul 28 20:49:05.474057 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.473935    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbw85\" (UniqueName: \"kubernetes.io/projected/c9084009-152e-4c87-b68b-4c16c3e59c10-kube-api-access-hbw85\") pod \"c9084009-152e-4c87-b68b-4c16c3e59c10\" (UID: \"c9084009-152e-4c87-b68b-4c16c3e59c10\") "
Jul 28 20:49:05.474323 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.474300    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9084009-152e-4c87-b68b-4c16c3e59c10-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c9084009-152e-4c87-b68b-4c16c3e59c10" (UID: "c9084009-152e-4c87-b68b-4c16c3e59c10"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:49:05.475948 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.475927    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9084009-152e-4c87-b68b-4c16c3e59c10-kube-api-access-hbw85" (OuterVolumeSpecName: "kube-api-access-hbw85") pod "c9084009-152e-4c87-b68b-4c16c3e59c10" (UID: "c9084009-152e-4c87-b68b-4c16c3e59c10"). InnerVolumeSpecName "kube-api-access-hbw85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:49:05.575133 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.575112    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9084009-152e-4c87-b68b-4c16c3e59c10-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:05.575133 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.575131    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbw85\" (UniqueName: \"kubernetes.io/projected/c9084009-152e-4c87-b68b-4c16c3e59c10-kube-api-access-hbw85\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:05.737802 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.737744    2561 generic.go:356] "Generic (PLEG): container finished" podID="c9084009-152e-4c87-b68b-4c16c3e59c10" containerID="bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e" exitCode=0
Jul 28 20:49:05.737802 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.737793    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"
Jul 28 20:49:05.737924 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.737805    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh" event={"ID":"c9084009-152e-4c87-b68b-4c16c3e59c10","Type":"ContainerDied","Data":"bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e"}
Jul 28 20:49:05.737924 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.737847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh" event={"ID":"c9084009-152e-4c87-b68b-4c16c3e59c10","Type":"ContainerDied","Data":"7afe5ed2ce18a55f61d7e1921515324b60e351efd986e8d818e95f41b204c56f"}
Jul 28 20:49:05.737924 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.737868    2561 scope.go:117] "RemoveContainer" containerID="bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e"
Jul 28 20:49:05.747605 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.747589    2561 scope.go:117] "RemoveContainer" containerID="bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e"
Jul 28 20:49:05.747877 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:49:05.747856    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e\": container with ID starting with bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e not found: ID does not exist" containerID="bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e"
Jul 28 20:49:05.747922 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.747885    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e"} err="failed to get container status \"bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e\": rpc error: code = NotFound desc = could not find container \"bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e\": container with ID starting with bbbeda0286abf9afc2de3503162419baec8c95f739660268d29f55ab123ccf1e not found: ID does not exist"
Jul 28 20:49:05.766399 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.766375    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"]
Jul 28 20:49:05.770389 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:05.770368    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-65eee9-58d644d9c8-w8bhh"]
Jul 28 20:49:06.076172 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:06.076148    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9084009-152e-4c87-b68b-4c16c3e59c10" path="/var/lib/kubelet/pods/c9084009-152e-4c87-b68b-4c16c3e59c10/volumes"
Jul 28 20:49:12.926997 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:12.926959    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"]
Jul 28 20:49:12.927577 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:12.927171    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy" containerID="cri-o://059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5" gracePeriod=30
Jul 28 20:49:15.452958 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:15.452920    2561 patch_prober.go:28] interesting pod/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:49:15.453388 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:15.452993    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:49:18.199575 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.199484    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:49:18.295380 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295345    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7469bede-59a4-4914-a912-916549215751-istiod-ca-cert\") pod \"7469bede-59a4-4914-a912-916549215751\" (UID: \"7469bede-59a4-4914-a912-916549215751\") "
Jul 28 20:49:18.295380 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295383    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-istio-token\") pod \"7469bede-59a4-4914-a912-916549215751\" (UID: \"7469bede-59a4-4914-a912-916549215751\") "
Jul 28 20:49:18.295587 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295407    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-credential-socket\") pod \"7469bede-59a4-4914-a912-916549215751\" (UID: \"7469bede-59a4-4914-a912-916549215751\") "
Jul 28 20:49:18.295625 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295598    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgqnr\" (UniqueName: \"kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-kube-api-access-pgqnr\") pod \"7469bede-59a4-4914-a912-916549215751\" (UID: \"7469bede-59a4-4914-a912-916549215751\") "
Jul 28 20:49:18.295686 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295672    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7469bede-59a4-4914-a912-916549215751-istio-podinfo\") pod \"7469bede-59a4-4914-a912-916549215751\" (UID: \"7469bede-59a4-4914-a912-916549215751\") "
Jul 28 20:49:18.295724 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-certs\") pod \"7469bede-59a4-4914-a912-916549215751\" (UID: \"7469bede-59a4-4914-a912-916549215751\") "
Jul 28 20:49:18.295724 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-data\") pod \"7469bede-59a4-4914-a912-916549215751\" (UID: \"7469bede-59a4-4914-a912-916549215751\") "
Jul 28 20:49:18.295829 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295730    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7469bede-59a4-4914-a912-916549215751" (UID: "7469bede-59a4-4914-a912-916549215751"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:18.295829 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295763    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7469bede-59a4-4914-a912-916549215751-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7469bede-59a4-4914-a912-916549215751" (UID: "7469bede-59a4-4914-a912-916549215751"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:49:18.295829 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295782    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-envoy\") pod \"7469bede-59a4-4914-a912-916549215751\" (UID: \"7469bede-59a4-4914-a912-916549215751\") "
Jul 28 20:49:18.295829 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295825    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-socket\") pod \"7469bede-59a4-4914-a912-916549215751\" (UID: \"7469bede-59a4-4914-a912-916549215751\") "
Jul 28 20:49:18.296038 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.295994    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7469bede-59a4-4914-a912-916549215751" (UID: "7469bede-59a4-4914-a912-916549215751"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:18.296197 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.296167    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7469bede-59a4-4914-a912-916549215751" (UID: "7469bede-59a4-4914-a912-916549215751"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:18.296197 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.296180    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:18.296197 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.296196    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7469bede-59a4-4914-a912-916549215751-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:18.296454 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.296209    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:18.296698 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.296675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-data" (OuterVolumeSpecName: "istio-data") pod "7469bede-59a4-4914-a912-916549215751" (UID: "7469bede-59a4-4914-a912-916549215751"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:18.297853 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.297829    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-istio-token" (OuterVolumeSpecName: "istio-token") pod "7469bede-59a4-4914-a912-916549215751" (UID: "7469bede-59a4-4914-a912-916549215751"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:49:18.297853 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.297827    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7469bede-59a4-4914-a912-916549215751-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7469bede-59a4-4914-a912-916549215751" (UID: "7469bede-59a4-4914-a912-916549215751"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:49:18.298150 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.298126    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-kube-api-access-pgqnr" (OuterVolumeSpecName: "kube-api-access-pgqnr") pod "7469bede-59a4-4914-a912-916549215751" (UID: "7469bede-59a4-4914-a912-916549215751"). InnerVolumeSpecName "kube-api-access-pgqnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:49:18.298229 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.298136    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7469bede-59a4-4914-a912-916549215751" (UID: "7469bede-59a4-4914-a912-916549215751"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:18.397424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.397382    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgqnr\" (UniqueName: \"kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-kube-api-access-pgqnr\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:18.397424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.397420    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7469bede-59a4-4914-a912-916549215751-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:18.397424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.397431    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:18.397424 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.397440    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:18.397693 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.397449    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7469bede-59a4-4914-a912-916549215751-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:18.397693 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.397457    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7469bede-59a4-4914-a912-916549215751-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:18.443358 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.443321    2561 scope.go:117] "RemoveContainer" containerID="3c9ed78211ed59f4b144fd9dfb428842aa825b322aad74ad4e4855d05efe6798"
Jul 28 20:49:18.826327 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.826288    2561 generic.go:356] "Generic (PLEG): container finished" podID="7469bede-59a4-4914-a912-916549215751" containerID="059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5" exitCode=0
Jul 28 20:49:18.826327 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.826333    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" event={"ID":"7469bede-59a4-4914-a912-916549215751","Type":"ContainerDied","Data":"059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5"}
Jul 28 20:49:18.826603 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.826362    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"
Jul 28 20:49:18.826603 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.826400    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8" event={"ID":"7469bede-59a4-4914-a912-916549215751","Type":"ContainerDied","Data":"c8207222ba05518a50364bfb89d25344c6de785ca0fb09d4cb96f24a09dd7b25"}
Jul 28 20:49:18.826603 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.826422    2561 scope.go:117] "RemoveContainer" containerID="059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5"
Jul 28 20:49:18.836380 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.836358    2561 scope.go:117] "RemoveContainer" containerID="5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535"
Jul 28 20:49:18.845386 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.845361    2561 scope.go:117] "RemoveContainer" containerID="059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5"
Jul 28 20:49:18.845766 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:49:18.845744    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5\": container with ID starting with 059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5 not found: ID does not exist" containerID="059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5"
Jul 28 20:49:18.845814 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.845777    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5"} err="failed to get container status \"059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5\": rpc error: code = NotFound desc = could not find container \"059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5\": container with ID starting with 059bec365a26cac12c7e2b12276b6f096780c06a984165b442e5da80a2b034c5 not found: ID does not exist"
Jul 28 20:49:18.845814 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.845798    2561 scope.go:117] "RemoveContainer" containerID="5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535"
Jul 28 20:49:18.846068 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:49:18.846046    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535\": container with ID starting with 5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535 not found: ID does not exist" containerID="5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535"
Jul 28 20:49:18.846132 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.846078    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535"} err="failed to get container status \"5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535\": rpc error: code = NotFound desc = could not find container \"5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535\": container with ID starting with 5ad37c94aba277ad3db78ca51db10c350412d42eb0e6ee67f7890332434bd535 not found: ID does not exist"
Jul 28 20:49:18.852397 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.852362    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"]
Jul 28 20:49:18.864766 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:18.864729    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-65eee9-openshift-default-9fc97584b-7ggv8"]
Jul 28 20:49:20.076699 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:20.076665    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7469bede-59a4-4914-a912-916549215751" path="/var/lib/kubelet/pods/7469bede-59a4-4914-a912-916549215751/volumes"
Jul 28 20:49:23.327252 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.327205    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"]
Jul 28 20:49:23.327750 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.327429    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f" podUID="0ab01e06-c24d-49ed-8857-8810657c5d9a" containerName="payload-processing" containerID="cri-o://da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52" gracePeriod=30
Jul 28 20:49:23.590226 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.590174    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:49:23.641487 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.641462    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ab01e06-c24d-49ed-8857-8810657c5d9a-plugins-config-volume\") pod \"0ab01e06-c24d-49ed-8857-8810657c5d9a\" (UID: \"0ab01e06-c24d-49ed-8857-8810657c5d9a\") "
Jul 28 20:49:23.641638 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.641565    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw5w7\" (UniqueName: \"kubernetes.io/projected/0ab01e06-c24d-49ed-8857-8810657c5d9a-kube-api-access-rw5w7\") pod \"0ab01e06-c24d-49ed-8857-8810657c5d9a\" (UID: \"0ab01e06-c24d-49ed-8857-8810657c5d9a\") "
Jul 28 20:49:23.641832 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.641810    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab01e06-c24d-49ed-8857-8810657c5d9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ab01e06-c24d-49ed-8857-8810657c5d9a" (UID: "0ab01e06-c24d-49ed-8857-8810657c5d9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:49:23.643843 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.643816    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ab01e06-c24d-49ed-8857-8810657c5d9a-kube-api-access-rw5w7" (OuterVolumeSpecName: "kube-api-access-rw5w7") pod "0ab01e06-c24d-49ed-8857-8810657c5d9a" (UID: "0ab01e06-c24d-49ed-8857-8810657c5d9a"). InnerVolumeSpecName "kube-api-access-rw5w7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:49:23.742282 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.742227    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ab01e06-c24d-49ed-8857-8810657c5d9a-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:23.742282 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.742281    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw5w7\" (UniqueName: \"kubernetes.io/projected/0ab01e06-c24d-49ed-8857-8810657c5d9a-kube-api-access-rw5w7\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:23.856869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.856805    2561 generic.go:356] "Generic (PLEG): container finished" podID="0ab01e06-c24d-49ed-8857-8810657c5d9a" containerID="da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52" exitCode=0
Jul 28 20:49:23.856869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.856844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f" event={"ID":"0ab01e06-c24d-49ed-8857-8810657c5d9a","Type":"ContainerDied","Data":"da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52"}
Jul 28 20:49:23.856869 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.856847    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"
Jul 28 20:49:23.857063 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.856885    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f" event={"ID":"0ab01e06-c24d-49ed-8857-8810657c5d9a","Type":"ContainerDied","Data":"fec165995ecf19d6f69f21117cba2e9a9e528e24a4d8fcc8eecb23505f879c12"}
Jul 28 20:49:23.857063 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.856907    2561 scope.go:117] "RemoveContainer" containerID="da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52"
Jul 28 20:49:23.866650 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.866630    2561 scope.go:117] "RemoveContainer" containerID="da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52"
Jul 28 20:49:23.866888 ip-10-0-136-137 kubenswrapper[2561]: E0728 20:49:23.866871    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52\": container with ID starting with da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52 not found: ID does not exist" containerID="da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52"
Jul 28 20:49:23.866953 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.866898    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52"} err="failed to get container status \"da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52\": rpc error: code = NotFound desc = could not find container \"da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52\": container with ID starting with da321ea7ae54c0bfb1f278119c922fe38fb15fc92eb561def4a88cc801803b52 not found: ID does not exist"
Jul 28 20:49:23.880304 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.880279    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"]
Jul 28 20:49:23.885162 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:23.885142    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-42ff09-bd5cdb488-6c57f"]
Jul 28 20:49:24.076806 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:24.076779    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ab01e06-c24d-49ed-8857-8810657c5d9a" path="/var/lib/kubelet/pods/0ab01e06-c24d-49ed-8857-8810657c5d9a/volumes"
Jul 28 20:49:30.746400 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:30.746368    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"]
Jul 28 20:49:30.746779 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:30.746575    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy" containerID="cri-o://debaec007a67b6aabe6e1c0354ec81f58f89b3f04874b559380b0ec89891fad3" gracePeriod=30
Jul 28 20:49:31.717990 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.717960    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"]
Jul 28 20:49:31.718363 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718349    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab01e06-c24d-49ed-8857-8810657c5d9a" containerName="payload-processing"
Jul 28 20:49:31.718420 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718364    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab01e06-c24d-49ed-8857-8810657c5d9a" containerName="payload-processing"
Jul 28 20:49:31.718420 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718373    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy"
Jul 28 20:49:31.718420 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718379    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy"
Jul 28 20:49:31.718420 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718389    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9084009-152e-4c87-b68b-4c16c3e59c10" containerName="payload-processing"
Jul 28 20:49:31.718420 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718395    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9084009-152e-4c87-b68b-4c16c3e59c10" containerName="payload-processing"
Jul 28 20:49:31.718420 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718406    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy"
Jul 28 20:49:31.718420 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718411    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy"
Jul 28 20:49:31.718642 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718483    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9084009-152e-4c87-b68b-4c16c3e59c10" containerName="payload-processing"
Jul 28 20:49:31.718642 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718493    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab01e06-c24d-49ed-8857-8810657c5d9a" containerName="payload-processing"
Jul 28 20:49:31.718642 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718500    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy"
Jul 28 20:49:31.718642 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.718506    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7469bede-59a4-4914-a912-916549215751" containerName="istio-proxy"
Jul 28 20:49:31.721626 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.721610    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.728056 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.727781    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-cc370c-openshift-default-dockercfg-965z2\""
Jul 28 20:49:31.740682 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.740658    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"]
Jul 28 20:49:31.810790 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.810755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-data\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.811283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.810808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-socket\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.811283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.810856    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-envoy\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.811283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.810885    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfv9c\" (UniqueName: \"kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-kube-api-access-zfv9c\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.811283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.810941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-token\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.811283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.810969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9163e173-6aee-457e-8ad5-811bbfb7ec70-istiod-ca-cert\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.811283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.810994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-podinfo\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.811283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.811029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-certs\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.811283 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.811071    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-credential-socket\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.911700 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.911666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-envoy\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.911871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.911707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv9c\" (UniqueName: \"kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-kube-api-access-zfv9c\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.911871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.911754    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-token\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.911871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.911779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9163e173-6aee-457e-8ad5-811bbfb7ec70-istiod-ca-cert\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.911871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.911800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-podinfo\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.911871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.911832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-certs\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.911871 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.911869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-credential-socket\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.912222 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.911937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-data\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.912222 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.911975    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-socket\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.912345 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.912266    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-certs\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.912345 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.912304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-credential-socket\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.912511 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.912493    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-socket\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.912619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.912543    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-data\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.912619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.912595    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9163e173-6aee-457e-8ad5-811bbfb7ec70-istiod-ca-cert\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.913994 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.913969    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-envoy\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.914245 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.914213    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-podinfo\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.921734 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.921695    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-token\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:31.923820 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:31.923800    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfv9c\" (UniqueName: \"kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-kube-api-access-zfv9c\") pod \"e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") " pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:32.031896 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:32.031876    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:32.181784 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:32.181754    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"]
Jul 28 20:49:32.185214 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:49:32.185190    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9163e173_6aee_457e_8ad5_811bbfb7ec70.slice/crio-e7fec1ff105b6f3ecbfd6ece8e993d345764d8ea06fb969397a65e7ca9f20566 WatchSource:0}: Error finding container e7fec1ff105b6f3ecbfd6ece8e993d345764d8ea06fb969397a65e7ca9f20566: Status 404 returned error can't find the container with id e7fec1ff105b6f3ecbfd6ece8e993d345764d8ea06fb969397a65e7ca9f20566
Jul 28 20:49:32.187350 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:32.187322    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:49:32.187412 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:32.187383    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:49:32.187451 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:32.187411    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:49:32.905194 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:32.905154    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" event={"ID":"9163e173-6aee-457e-8ad5-811bbfb7ec70","Type":"ContainerStarted","Data":"51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e"}
Jul 28 20:49:32.905662 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:32.905220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" event={"ID":"9163e173-6aee-457e-8ad5-811bbfb7ec70","Type":"ContainerStarted","Data":"e7fec1ff105b6f3ecbfd6ece8e993d345764d8ea06fb969397a65e7ca9f20566"}
Jul 28 20:49:32.930911 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:32.930865    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" podStartSLOduration=1.9308513029999999 podStartE2EDuration="1.930851303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:49:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:32.927697342 +0000 UTC m=+2475.324400532" watchObservedRunningTime="2026-07-28 20:49:32.930851303 +0000 UTC m=+2475.327554459"
Jul 28 20:49:33.032827 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:33.032800    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:33.041252 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:33.038006    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:33.765619 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:33.765582    2561 patch_prober.go:28] interesting pod/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:49:33.765794 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:33.765638    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:49:33.911207 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:33.911178    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:33.912087 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:33.912061    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:35.826479 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:35.826447    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"]
Jul 28 20:49:35.830141 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:35.830124    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 20:49:35.832815 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:35.832795    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-cc370c-dockercfg-f5wc6\""
Jul 28 20:49:35.832901 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:35.832839    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-cc370c\""
Jul 28 20:49:35.842067 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:35.842044    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"]
Jul 28 20:49:35.924119 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:35.924090    2561 generic.go:356] "Generic (PLEG): container finished" podID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerID="debaec007a67b6aabe6e1c0354ec81f58f89b3f04874b559380b0ec89891fad3" exitCode=0
Jul 28 20:49:35.924254 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:35.924162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" event={"ID":"0734d745-9166-40da-bd70-7b1cc424b4d7","Type":"ContainerDied","Data":"debaec007a67b6aabe6e1c0354ec81f58f89b3f04874b559380b0ec89891fad3"}
Jul 28 20:49:35.924254 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:35.924224    2561 scope.go:117] "RemoveContainer" containerID="f79b5b90b59e2780efb2d66bf755806052f67de2fe1cacb5e61eef8dccbc87b6"
Jul 28 20:49:35.949636 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:35.949371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d9dec93-b285-4434-86ed-9edcdc1299c0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x\" (UID: \"5d9dec93-b285-4434-86ed-9edcdc1299c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 20:49:35.949636 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:35.949535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xm7p\" (UniqueName: \"kubernetes.io/projected/5d9dec93-b285-4434-86ed-9edcdc1299c0-kube-api-access-2xm7p\") pod \"payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x\" (UID: \"5d9dec93-b285-4434-86ed-9edcdc1299c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 20:49:36.017630 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.017577    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:49:36.050137 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050115    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-data\") pod \"0734d745-9166-40da-bd70-7b1cc424b4d7\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") "
Jul 28 20:49:36.050269 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050147    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-podinfo\") pod \"0734d745-9166-40da-bd70-7b1cc424b4d7\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") "
Jul 28 20:49:36.050269 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050195    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-certs\") pod \"0734d745-9166-40da-bd70-7b1cc424b4d7\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") "
Jul 28 20:49:36.050269 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050211    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-token\") pod \"0734d745-9166-40da-bd70-7b1cc424b4d7\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") "
Jul 28 20:49:36.050443 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050272    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-envoy\") pod \"0734d745-9166-40da-bd70-7b1cc424b4d7\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") "
Jul 28 20:49:36.050443 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050292    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-credential-socket\") pod \"0734d745-9166-40da-bd70-7b1cc424b4d7\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") "
Jul 28 20:49:36.050512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050440    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0734d745-9166-40da-bd70-7b1cc424b4d7-istiod-ca-cert\") pod \"0734d745-9166-40da-bd70-7b1cc424b4d7\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") "
Jul 28 20:49:36.050512 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050480    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2nq5\" (UniqueName: \"kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-kube-api-access-p2nq5\") pod \"0734d745-9166-40da-bd70-7b1cc424b4d7\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") "
Jul 28 20:49:36.050580 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050522    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-socket\") pod \"0734d745-9166-40da-bd70-7b1cc424b4d7\" (UID: \"0734d745-9166-40da-bd70-7b1cc424b4d7\") "
Jul 28 20:49:36.050687 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d9dec93-b285-4434-86ed-9edcdc1299c0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x\" (UID: \"5d9dec93-b285-4434-86ed-9edcdc1299c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 20:49:36.050875 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050856    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "0734d745-9166-40da-bd70-7b1cc424b4d7" (UID: "0734d745-9166-40da-bd70-7b1cc424b4d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:36.050954 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.050928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xm7p\" (UniqueName: \"kubernetes.io/projected/5d9dec93-b285-4434-86ed-9edcdc1299c0-kube-api-access-2xm7p\") pod \"payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x\" (UID: \"5d9dec93-b285-4434-86ed-9edcdc1299c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 20:49:36.051129 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.051012    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:36.051129 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.051083    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0734d745-9166-40da-bd70-7b1cc424b4d7" (UID: "0734d745-9166-40da-bd70-7b1cc424b4d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:36.051362 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.051328    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0734d745-9166-40da-bd70-7b1cc424b4d7" (UID: "0734d745-9166-40da-bd70-7b1cc424b4d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:36.051528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.051503    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0734d745-9166-40da-bd70-7b1cc424b4d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0734d745-9166-40da-bd70-7b1cc424b4d7" (UID: "0734d745-9166-40da-bd70-7b1cc424b4d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:49:36.051819 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.051795    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0734d745-9166-40da-bd70-7b1cc424b4d7" (UID: "0734d745-9166-40da-bd70-7b1cc424b4d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:36.051953 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.051934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d9dec93-b285-4434-86ed-9edcdc1299c0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x\" (UID: \"5d9dec93-b285-4434-86ed-9edcdc1299c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 20:49:36.052556 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.052523    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0734d745-9166-40da-bd70-7b1cc424b4d7" (UID: "0734d745-9166-40da-bd70-7b1cc424b4d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:49:36.053291 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.053270    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "0734d745-9166-40da-bd70-7b1cc424b4d7" (UID: "0734d745-9166-40da-bd70-7b1cc424b4d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:49:36.053504 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.053487    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-kube-api-access-p2nq5" (OuterVolumeSpecName: "kube-api-access-p2nq5") pod "0734d745-9166-40da-bd70-7b1cc424b4d7" (UID: "0734d745-9166-40da-bd70-7b1cc424b4d7"). InnerVolumeSpecName "kube-api-access-p2nq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:49:36.053939 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.053923    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0734d745-9166-40da-bd70-7b1cc424b4d7" (UID: "0734d745-9166-40da-bd70-7b1cc424b4d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:36.061584 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.061560    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xm7p\" (UniqueName: \"kubernetes.io/projected/5d9dec93-b285-4434-86ed-9edcdc1299c0-kube-api-access-2xm7p\") pod \"payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x\" (UID: \"5d9dec93-b285-4434-86ed-9edcdc1299c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 20:49:36.140080 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.140052    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 20:49:36.152215 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.152182    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0734d745-9166-40da-bd70-7b1cc424b4d7-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:36.152215 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.152202    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2nq5\" (UniqueName: \"kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-kube-api-access-p2nq5\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:36.152215 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.152212    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:36.152467 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.152222    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:36.152467 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.152258    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:36.152467 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.152279    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:36.152467 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.152288    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:36.152467 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.152296    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0734d745-9166-40da-bd70-7b1cc424b4d7-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 20:49:36.293967 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:49:36.293932    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9dec93_b285_4434_86ed_9edcdc1299c0.slice/crio-b8c9ac7e611db338f6eae6ab88b0050d10dd02aed0f4fde9d0c255ac4d8702bd WatchSource:0}: Error finding container b8c9ac7e611db338f6eae6ab88b0050d10dd02aed0f4fde9d0c255ac4d8702bd: Status 404 returned error can't find the container with id b8c9ac7e611db338f6eae6ab88b0050d10dd02aed0f4fde9d0c255ac4d8702bd
Jul 28 20:49:36.295135 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.295110    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"]
Jul 28 20:49:36.930732 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.930705    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"
Jul 28 20:49:36.931210 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.930767    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m" event={"ID":"0734d745-9166-40da-bd70-7b1cc424b4d7","Type":"ContainerDied","Data":"e21d875e5fbb4f845b378e0922906c152a829f4c85c2eb954e24fa1c1fd7804c"}
Jul 28 20:49:36.931210 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.930817    2561 scope.go:117] "RemoveContainer" containerID="debaec007a67b6aabe6e1c0354ec81f58f89b3f04874b559380b0ec89891fad3"
Jul 28 20:49:36.932606 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.932584    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x" event={"ID":"5d9dec93-b285-4434-86ed-9edcdc1299c0","Type":"ContainerStarted","Data":"27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8"}
Jul 28 20:49:36.932722 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.932630    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x" event={"ID":"5d9dec93-b285-4434-86ed-9edcdc1299c0","Type":"ContainerStarted","Data":"b8c9ac7e611db338f6eae6ab88b0050d10dd02aed0f4fde9d0c255ac4d8702bd"}
Jul 28 20:49:36.932794 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.932741    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 20:49:36.959130 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.959090    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x" podStartSLOduration=1.9590770800000001 podStartE2EDuration="1.95907708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:49:36.9565277 +0000 UTC m=+2479.353230856" watchObservedRunningTime="2026-07-28 20:49:36.95907708 +0000 UTC m=+2479.355780247"
Jul 28 20:49:36.975634 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.975610    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"]
Jul 28 20:49:36.980336 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:36.980316    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-42ff09-openshift-default-58bc545b9b-g2k7m"]
Jul 28 20:49:38.076081 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:38.076050    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" path="/var/lib/kubelet/pods/0734d745-9166-40da-bd70-7b1cc424b4d7/volumes"
Jul 28 20:49:47.940877 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:47.940850    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 20:49:47.992772 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:47.992737    2561 generic.go:356] "Generic (PLEG): container finished" podID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerID="51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e" exitCode=0
Jul 28 20:49:47.992942 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:47.992792    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" event={"ID":"9163e173-6aee-457e-8ad5-811bbfb7ec70","Type":"ContainerDied","Data":"51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e"}
Jul 28 20:49:47.993302 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:47.993282    2561 scope.go:117] "RemoveContainer" containerID="51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e"
Jul 28 20:49:47.994479 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:47.994445    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:49:47.994590 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:47.994538    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:49:47.994633 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:47.994588    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:49:48.911779 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:48.911731    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:49.005256 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:49.005193    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" event={"ID":"9163e173-6aee-457e-8ad5-811bbfb7ec70","Type":"ContainerStarted","Data":"349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c"}
Jul 28 20:49:49.033019 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:49.032987    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:49.034098 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:49.034074    2561 patch_prober.go:28] interesting pod/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 28 20:49:49.034258 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:49.034122    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 28 20:49:50.032966 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:50.032933    2561 patch_prober.go:28] interesting pod/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 28 20:49:50.033450 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:50.032986    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 28 20:49:51.033069 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:51.033038    2561 patch_prober.go:28] interesting pod/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 28 20:49:51.033464 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:51.033095    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 28 20:49:52.032916 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:52.032883    2561 patch_prober.go:28] interesting pod/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 28 20:49:52.033088 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:52.032932    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 28 20:49:53.036226 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:53.036200    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:53.036692 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:53.036471    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:49:53.037194 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:49:53.037178    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 20:50:00.570706 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.570674    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"]
Jul 28 20:50:00.571174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.570997    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy"
Jul 28 20:50:00.571174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.571008    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy"
Jul 28 20:50:00.571174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.571025    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy"
Jul 28 20:50:00.571174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.571030    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy"
Jul 28 20:50:00.571174 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.571089    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy"
Jul 28 20:50:00.573949 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.573932    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.577807 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.577785    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-35c841-openshift-default-dockercfg-mvlhc\""
Jul 28 20:50:00.589817 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.589798    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"]
Jul 28 20:50:00.655767 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.655745    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-token\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.655885 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.655777    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/007f6530-a24c-4edc-895d-c1a7a5238f0f-istiod-ca-cert\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.655885 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.655797    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb9vp\" (UniqueName: \"kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-kube-api-access-kb9vp\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.655885 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.655847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-socket\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.655885 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.655864    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-podinfo\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.655885 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.655881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-certs\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.656098 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.655905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-data\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.656098 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.655963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-credential-socket\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.656098 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.655998    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-envoy\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.756929 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.756895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-credential-socket\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.756940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-envoy\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.756978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-token\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/007f6530-a24c-4edc-895d-c1a7a5238f0f-istiod-ca-cert\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757043    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb9vp\" (UniqueName: \"kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-kube-api-access-kb9vp\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757100 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757100    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-socket\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757423 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-podinfo\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757423 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-certs\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757423 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757366    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-credential-socket\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757423 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-data\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757650 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-socket\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757650 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-certs\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757766 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-data\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.757831 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.757808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/007f6530-a24c-4edc-895d-c1a7a5238f0f-istiod-ca-cert\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.759336 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.759313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-envoy\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.759668 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.759650    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-podinfo\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.771472 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.771447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-token\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.771565 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.771539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb9vp\" (UniqueName: \"kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-kube-api-access-kb9vp\") pod \"e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") " pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:00.884382 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:00.884333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:01.027287 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:01.027254    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"]
Jul 28 20:50:01.028300 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:50:01.028269    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007f6530_a24c_4edc_895d_c1a7a5238f0f.slice/crio-15a2e385809574340e02d8a944ff1f3857c0d7143f5f78cd715d45f5ef04e60e WatchSource:0}: Error finding container 15a2e385809574340e02d8a944ff1f3857c0d7143f5f78cd715d45f5ef04e60e: Status 404 returned error can't find the container with id 15a2e385809574340e02d8a944ff1f3857c0d7143f5f78cd715d45f5ef04e60e
Jul 28 20:50:01.030528 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:01.030498    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:50:01.030609 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:01.030557    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:50:01.030609 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:01.030583    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:50:01.075298 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:01.075266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" event={"ID":"007f6530-a24c-4edc-895d-c1a7a5238f0f","Type":"ContainerStarted","Data":"15a2e385809574340e02d8a944ff1f3857c0d7143f5f78cd715d45f5ef04e60e"}
Jul 28 20:50:02.082569 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:02.082529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" event={"ID":"007f6530-a24c-4edc-895d-c1a7a5238f0f","Type":"ContainerStarted","Data":"9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531"}
Jul 28 20:50:02.105151 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:02.105100    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" podStartSLOduration=2.105084743 podStartE2EDuration="2.105084743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:50:02.102353205 +0000 UTC m=+2504.499056397" watchObservedRunningTime="2026-07-28 20:50:02.105084743 +0000 UTC m=+2504.501787899"
Jul 28 20:50:02.885342 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:02.885308    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:02.890333 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:02.890309    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:03.087955 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:03.087926    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:03.088769 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:03.088750    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:05.130920 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.130889    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"]
Jul 28 20:50:05.132069 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.132043    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0734d745-9166-40da-bd70-7b1cc424b4d7" containerName="istio-proxy"
Jul 28 20:50:05.135625 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.135602    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 20:50:05.138196 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.138174    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-35c841\""
Jul 28 20:50:05.138440 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.138426    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-35c841-dockercfg-hm8gc\""
Jul 28 20:50:05.148204 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.148181    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"]
Jul 28 20:50:05.293497 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.293462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf\" (UID: \"64de0412-66f8-4bc8-ab84-0a4d9743c7c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 20:50:05.293682 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.293520    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzzm\" (UniqueName: \"kubernetes.io/projected/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-kube-api-access-ptzzm\") pod \"payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf\" (UID: \"64de0412-66f8-4bc8-ab84-0a4d9743c7c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 20:50:05.394379 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.394309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf\" (UID: \"64de0412-66f8-4bc8-ab84-0a4d9743c7c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 20:50:05.394379 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.394355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzzm\" (UniqueName: \"kubernetes.io/projected/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-kube-api-access-ptzzm\") pod \"payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf\" (UID: \"64de0412-66f8-4bc8-ab84-0a4d9743c7c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 20:50:05.395056 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.395038    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf\" (UID: \"64de0412-66f8-4bc8-ab84-0a4d9743c7c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 20:50:05.405153 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.405128    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzzm\" (UniqueName: \"kubernetes.io/projected/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-kube-api-access-ptzzm\") pod \"payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf\" (UID: \"64de0412-66f8-4bc8-ab84-0a4d9743c7c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 20:50:05.447210 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.447184    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 20:50:05.580219 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:05.580196    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"]
Jul 28 20:50:05.581784 ip-10-0-136-137 kubenswrapper[2561]: W0728 20:50:05.581757    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64de0412_66f8_4bc8_ab84_0a4d9743c7c6.slice/crio-67fbfc7eac97cba4758109de696ffa39a5ef0462afc1d1ea74555708be9f6553 WatchSource:0}: Error finding container 67fbfc7eac97cba4758109de696ffa39a5ef0462afc1d1ea74555708be9f6553: Status 404 returned error can't find the container with id 67fbfc7eac97cba4758109de696ffa39a5ef0462afc1d1ea74555708be9f6553
Jul 28 20:50:06.105046 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:06.105012    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf" event={"ID":"64de0412-66f8-4bc8-ab84-0a4d9743c7c6","Type":"ContainerStarted","Data":"7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a"}
Jul 28 20:50:06.105249 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:06.105065    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf" event={"ID":"64de0412-66f8-4bc8-ab84-0a4d9743c7c6","Type":"ContainerStarted","Data":"67fbfc7eac97cba4758109de696ffa39a5ef0462afc1d1ea74555708be9f6553"}
Jul 28 20:50:06.105249 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:06.105097    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 20:50:06.125712 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:06.125665    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf" podStartSLOduration=1.125651297 podStartE2EDuration="1.125651297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:50:06.123312698 +0000 UTC m=+2508.520015853" watchObservedRunningTime="2026-07-28 20:50:06.125651297 +0000 UTC m=+2508.522354482"
Jul 28 20:50:17.112550 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:17.112528    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 20:50:19.130389 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:19.130356    2561 patch_prober.go:28] interesting pod/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 20:50:19.130765 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:19.130417    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 20:50:20.188308 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:20.188275    2561 generic.go:356] "Generic (PLEG): container finished" podID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerID="9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531" exitCode=0
Jul 28 20:50:20.188779 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:20.188320    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" event={"ID":"007f6530-a24c-4edc-895d-c1a7a5238f0f","Type":"ContainerDied","Data":"9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531"}
Jul 28 20:50:20.188779 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:20.188714    2561 scope.go:117] "RemoveContainer" containerID="9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531"
Jul 28 20:50:20.189743 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:20.189716    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:50:20.189807 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:20.189790    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:50:20.189848 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:20.189833    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:50:21.199879 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:21.199834    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" event={"ID":"007f6530-a24c-4edc-895d-c1a7a5238f0f","Type":"ContainerStarted","Data":"5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2"}
Jul 28 20:50:21.885472 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:21.885443    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:21.885705 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:21.885682    2561 patch_prober.go:28] interesting pod/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 28 20:50:21.885754 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:21.885732    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 28 20:50:22.885771 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:22.885727    2561 patch_prober.go:28] interesting pod/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 28 20:50:22.886178 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:22.885795    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 28 20:50:23.885361 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:23.885324    2561 patch_prober.go:28] interesting pod/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 28 20:50:23.885547 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:23.885382    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 28 20:50:24.885781 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:24.885742    2561 patch_prober.go:28] interesting pod/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 28 20:50:24.886193 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:24.885805    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 28 20:50:25.888602 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:25.888567    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:25.889073 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:25.889004    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:50:25.889720 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:50:25.889699    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 20:51:18.499832 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:51:18.499800    2561 scope.go:117] "RemoveContainer" containerID="2ab75858115db2d6de238b3882b9a4328e87acca09bc8e4b084ea81b30ce8a4c"
Jul 28 20:53:18.350624 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:53:18.350548    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:53:18.357857 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:53:18.357835    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:53:18.529627 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:53:18.529598    2561 scope.go:117] "RemoveContainer" containerID="e6800844bdd80875e15ecf7f918537846952353e5583dca955d5497237aba428"
Jul 28 20:54:18.551333 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:54:18.551303    2561 scope.go:117] "RemoveContainer" containerID="b33875cbaa90eb2ac0074be071f52eabe22c6fce8999987eb687523f423d5fd0"
Jul 28 20:58:18.389895 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:58:18.389861    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 20:58:18.397902 ip-10-0-136-137 kubenswrapper[2561]: I0728 20:58:18.397880    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 21:01:02.423678 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.423643    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"]
Jul 28 21:01:02.427004 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.426987    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.430141 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.430119    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ce337a-openshift-default-dockercfg-kbl6b\""
Jul 28 21:01:02.440021 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.439996    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"]
Jul 28 21:01:02.496411 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.496378    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-socket\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.496411 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.496422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf6lt\" (UniqueName: \"kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-kube-api-access-rf6lt\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.496637 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.496502    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-credential-socket\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.496637 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.496553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-certs\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.496637 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.496613    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc677cbc-8071-490a-94af-33ed7139b610-istiod-ca-cert\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.496775 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.496646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-istio-token\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.496775 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.496669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc677cbc-8071-490a-94af-33ed7139b610-istio-podinfo\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.496775 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.496705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-data\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.496775 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.496723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-envoy\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597303 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-socket\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597303 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf6lt\" (UniqueName: \"kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-kube-api-access-rf6lt\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597562 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-credential-socket\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597562 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597389    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-certs\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597562 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc677cbc-8071-490a-94af-33ed7139b610-istiod-ca-cert\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597562 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-istio-token\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597562 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc677cbc-8071-490a-94af-33ed7139b610-istio-podinfo\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597562 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-data\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597853 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-envoy\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597853 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-socket\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597853 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-certs\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.597998 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.597972    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-data\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.598056 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.598035    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-credential-socket\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.598134 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.598114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc677cbc-8071-490a-94af-33ed7139b610-istiod-ca-cert\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.599829 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.599806    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-envoy\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.600063 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.600042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc677cbc-8071-490a-94af-33ed7139b610-istio-podinfo\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.605315 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.605291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf6lt\" (UniqueName: \"kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-kube-api-access-rf6lt\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.605398 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.605351    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-istio-token\") pod \"e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") " pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.736894 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.736808    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:02.879080 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.879053    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"]
Jul 28 21:01:02.880635 ip-10-0-136-137 kubenswrapper[2561]: W0728 21:01:02.880604    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc677cbc_8071_490a_94af_33ed7139b610.slice/crio-ced959cbbfd2527a69d2029331bffe0a246e9a9d29b1c1a4422a5dcc8e4c2e70 WatchSource:0}: Error finding container ced959cbbfd2527a69d2029331bffe0a246e9a9d29b1c1a4422a5dcc8e4c2e70: Status 404 returned error can't find the container with id ced959cbbfd2527a69d2029331bffe0a246e9a9d29b1c1a4422a5dcc8e4c2e70
Jul 28 21:01:02.882756 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.882725    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:02.882842 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.882790    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:02.882842 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:02.882817    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:03.666401 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:03.666357    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" event={"ID":"fc677cbc-8071-490a-94af-33ed7139b610","Type":"ContainerStarted","Data":"548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e"}
Jul 28 21:01:03.666883 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:03.666416    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" event={"ID":"fc677cbc-8071-490a-94af-33ed7139b610","Type":"ContainerStarted","Data":"ced959cbbfd2527a69d2029331bffe0a246e9a9d29b1c1a4422a5dcc8e4c2e70"}
Jul 28 21:01:03.689773 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:03.689718    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" podStartSLOduration=1.689701784 podStartE2EDuration="1.689701784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:01:03.687700206 +0000 UTC m=+3166.084403363" watchObservedRunningTime="2026-07-28 21:01:03.689701784 +0000 UTC m=+3166.086404939"
Jul 28 21:01:03.738023 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:03.737987    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:03.742751 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:03.742727    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:04.672417 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:04.672388    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:04.673430 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:04.673410    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:23.782315 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:23.782279    2561 generic.go:356] "Generic (PLEG): container finished" podID="fc677cbc-8071-490a-94af-33ed7139b610" containerID="548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e" exitCode=0
Jul 28 21:01:23.782736 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:23.782354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" event={"ID":"fc677cbc-8071-490a-94af-33ed7139b610","Type":"ContainerDied","Data":"548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e"}
Jul 28 21:01:23.782785 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:23.782755    2561 scope.go:117] "RemoveContainer" containerID="548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e"
Jul 28 21:01:23.783839 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:23.783813    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:23.783933 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:23.783874    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:23.783933 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:23.783921    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:24.789281 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:24.789225    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" event={"ID":"fc677cbc-8071-490a-94af-33ed7139b610","Type":"ContainerStarted","Data":"bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa"}
Jul 28 21:01:25.737414 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:25.737375    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:25.737723 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:25.737701    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 28 21:01:25.737790 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:25.737759    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" podUID="fc677cbc-8071-490a-94af-33ed7139b610" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 28 21:01:26.737898 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:26.737855    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 28 21:01:26.738508 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:26.737933    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" podUID="fc677cbc-8071-490a-94af-33ed7139b610" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 28 21:01:27.737518 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:27.737485    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 28 21:01:27.737705 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:27.737549    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" podUID="fc677cbc-8071-490a-94af-33ed7139b610" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 28 21:01:28.740788 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:28.740759    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:28.741175 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:28.741139    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:28.741777 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:28.741760    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:01:38.566519 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.566485    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"]
Jul 28 21:01:38.570077 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.570058    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:01:38.573696 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.573670    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-542599-dockercfg-wh95b\""
Jul 28 21:01:38.573930 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.573915    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-542599\""
Jul 28 21:01:38.586597 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.586570    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"]
Jul 28 21:01:38.589841 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.589827    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:01:38.596804 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.596782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"]
Jul 28 21:01:38.603726 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.603700    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"]
Jul 28 21:01:38.646502 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.646459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl5n6\" (UniqueName: \"kubernetes.io/projected/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-kube-api-access-cl5n6\") pod \"payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn\" (UID: \"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:01:38.646732 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.646586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn\" (UID: \"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:01:38.747216 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.747179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl5n6\" (UniqueName: \"kubernetes.io/projected/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-kube-api-access-cl5n6\") pod \"payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn\" (UID: \"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:01:38.747216 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.747225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz7wx\" (UniqueName: \"kubernetes.io/projected/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-kube-api-access-xz7wx\") pod \"payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb\" (UID: \"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:01:38.747479 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.747297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn\" (UID: \"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:01:38.747479 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.747319    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb\" (UID: \"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:01:38.748080 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.748059    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn\" (UID: \"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:01:38.755852 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.755827    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl5n6\" (UniqueName: \"kubernetes.io/projected/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-kube-api-access-cl5n6\") pod \"payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn\" (UID: \"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:01:38.847992 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.847892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb\" (UID: \"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:01:38.847992 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.847995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7wx\" (UniqueName: \"kubernetes.io/projected/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-kube-api-access-xz7wx\") pod \"payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb\" (UID: \"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:01:38.848644 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.848625    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb\" (UID: \"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:01:38.860373 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.860344    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz7wx\" (UniqueName: \"kubernetes.io/projected/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-kube-api-access-xz7wx\") pod \"payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb\" (UID: \"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:01:38.880696 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.880662    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:01:38.902048 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:38.902015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:01:39.064050 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:39.064025    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"]
Jul 28 21:01:39.065915 ip-10-0-136-137 kubenswrapper[2561]: W0728 21:01:39.065894    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3692d9d_2d1f_4ff5_bba0_3b84e6f42183.slice/crio-d0f07a04568de304c273d0c729839d35f5a8f995978d52b685b0e8becc71c3aa WatchSource:0}: Error finding container d0f07a04568de304c273d0c729839d35f5a8f995978d52b685b0e8becc71c3aa: Status 404 returned error can't find the container with id d0f07a04568de304c273d0c729839d35f5a8f995978d52b685b0e8becc71c3aa
Jul 28 21:01:39.243068 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:39.243044    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"]
Jul 28 21:01:39.244650 ip-10-0-136-137 kubenswrapper[2561]: W0728 21:01:39.244627    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d039c4e_f21c_48f8_8841_dcc3d66b4e2d.slice/crio-45f6656d9fd8a6491403464bacd54eac5f62b1f1dc3b863993cd10bc747380d2 WatchSource:0}: Error finding container 45f6656d9fd8a6491403464bacd54eac5f62b1f1dc3b863993cd10bc747380d2: Status 404 returned error can't find the container with id 45f6656d9fd8a6491403464bacd54eac5f62b1f1dc3b863993cd10bc747380d2
Jul 28 21:01:39.884044 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:39.884010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb" event={"ID":"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183","Type":"ContainerStarted","Data":"cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c"}
Jul 28 21:01:39.884531 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:39.884071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb" event={"ID":"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183","Type":"ContainerStarted","Data":"d0f07a04568de304c273d0c729839d35f5a8f995978d52b685b0e8becc71c3aa"}
Jul 28 21:01:39.884531 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:39.884224    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:01:39.885537 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:39.885516    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn" event={"ID":"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d","Type":"ContainerStarted","Data":"5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694"}
Jul 28 21:01:39.885655 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:39.885551    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn" event={"ID":"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d","Type":"ContainerStarted","Data":"45f6656d9fd8a6491403464bacd54eac5f62b1f1dc3b863993cd10bc747380d2"}
Jul 28 21:01:39.885727 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:39.885658    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:01:39.902131 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:39.902081    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb" podStartSLOduration=1.9020666899999998 podStartE2EDuration="1.90206669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:01:39.899865464 +0000 UTC m=+3202.296568640" watchObservedRunningTime="2026-07-28 21:01:39.90206669 +0000 UTC m=+3202.298769846"
Jul 28 21:01:39.918903 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:39.918854    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn" podStartSLOduration=1.91883812 podStartE2EDuration="1.91883812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:01:39.917952357 +0000 UTC m=+3202.314655514" watchObservedRunningTime="2026-07-28 21:01:39.91883812 +0000 UTC m=+3202.315541276"
Jul 28 21:01:50.893399 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:50.893354    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:01:50.893847 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:01:50.893536    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:02:09.485220 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:02:09.485182    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-864kr_180c0d40-0a50-431e-b082-6ac16adfaf80/payload-processing/0.log"
Jul 28 21:02:09.612612 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:02:09.612581    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn_7d039c4e-f21c-48f8-8841-dcc3d66b4e2d/payload-processing/0.log"
Jul 28 21:03:18.427853 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:18.427823    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 21:03:18.436442 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:18.436419    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 21:03:27.446350 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:27.446323    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-864kr_180c0d40-0a50-431e-b082-6ac16adfaf80/payload-processing/0.log"
Jul 28 21:03:27.564838 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:27.564806    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn_7d039c4e-f21c-48f8-8841-dcc3d66b4e2d/payload-processing/0.log"
Jul 28 21:03:32.208632 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.208592    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"]
Jul 28 21:03:32.212334 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.212311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:03:32.215059 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.215036    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-edb657\""
Jul 28 21:03:32.215173 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.215106    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-edb657-dockercfg-s6cj7\""
Jul 28 21:03:32.222063 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.222038    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"]
Jul 28 21:03:32.225012 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.224991    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"]
Jul 28 21:03:32.228631 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.228612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:03:32.241974 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.241948    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"]
Jul 28 21:03:32.324333 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.324272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g76vb\" (UniqueName: \"kubernetes.io/projected/6eee9f5d-b147-4b45-ad48-0be49c47dd53-kube-api-access-g76vb\") pod \"payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9\" (UID: \"6eee9f5d-b147-4b45-ad48-0be49c47dd53\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:03:32.324515 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.324356    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf\" (UID: \"be85a0d9-79bd-4eb8-b3ac-5ec048085c07\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:03:32.324515 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.324421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g6f6\" (UniqueName: \"kubernetes.io/projected/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-kube-api-access-6g6f6\") pod \"payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf\" (UID: \"be85a0d9-79bd-4eb8-b3ac-5ec048085c07\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:03:32.324515 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.324462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eee9f5d-b147-4b45-ad48-0be49c47dd53-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9\" (UID: \"6eee9f5d-b147-4b45-ad48-0be49c47dd53\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:03:32.425047 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.425007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eee9f5d-b147-4b45-ad48-0be49c47dd53-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9\" (UID: \"6eee9f5d-b147-4b45-ad48-0be49c47dd53\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:03:32.425217 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.425119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g76vb\" (UniqueName: \"kubernetes.io/projected/6eee9f5d-b147-4b45-ad48-0be49c47dd53-kube-api-access-g76vb\") pod \"payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9\" (UID: \"6eee9f5d-b147-4b45-ad48-0be49c47dd53\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:03:32.425217 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.425149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf\" (UID: \"be85a0d9-79bd-4eb8-b3ac-5ec048085c07\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:03:32.425217 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.425187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g6f6\" (UniqueName: \"kubernetes.io/projected/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-kube-api-access-6g6f6\") pod \"payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf\" (UID: \"be85a0d9-79bd-4eb8-b3ac-5ec048085c07\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:03:32.425879 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.425858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf\" (UID: \"be85a0d9-79bd-4eb8-b3ac-5ec048085c07\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:03:32.425918 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.425902    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eee9f5d-b147-4b45-ad48-0be49c47dd53-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9\" (UID: \"6eee9f5d-b147-4b45-ad48-0be49c47dd53\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:03:32.433871 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.433841    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g6f6\" (UniqueName: \"kubernetes.io/projected/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-kube-api-access-6g6f6\") pod \"payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf\" (UID: \"be85a0d9-79bd-4eb8-b3ac-5ec048085c07\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:03:32.434000 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.433966    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g76vb\" (UniqueName: \"kubernetes.io/projected/6eee9f5d-b147-4b45-ad48-0be49c47dd53-kube-api-access-g76vb\") pod \"payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9\" (UID: \"6eee9f5d-b147-4b45-ad48-0be49c47dd53\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:03:32.523403 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.523370    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:03:32.539577 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.539549    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:03:32.676525 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.676497    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"]
Jul 28 21:03:32.677653 ip-10-0-136-137 kubenswrapper[2561]: W0728 21:03:32.677622    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eee9f5d_b147_4b45_ad48_0be49c47dd53.slice/crio-01dea7cf8d1589b0eaecca612c6894616f1e0b5b61912ef00639bba4f43ab155 WatchSource:0}: Error finding container 01dea7cf8d1589b0eaecca612c6894616f1e0b5b61912ef00639bba4f43ab155: Status 404 returned error can't find the container with id 01dea7cf8d1589b0eaecca612c6894616f1e0b5b61912ef00639bba4f43ab155
Jul 28 21:03:32.910040 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:32.910009    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"]
Jul 28 21:03:32.910943 ip-10-0-136-137 kubenswrapper[2561]: W0728 21:03:32.910916    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe85a0d9_79bd_4eb8_b3ac_5ec048085c07.slice/crio-3ec2da441b0df744650963a16f9b23cfc5182c28155d6b5db79d3def21726616 WatchSource:0}: Error finding container 3ec2da441b0df744650963a16f9b23cfc5182c28155d6b5db79d3def21726616: Status 404 returned error can't find the container with id 3ec2da441b0df744650963a16f9b23cfc5182c28155d6b5db79d3def21726616
Jul 28 21:03:33.519019 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:33.518977    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9" event={"ID":"6eee9f5d-b147-4b45-ad48-0be49c47dd53","Type":"ContainerStarted","Data":"53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69"}
Jul 28 21:03:33.519516 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:33.519042    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:03:33.519516 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:33.519060    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9" event={"ID":"6eee9f5d-b147-4b45-ad48-0be49c47dd53","Type":"ContainerStarted","Data":"01dea7cf8d1589b0eaecca612c6894616f1e0b5b61912ef00639bba4f43ab155"}
Jul 28 21:03:33.520587 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:33.520564    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf" event={"ID":"be85a0d9-79bd-4eb8-b3ac-5ec048085c07","Type":"ContainerStarted","Data":"2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f"}
Jul 28 21:03:33.520685 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:33.520601    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf" event={"ID":"be85a0d9-79bd-4eb8-b3ac-5ec048085c07","Type":"ContainerStarted","Data":"3ec2da441b0df744650963a16f9b23cfc5182c28155d6b5db79d3def21726616"}
Jul 28 21:03:33.520751 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:33.520696    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:03:33.543653 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:33.543587    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9" podStartSLOduration=1.5435650939999999 podStartE2EDuration="1.543565094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:03:33.541756952 +0000 UTC m=+3315.938460135" watchObservedRunningTime="2026-07-28 21:03:33.543565094 +0000 UTC m=+3315.940268251"
Jul 28 21:03:33.558133 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:33.558079    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf" podStartSLOduration=1.558064275 podStartE2EDuration="1.558064275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:03:33.556513702 +0000 UTC m=+3315.953216882" watchObservedRunningTime="2026-07-28 21:03:33.558064275 +0000 UTC m=+3315.954767466"
Jul 28 21:03:44.529264 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:44.529156    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:03:44.529264 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:03:44.529251    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:04:01.934485 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:01.934445    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"]
Jul 28 21:04:01.934943 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:01.934706    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf" podUID="be85a0d9-79bd-4eb8-b3ac-5ec048085c07" containerName="payload-processing" containerID="cri-o://2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f" gracePeriod=30
Jul 28 21:04:01.947024 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:01.946992    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"]
Jul 28 21:04:01.947306 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:01.947255    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9" podUID="6eee9f5d-b147-4b45-ad48-0be49c47dd53" containerName="payload-pre-processing" containerID="cri-o://53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69" gracePeriod=30
Jul 28 21:04:02.243313 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.243286    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:04:02.246350 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.246327    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:04:02.319230 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.319196    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g6f6\" (UniqueName: \"kubernetes.io/projected/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-kube-api-access-6g6f6\") pod \"be85a0d9-79bd-4eb8-b3ac-5ec048085c07\" (UID: \"be85a0d9-79bd-4eb8-b3ac-5ec048085c07\") "
Jul 28 21:04:02.319434 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.319304    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g76vb\" (UniqueName: \"kubernetes.io/projected/6eee9f5d-b147-4b45-ad48-0be49c47dd53-kube-api-access-g76vb\") pod \"6eee9f5d-b147-4b45-ad48-0be49c47dd53\" (UID: \"6eee9f5d-b147-4b45-ad48-0be49c47dd53\") "
Jul 28 21:04:02.319434 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.319344    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-plugins-config-volume\") pod \"be85a0d9-79bd-4eb8-b3ac-5ec048085c07\" (UID: \"be85a0d9-79bd-4eb8-b3ac-5ec048085c07\") "
Jul 28 21:04:02.319434 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.319378    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eee9f5d-b147-4b45-ad48-0be49c47dd53-plugins-config-volume\") pod \"6eee9f5d-b147-4b45-ad48-0be49c47dd53\" (UID: \"6eee9f5d-b147-4b45-ad48-0be49c47dd53\") "
Jul 28 21:04:02.319757 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.319722    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be85a0d9-79bd-4eb8-b3ac-5ec048085c07" (UID: "be85a0d9-79bd-4eb8-b3ac-5ec048085c07"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:04:02.319757 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.319729    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eee9f5d-b147-4b45-ad48-0be49c47dd53-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6eee9f5d-b147-4b45-ad48-0be49c47dd53" (UID: "6eee9f5d-b147-4b45-ad48-0be49c47dd53"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:04:02.321459 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.321437    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-kube-api-access-6g6f6" (OuterVolumeSpecName: "kube-api-access-6g6f6") pod "be85a0d9-79bd-4eb8-b3ac-5ec048085c07" (UID: "be85a0d9-79bd-4eb8-b3ac-5ec048085c07"). InnerVolumeSpecName "kube-api-access-6g6f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:04:02.321549 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.321496    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eee9f5d-b147-4b45-ad48-0be49c47dd53-kube-api-access-g76vb" (OuterVolumeSpecName: "kube-api-access-g76vb") pod "6eee9f5d-b147-4b45-ad48-0be49c47dd53" (UID: "6eee9f5d-b147-4b45-ad48-0be49c47dd53"). InnerVolumeSpecName "kube-api-access-g76vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:04:02.420407 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.420370    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6eee9f5d-b147-4b45-ad48-0be49c47dd53-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:04:02.420407 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.420399    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g6f6\" (UniqueName: \"kubernetes.io/projected/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-kube-api-access-6g6f6\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:04:02.420407 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.420409    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g76vb\" (UniqueName: \"kubernetes.io/projected/6eee9f5d-b147-4b45-ad48-0be49c47dd53-kube-api-access-g76vb\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:04:02.420407 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.420417    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be85a0d9-79bd-4eb8-b3ac-5ec048085c07-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:04:02.687032 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.686995    2561 generic.go:356] "Generic (PLEG): container finished" podID="be85a0d9-79bd-4eb8-b3ac-5ec048085c07" containerID="2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f" exitCode=0
Jul 28 21:04:02.687264 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.687044    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"
Jul 28 21:04:02.687264 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.687080    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf" event={"ID":"be85a0d9-79bd-4eb8-b3ac-5ec048085c07","Type":"ContainerDied","Data":"2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f"}
Jul 28 21:04:02.687264 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.687131    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf" event={"ID":"be85a0d9-79bd-4eb8-b3ac-5ec048085c07","Type":"ContainerDied","Data":"3ec2da441b0df744650963a16f9b23cfc5182c28155d6b5db79d3def21726616"}
Jul 28 21:04:02.687264 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.687158    2561 scope.go:117] "RemoveContainer" containerID="2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f"
Jul 28 21:04:02.688347 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.688325    2561 generic.go:356] "Generic (PLEG): container finished" podID="6eee9f5d-b147-4b45-ad48-0be49c47dd53" containerID="53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69" exitCode=0
Jul 28 21:04:02.688475 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.688380    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"
Jul 28 21:04:02.688475 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.688394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9" event={"ID":"6eee9f5d-b147-4b45-ad48-0be49c47dd53","Type":"ContainerDied","Data":"53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69"}
Jul 28 21:04:02.688475 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.688422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9" event={"ID":"6eee9f5d-b147-4b45-ad48-0be49c47dd53","Type":"ContainerDied","Data":"01dea7cf8d1589b0eaecca612c6894616f1e0b5b61912ef00639bba4f43ab155"}
Jul 28 21:04:02.698067 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.698050    2561 scope.go:117] "RemoveContainer" containerID="2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f"
Jul 28 21:04:02.698394 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:04:02.698368    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f\": container with ID starting with 2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f not found: ID does not exist" containerID="2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f"
Jul 28 21:04:02.698503 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.698405    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f"} err="failed to get container status \"2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f\": rpc error: code = NotFound desc = could not find container \"2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f\": container with ID starting with 2de187bf4dfb097e2c013b170135bf60ed94931b8007062c78c92b716facef0f not found: ID does not exist"
Jul 28 21:04:02.698503 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.698428    2561 scope.go:117] "RemoveContainer" containerID="53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69"
Jul 28 21:04:02.707051 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.707002    2561 scope.go:117] "RemoveContainer" containerID="53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69"
Jul 28 21:04:02.707380 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:04:02.707353    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69\": container with ID starting with 53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69 not found: ID does not exist" containerID="53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69"
Jul 28 21:04:02.707471 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.707383    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69"} err="failed to get container status \"53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69\": rpc error: code = NotFound desc = could not find container \"53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69\": container with ID starting with 53e29ed1cb8718473b48a813660f0f46074378d09be4a6d016be74a46be0db69 not found: ID does not exist"
Jul 28 21:04:02.709227 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.709208    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"]
Jul 28 21:04:02.719636 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.719610    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-edb657-86f88fb8c4-vs8mf"]
Jul 28 21:04:02.728932 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.728904    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"]
Jul 28 21:04:02.732971 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:02.732947    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-edb657-c5ffc4968-tbhs9"]
Jul 28 21:04:04.076906 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:04.076875    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eee9f5d-b147-4b45-ad48-0be49c47dd53" path="/var/lib/kubelet/pods/6eee9f5d-b147-4b45-ad48-0be49c47dd53/volumes"
Jul 28 21:04:04.077382 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:04.077220    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be85a0d9-79bd-4eb8-b3ac-5ec048085c07" path="/var/lib/kubelet/pods/be85a0d9-79bd-4eb8-b3ac-5ec048085c07/volumes"
Jul 28 21:04:12.477196 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.477163    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"]
Jul 28 21:04:12.477606 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.477560    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eee9f5d-b147-4b45-ad48-0be49c47dd53" containerName="payload-pre-processing"
Jul 28 21:04:12.477606 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.477572    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eee9f5d-b147-4b45-ad48-0be49c47dd53" containerName="payload-pre-processing"
Jul 28 21:04:12.477606 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.477590    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be85a0d9-79bd-4eb8-b3ac-5ec048085c07" containerName="payload-processing"
Jul 28 21:04:12.477606 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.477596    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="be85a0d9-79bd-4eb8-b3ac-5ec048085c07" containerName="payload-processing"
Jul 28 21:04:12.477792 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.477654    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="be85a0d9-79bd-4eb8-b3ac-5ec048085c07" containerName="payload-processing"
Jul 28 21:04:12.477792 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.477665    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eee9f5d-b147-4b45-ad48-0be49c47dd53" containerName="payload-pre-processing"
Jul 28 21:04:12.482110 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.482092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"
Jul 28 21:04:12.484634 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.484605    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 21:04:12.485197 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.485174    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 21:04:12.487648 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.487627    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"]
Jul 28 21:04:12.619851 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.619811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9e8391-a27c-4609-970c-4c4128283ee5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt\" (UID: \"eb9e8391-a27c-4609-970c-4c4128283ee5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"
Jul 28 21:04:12.721161 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.721124    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9e8391-a27c-4609-970c-4c4128283ee5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt\" (UID: \"eb9e8391-a27c-4609-970c-4c4128283ee5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"
Jul 28 21:04:12.721761 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.721742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9e8391-a27c-4609-970c-4c4128283ee5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt\" (UID: \"eb9e8391-a27c-4609-970c-4c4128283ee5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"
Jul 28 21:04:12.795360 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.795308    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"
Jul 28 21:04:12.928418 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:12.928389    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"]
Jul 28 21:04:12.930508 ip-10-0-136-137 kubenswrapper[2561]: W0728 21:04:12.930473    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9e8391_a27c_4609_970c_4c4128283ee5.slice/crio-f7ba89e17eb94927e21084a2112e27269cabeeee748b3a196e018d871346c244 WatchSource:0}: Error finding container f7ba89e17eb94927e21084a2112e27269cabeeee748b3a196e018d871346c244: Status 404 returned error can't find the container with id f7ba89e17eb94927e21084a2112e27269cabeeee748b3a196e018d871346c244
Jul 28 21:04:13.752664 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:13.752625    2561 generic.go:356] "Generic (PLEG): container finished" podID="eb9e8391-a27c-4609-970c-4c4128283ee5" containerID="ed86bc1edbbc19b67aa18e992495bb12b75fa705acef50b7a94a6c4bd6e58223" exitCode=0
Jul 28 21:04:13.753042 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:13.752686    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt" event={"ID":"eb9e8391-a27c-4609-970c-4c4128283ee5","Type":"ContainerDied","Data":"ed86bc1edbbc19b67aa18e992495bb12b75fa705acef50b7a94a6c4bd6e58223"}
Jul 28 21:04:13.753042 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:13.752726    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt" event={"ID":"eb9e8391-a27c-4609-970c-4c4128283ee5","Type":"ContainerStarted","Data":"f7ba89e17eb94927e21084a2112e27269cabeeee748b3a196e018d871346c244"}
Jul 28 21:04:14.892541 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:14.892512    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"
Jul 28 21:04:15.044875 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:15.044782    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9e8391-a27c-4609-970c-4c4128283ee5-maas-api-service-ca\") pod \"eb9e8391-a27c-4609-970c-4c4128283ee5\" (UID: \"eb9e8391-a27c-4609-970c-4c4128283ee5\") "
Jul 28 21:04:15.045176 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:15.045151    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb9e8391-a27c-4609-970c-4c4128283ee5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb9e8391-a27c-4609-970c-4c4128283ee5" (UID: "eb9e8391-a27c-4609-970c-4c4128283ee5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:04:15.146197 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:15.146160    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9e8391-a27c-4609-970c-4c4128283ee5-maas-api-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:04:15.764290 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:15.764252    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"
Jul 28 21:04:15.764290 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:15.764277    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt" event={"ID":"eb9e8391-a27c-4609-970c-4c4128283ee5","Type":"ContainerDied","Data":"f7ba89e17eb94927e21084a2112e27269cabeeee748b3a196e018d871346c244"}
Jul 28 21:04:15.764508 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:15.764359    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7ba89e17eb94927e21084a2112e27269cabeeee748b3a196e018d871346c244"
Jul 28 21:04:28.172966 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:28.172922    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"]
Jul 28 21:04:28.180606 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:28.180574    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ce337a-qpbbt"]
Jul 28 21:04:30.080078 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:04:30.080035    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9e8391-a27c-4609-970c-4c4128283ee5" path="/var/lib/kubelet/pods/eb9e8391-a27c-4609-970c-4c4128283ee5/volumes"
Jul 28 21:05:16.718097 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:16.718062    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"]
Jul 28 21:05:16.718596 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:16.718295    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" podUID="fc677cbc-8071-490a-94af-33ed7139b610" containerName="istio-proxy" containerID="cri-o://bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa" gracePeriod=30
Jul 28 21:05:21.977132 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.977065    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:05:21.979131 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979108    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc677cbc-8071-490a-94af-33ed7139b610-istiod-ca-cert\") pod \"fc677cbc-8071-490a-94af-33ed7139b610\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") "
Jul 28 21:05:21.979230 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979158    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-data\") pod \"fc677cbc-8071-490a-94af-33ed7139b610\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") "
Jul 28 21:05:21.979230 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979223    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf6lt\" (UniqueName: \"kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-kube-api-access-rf6lt\") pod \"fc677cbc-8071-490a-94af-33ed7139b610\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") "
Jul 28 21:05:21.979371 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979301    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-certs\") pod \"fc677cbc-8071-490a-94af-33ed7139b610\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") "
Jul 28 21:05:21.979371 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979336    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc677cbc-8071-490a-94af-33ed7139b610-istio-podinfo\") pod \"fc677cbc-8071-490a-94af-33ed7139b610\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") "
Jul 28 21:05:21.979371 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979362    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-socket\") pod \"fc677cbc-8071-490a-94af-33ed7139b610\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") "
Jul 28 21:05:21.979528 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979395    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-envoy\") pod \"fc677cbc-8071-490a-94af-33ed7139b610\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") "
Jul 28 21:05:21.979528 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979434    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-credential-socket\") pod \"fc677cbc-8071-490a-94af-33ed7139b610\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") "
Jul 28 21:05:21.979528 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979483    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-istio-token\") pod \"fc677cbc-8071-490a-94af-33ed7139b610\" (UID: \"fc677cbc-8071-490a-94af-33ed7139b610\") "
Jul 28 21:05:21.979528 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979500    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc677cbc-8071-490a-94af-33ed7139b610-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc677cbc-8071-490a-94af-33ed7139b610" (UID: "fc677cbc-8071-490a-94af-33ed7139b610"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:21.979729 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979633    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc677cbc-8071-490a-94af-33ed7139b610" (UID: "fc677cbc-8071-490a-94af-33ed7139b610"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:21.979816 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979791    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc677cbc-8071-490a-94af-33ed7139b610" (UID: "fc677cbc-8071-490a-94af-33ed7139b610"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:21.979882 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979850    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc677cbc-8071-490a-94af-33ed7139b610" (UID: "fc677cbc-8071-490a-94af-33ed7139b610"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:21.979882 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979869    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:21.980006 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.979889    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc677cbc-8071-490a-94af-33ed7139b610-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:21.980132 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.980106    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc677cbc-8071-490a-94af-33ed7139b610" (UID: "fc677cbc-8071-490a-94af-33ed7139b610"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:21.981543 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.981520    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc677cbc-8071-490a-94af-33ed7139b610-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc677cbc-8071-490a-94af-33ed7139b610" (UID: "fc677cbc-8071-490a-94af-33ed7139b610"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:05:21.981645 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.981581    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-kube-api-access-rf6lt" (OuterVolumeSpecName: "kube-api-access-rf6lt") pod "fc677cbc-8071-490a-94af-33ed7139b610" (UID: "fc677cbc-8071-490a-94af-33ed7139b610"). InnerVolumeSpecName "kube-api-access-rf6lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:21.981745 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.981728    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc677cbc-8071-490a-94af-33ed7139b610" (UID: "fc677cbc-8071-490a-94af-33ed7139b610"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:21.981799 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:21.981756    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc677cbc-8071-490a-94af-33ed7139b610" (UID: "fc677cbc-8071-490a-94af-33ed7139b610"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:22.080604 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.080567    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:22.080604 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.080598    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:22.080604 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.080613    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:22.080858 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.080629    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:22.080858 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.080642    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf6lt\" (UniqueName: \"kubernetes.io/projected/fc677cbc-8071-490a-94af-33ed7139b610-kube-api-access-rf6lt\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:22.080858 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.080655    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc677cbc-8071-490a-94af-33ed7139b610-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:22.080858 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.080669    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc677cbc-8071-490a-94af-33ed7139b610-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:22.134579 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.134539    2561 generic.go:356] "Generic (PLEG): container finished" podID="fc677cbc-8071-490a-94af-33ed7139b610" containerID="bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa" exitCode=0
Jul 28 21:05:22.134743 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.134594    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"
Jul 28 21:05:22.134743 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.134631    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" event={"ID":"fc677cbc-8071-490a-94af-33ed7139b610","Type":"ContainerDied","Data":"bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa"}
Jul 28 21:05:22.134743 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.134691    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w" event={"ID":"fc677cbc-8071-490a-94af-33ed7139b610","Type":"ContainerDied","Data":"ced959cbbfd2527a69d2029331bffe0a246e9a9d29b1c1a4422a5dcc8e4c2e70"}
Jul 28 21:05:22.134743 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.134721    2561 scope.go:117] "RemoveContainer" containerID="bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa"
Jul 28 21:05:22.144026 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.144009    2561 scope.go:117] "RemoveContainer" containerID="548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e"
Jul 28 21:05:22.153027 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.152968    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"]
Jul 28 21:05:22.154390 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.154371    2561 scope.go:117] "RemoveContainer" containerID="bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa"
Jul 28 21:05:22.154713 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:05:22.154692    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa\": container with ID starting with bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa not found: ID does not exist" containerID="bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa"
Jul 28 21:05:22.154768 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.154722    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa"} err="failed to get container status \"bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa\": rpc error: code = NotFound desc = could not find container \"bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa\": container with ID starting with bcab5da65ac2b3bbb636f76d06b3da7715048fb95e1c6a3e20ed0e0d4ff7d1fa not found: ID does not exist"
Jul 28 21:05:22.154768 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.154740    2561 scope.go:117] "RemoveContainer" containerID="548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e"
Jul 28 21:05:22.154983 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:05:22.154964    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e\": container with ID starting with 548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e not found: ID does not exist" containerID="548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e"
Jul 28 21:05:22.155044 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.154992    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e"} err="failed to get container status \"548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e\": rpc error: code = NotFound desc = could not find container \"548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e\": container with ID starting with 548f499cedfe4fc22628baf2f1f497ff35429cf3844b2deb8f3faf0ed0b5602e not found: ID does not exist"
Jul 28 21:05:22.155603 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:22.155584    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-ce337a-openshift-default-58476c7d7d-c9p7w"]
Jul 28 21:05:24.076480 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:24.076445    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc677cbc-8071-490a-94af-33ed7139b610" path="/var/lib/kubelet/pods/fc677cbc-8071-490a-94af-33ed7139b610/volumes"
Jul 28 21:05:28.288033 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.287990    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"]
Jul 28 21:05:28.288477 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.288285    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn" podUID="7d039c4e-f21c-48f8-8841-dcc3d66b4e2d" containerName="payload-processing" containerID="cri-o://5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694" gracePeriod=30
Jul 28 21:05:28.294965 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.294937    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"]
Jul 28 21:05:28.295184 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.295143    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb" podUID="c3692d9d-2d1f-4ff5-bba0-3b84e6f42183" containerName="payload-pre-processing" containerID="cri-o://cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c" gracePeriod=30
Jul 28 21:05:28.569756 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.569726    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:05:28.593457 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.593432    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:05:28.627546 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.627489    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-plugins-config-volume\") pod \"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d\" (UID: \"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d\") "
Jul 28 21:05:28.627738 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.627573    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz7wx\" (UniqueName: \"kubernetes.io/projected/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-kube-api-access-xz7wx\") pod \"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183\" (UID: \"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183\") "
Jul 28 21:05:28.627738 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.627594    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl5n6\" (UniqueName: \"kubernetes.io/projected/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-kube-api-access-cl5n6\") pod \"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d\" (UID: \"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d\") "
Jul 28 21:05:28.627738 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.627650    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-plugins-config-volume\") pod \"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183\" (UID: \"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183\") "
Jul 28 21:05:28.627961 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.627935    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d039c4e-f21c-48f8-8841-dcc3d66b4e2d" (UID: "7d039c4e-f21c-48f8-8841-dcc3d66b4e2d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:28.628100 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.628077    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3692d9d-2d1f-4ff5-bba0-3b84e6f42183" (UID: "c3692d9d-2d1f-4ff5-bba0-3b84e6f42183"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:28.629742 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.629716    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-kube-api-access-cl5n6" (OuterVolumeSpecName: "kube-api-access-cl5n6") pod "7d039c4e-f21c-48f8-8841-dcc3d66b4e2d" (UID: "7d039c4e-f21c-48f8-8841-dcc3d66b4e2d"). InnerVolumeSpecName "kube-api-access-cl5n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:28.629838 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.629737    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-kube-api-access-xz7wx" (OuterVolumeSpecName: "kube-api-access-xz7wx") pod "c3692d9d-2d1f-4ff5-bba0-3b84e6f42183" (UID: "c3692d9d-2d1f-4ff5-bba0-3b84e6f42183"). InnerVolumeSpecName "kube-api-access-xz7wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:28.729028 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.728989    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:28.729028 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.729021    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz7wx\" (UniqueName: \"kubernetes.io/projected/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-kube-api-access-xz7wx\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:28.729028 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.729035    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl5n6\" (UniqueName: \"kubernetes.io/projected/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d-kube-api-access-cl5n6\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:28.729318 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:28.729047    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:29.175565 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.175525    2561 generic.go:356] "Generic (PLEG): container finished" podID="c3692d9d-2d1f-4ff5-bba0-3b84e6f42183" containerID="cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c" exitCode=0
Jul 28 21:05:29.175742 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.175586    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"
Jul 28 21:05:29.175742 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.175612    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb" event={"ID":"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183","Type":"ContainerDied","Data":"cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c"}
Jul 28 21:05:29.175742 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.175669    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb" event={"ID":"c3692d9d-2d1f-4ff5-bba0-3b84e6f42183","Type":"ContainerDied","Data":"d0f07a04568de304c273d0c729839d35f5a8f995978d52b685b0e8becc71c3aa"}
Jul 28 21:05:29.175742 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.175700    2561 scope.go:117] "RemoveContainer" containerID="cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c"
Jul 28 21:05:29.177056 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.177035    2561 generic.go:356] "Generic (PLEG): container finished" podID="7d039c4e-f21c-48f8-8841-dcc3d66b4e2d" containerID="5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694" exitCode=0
Jul 28 21:05:29.177169 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.177066    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn" event={"ID":"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d","Type":"ContainerDied","Data":"5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694"}
Jul 28 21:05:29.177169 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.177095    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"
Jul 28 21:05:29.177169 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.177127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn" event={"ID":"7d039c4e-f21c-48f8-8841-dcc3d66b4e2d","Type":"ContainerDied","Data":"45f6656d9fd8a6491403464bacd54eac5f62b1f1dc3b863993cd10bc747380d2"}
Jul 28 21:05:29.184798 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.184779    2561 scope.go:117] "RemoveContainer" containerID="cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c"
Jul 28 21:05:29.185180 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:05:29.185078    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c\": container with ID starting with cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c not found: ID does not exist" containerID="cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c"
Jul 28 21:05:29.185180 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.185102    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c"} err="failed to get container status \"cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c\": rpc error: code = NotFound desc = could not find container \"cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c\": container with ID starting with cf1e1d3aa54130bc77ea0805cbb83fc8c07a608fc107d76a0fd347ccb8a1b87c not found: ID does not exist"
Jul 28 21:05:29.185180 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.185120    2561 scope.go:117] "RemoveContainer" containerID="5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694"
Jul 28 21:05:29.193371 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.193353    2561 scope.go:117] "RemoveContainer" containerID="5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694"
Jul 28 21:05:29.193599 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:05:29.193581    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694\": container with ID starting with 5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694 not found: ID does not exist" containerID="5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694"
Jul 28 21:05:29.193653 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.193605    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694"} err="failed to get container status \"5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694\": rpc error: code = NotFound desc = could not find container \"5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694\": container with ID starting with 5ed752546e6f8318ccbb8da9c9d12f3e0c6f7c357c84b72b2ef0b279b25d5694 not found: ID does not exist"
Jul 28 21:05:29.200139 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.200113    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"]
Jul 28 21:05:29.204709 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.204689    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-542599-69bb495c6-2v5gb"]
Jul 28 21:05:29.214870 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.214848    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"]
Jul 28 21:05:29.218765 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:29.218743    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-542599-5b8c4c6c84-rnsgn"]
Jul 28 21:05:30.077294 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:30.077261    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d039c4e-f21c-48f8-8841-dcc3d66b4e2d" path="/var/lib/kubelet/pods/7d039c4e-f21c-48f8-8841-dcc3d66b4e2d/volumes"
Jul 28 21:05:30.077793 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:30.077775    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3692d9d-2d1f-4ff5-bba0-3b84e6f42183" path="/var/lib/kubelet/pods/c3692d9d-2d1f-4ff5-bba0-3b84e6f42183/volumes"
Jul 28 21:05:45.885404 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:45.885366    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"]
Jul 28 21:05:45.885881 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:45.885562    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x" podUID="5d9dec93-b285-4434-86ed-9edcdc1299c0" containerName="payload-processing" containerID="cri-o://27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8" gracePeriod=30
Jul 28 21:05:46.156706 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.156677    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 21:05:46.200134 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.200099    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d9dec93-b285-4434-86ed-9edcdc1299c0-plugins-config-volume\") pod \"5d9dec93-b285-4434-86ed-9edcdc1299c0\" (UID: \"5d9dec93-b285-4434-86ed-9edcdc1299c0\") "
Jul 28 21:05:46.200334 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.200201    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xm7p\" (UniqueName: \"kubernetes.io/projected/5d9dec93-b285-4434-86ed-9edcdc1299c0-kube-api-access-2xm7p\") pod \"5d9dec93-b285-4434-86ed-9edcdc1299c0\" (UID: \"5d9dec93-b285-4434-86ed-9edcdc1299c0\") "
Jul 28 21:05:46.200573 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.200545    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d9dec93-b285-4434-86ed-9edcdc1299c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d9dec93-b285-4434-86ed-9edcdc1299c0" (UID: "5d9dec93-b285-4434-86ed-9edcdc1299c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:46.202667 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.202641    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d9dec93-b285-4434-86ed-9edcdc1299c0-kube-api-access-2xm7p" (OuterVolumeSpecName: "kube-api-access-2xm7p") pod "5d9dec93-b285-4434-86ed-9edcdc1299c0" (UID: "5d9dec93-b285-4434-86ed-9edcdc1299c0"). InnerVolumeSpecName "kube-api-access-2xm7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:46.270713 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.270673    2561 generic.go:356] "Generic (PLEG): container finished" podID="5d9dec93-b285-4434-86ed-9edcdc1299c0" containerID="27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8" exitCode=0
Jul 28 21:05:46.270713 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.270719    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"
Jul 28 21:05:46.270922 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.270717    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x" event={"ID":"5d9dec93-b285-4434-86ed-9edcdc1299c0","Type":"ContainerDied","Data":"27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8"}
Jul 28 21:05:46.270922 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.270777    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x" event={"ID":"5d9dec93-b285-4434-86ed-9edcdc1299c0","Type":"ContainerDied","Data":"b8c9ac7e611db338f6eae6ab88b0050d10dd02aed0f4fde9d0c255ac4d8702bd"}
Jul 28 21:05:46.270922 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.270803    2561 scope.go:117] "RemoveContainer" containerID="27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8"
Jul 28 21:05:46.280117 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.280101    2561 scope.go:117] "RemoveContainer" containerID="27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8"
Jul 28 21:05:46.280377 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:05:46.280360    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8\": container with ID starting with 27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8 not found: ID does not exist" containerID="27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8"
Jul 28 21:05:46.280437 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.280384    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8"} err="failed to get container status \"27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8\": rpc error: code = NotFound desc = could not find container \"27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8\": container with ID starting with 27c055e76a43c186cf2175817b4bd7a23680b974e5105faaeac1bf35301982c8 not found: ID does not exist"
Jul 28 21:05:46.291501 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.291462    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"]
Jul 28 21:05:46.294501 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.294478    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-cc370c-67bf5d9fc4-pv98x"]
Jul 28 21:05:46.301559 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.301539    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d9dec93-b285-4434-86ed-9edcdc1299c0-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:46.301621 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:46.301561    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xm7p\" (UniqueName: \"kubernetes.io/projected/5d9dec93-b285-4434-86ed-9edcdc1299c0-kube-api-access-2xm7p\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:48.077466 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:48.077431    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d9dec93-b285-4434-86ed-9edcdc1299c0" path="/var/lib/kubelet/pods/5d9dec93-b285-4434-86ed-9edcdc1299c0/volumes"
Jul 28 21:05:52.717588 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:52.717557    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"]
Jul 28 21:05:52.718092 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:52.717767    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy" containerID="cri-o://349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c" gracePeriod=30
Jul 28 21:05:53.039714 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.039679    2561 patch_prober.go:28] interesting pod/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 21:05:53.039889 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.039742    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 21:05:53.059102 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059067    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"]
Jul 28 21:05:53.059438 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059425    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc677cbc-8071-490a-94af-33ed7139b610" containerName="istio-proxy"
Jul 28 21:05:53.059438 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059439    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc677cbc-8071-490a-94af-33ed7139b610" containerName="istio-proxy"
Jul 28 21:05:53.059533 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059449    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3692d9d-2d1f-4ff5-bba0-3b84e6f42183" containerName="payload-pre-processing"
Jul 28 21:05:53.059533 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059455    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3692d9d-2d1f-4ff5-bba0-3b84e6f42183" containerName="payload-pre-processing"
Jul 28 21:05:53.059533 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059469    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9e8391-a27c-4609-970c-4c4128283ee5" containerName="revoke-keys"
Jul 28 21:05:53.059533 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059474    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9e8391-a27c-4609-970c-4c4128283ee5" containerName="revoke-keys"
Jul 28 21:05:53.059533 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059482    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d039c4e-f21c-48f8-8841-dcc3d66b4e2d" containerName="payload-processing"
Jul 28 21:05:53.059533 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059487    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d039c4e-f21c-48f8-8841-dcc3d66b4e2d" containerName="payload-processing"
Jul 28 21:05:53.059533 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059512    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9dec93-b285-4434-86ed-9edcdc1299c0" containerName="payload-processing"
Jul 28 21:05:53.059533 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059517    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9dec93-b285-4434-86ed-9edcdc1299c0" containerName="payload-processing"
Jul 28 21:05:53.059778 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059575    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3692d9d-2d1f-4ff5-bba0-3b84e6f42183" containerName="payload-pre-processing"
Jul 28 21:05:53.059778 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059581    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d9dec93-b285-4434-86ed-9edcdc1299c0" containerName="payload-processing"
Jul 28 21:05:53.059778 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059588    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9e8391-a27c-4609-970c-4c4128283ee5" containerName="revoke-keys"
Jul 28 21:05:53.059778 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059594    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d039c4e-f21c-48f8-8841-dcc3d66b4e2d" containerName="payload-processing"
Jul 28 21:05:53.059778 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059600    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc677cbc-8071-490a-94af-33ed7139b610" containerName="istio-proxy"
Jul 28 21:05:53.059778 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.059607    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc677cbc-8071-490a-94af-33ed7139b610" containerName="istio-proxy"
Jul 28 21:05:53.063900 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.063881    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"
Jul 28 21:05:53.066423 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.066405    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gcrkz\""
Jul 28 21:05:53.066532 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.066431    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 21:05:53.070392 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.070351    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"]
Jul 28 21:05:53.167228 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.167173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ea9f43-4e97-4d9b-b77c-9289696cd35f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-35c841-74x8t\" (UID: \"e4ea9f43-4e97-4d9b-b77c-9289696cd35f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"
Jul 28 21:05:53.268061 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.268022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ea9f43-4e97-4d9b-b77c-9289696cd35f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-35c841-74x8t\" (UID: \"e4ea9f43-4e97-4d9b-b77c-9289696cd35f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"
Jul 28 21:05:53.268710 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.268688    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ea9f43-4e97-4d9b-b77c-9289696cd35f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-35c841-74x8t\" (UID: \"e4ea9f43-4e97-4d9b-b77c-9289696cd35f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"
Jul 28 21:05:53.376108 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.376020    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"
Jul 28 21:05:53.723433 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:53.723342    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"]
Jul 28 21:05:53.729465 ip-10-0-136-137 kubenswrapper[2561]: W0728 21:05:53.729426    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ea9f43_4e97_4d9b_b77c_9289696cd35f.slice/crio-3a024b582da708ac89641064fb5c93819b7b6f6a421dc08d599e20d2db64f7e2 WatchSource:0}: Error finding container 3a024b582da708ac89641064fb5c93819b7b6f6a421dc08d599e20d2db64f7e2: Status 404 returned error can't find the container with id 3a024b582da708ac89641064fb5c93819b7b6f6a421dc08d599e20d2db64f7e2
Jul 28 21:05:54.314058 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:54.314027    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t" event={"ID":"e4ea9f43-4e97-4d9b-b77c-9289696cd35f","Type":"ContainerStarted","Data":"53bd418468d54e9a2ea037f0a2d9722e7df84e715eccf06972c0678ff1a8e9c8"}
Jul 28 21:05:54.314218 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:54.314082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t" event={"ID":"e4ea9f43-4e97-4d9b-b77c-9289696cd35f","Type":"ContainerStarted","Data":"3a024b582da708ac89641064fb5c93819b7b6f6a421dc08d599e20d2db64f7e2"}
Jul 28 21:05:54.329071 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:54.329024    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t" podStartSLOduration=1.329008146 podStartE2EDuration="1.329008146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:05:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:05:54.327370981 +0000 UTC m=+3456.724074136" watchObservedRunningTime="2026-07-28 21:05:54.329008146 +0000 UTC m=+3456.725711301"
Jul 28 21:05:55.321505 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:55.321472    2561 generic.go:356] "Generic (PLEG): container finished" podID="e4ea9f43-4e97-4d9b-b77c-9289696cd35f" containerID="53bd418468d54e9a2ea037f0a2d9722e7df84e715eccf06972c0678ff1a8e9c8" exitCode=0
Jul 28 21:05:55.321897 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:55.321554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t" event={"ID":"e4ea9f43-4e97-4d9b-b77c-9289696cd35f","Type":"ContainerDied","Data":"53bd418468d54e9a2ea037f0a2d9722e7df84e715eccf06972c0678ff1a8e9c8"}
Jul 28 21:05:56.457907 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:56.457878    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"
Jul 28 21:05:56.597868 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:56.597752    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ea9f43-4e97-4d9b-b77c-9289696cd35f-maas-api-service-ca\") pod \"e4ea9f43-4e97-4d9b-b77c-9289696cd35f\" (UID: \"e4ea9f43-4e97-4d9b-b77c-9289696cd35f\") "
Jul 28 21:05:56.598139 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:56.598115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ea9f43-4e97-4d9b-b77c-9289696cd35f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4ea9f43-4e97-4d9b-b77c-9289696cd35f" (UID: "e4ea9f43-4e97-4d9b-b77c-9289696cd35f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:56.698525 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:56.698490    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ea9f43-4e97-4d9b-b77c-9289696cd35f-maas-api-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:57.333510 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:57.333475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t" event={"ID":"e4ea9f43-4e97-4d9b-b77c-9289696cd35f","Type":"ContainerDied","Data":"3a024b582da708ac89641064fb5c93819b7b6f6a421dc08d599e20d2db64f7e2"}
Jul 28 21:05:57.333698 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:57.333535    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a024b582da708ac89641064fb5c93819b7b6f6a421dc08d599e20d2db64f7e2"
Jul 28 21:05:57.333698 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:57.333482    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"
Jul 28 21:05:57.974678 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:57.974652    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 21:05:58.111612 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.111577    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-token\") pod \"9163e173-6aee-457e-8ad5-811bbfb7ec70\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") "
Jul 28 21:05:58.111612 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.111620    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-socket\") pod \"9163e173-6aee-457e-8ad5-811bbfb7ec70\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") "
Jul 28 21:05:58.111856 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.111650    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-podinfo\") pod \"9163e173-6aee-457e-8ad5-811bbfb7ec70\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") "
Jul 28 21:05:58.111856 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.111690    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9163e173-6aee-457e-8ad5-811bbfb7ec70-istiod-ca-cert\") pod \"9163e173-6aee-457e-8ad5-811bbfb7ec70\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") "
Jul 28 21:05:58.111856 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.111757    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-data\") pod \"9163e173-6aee-457e-8ad5-811bbfb7ec70\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") "
Jul 28 21:05:58.111856 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.111788    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-credential-socket\") pod \"9163e173-6aee-457e-8ad5-811bbfb7ec70\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") "
Jul 28 21:05:58.111856 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.111827    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-envoy\") pod \"9163e173-6aee-457e-8ad5-811bbfb7ec70\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") "
Jul 28 21:05:58.112175 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.111894    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-certs\") pod \"9163e173-6aee-457e-8ad5-811bbfb7ec70\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") "
Jul 28 21:05:58.112175 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.111931    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfv9c\" (UniqueName: \"kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-kube-api-access-zfv9c\") pod \"9163e173-6aee-457e-8ad5-811bbfb7ec70\" (UID: \"9163e173-6aee-457e-8ad5-811bbfb7ec70\") "
Jul 28 21:05:58.112175 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.111933    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9163e173-6aee-457e-8ad5-811bbfb7ec70" (UID: "9163e173-6aee-457e-8ad5-811bbfb7ec70"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:58.112175 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.112161    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9163e173-6aee-457e-8ad5-811bbfb7ec70-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9163e173-6aee-457e-8ad5-811bbfb7ec70" (UID: "9163e173-6aee-457e-8ad5-811bbfb7ec70"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:58.112419 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.112225    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:58.112419 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.112343    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9163e173-6aee-457e-8ad5-811bbfb7ec70" (UID: "9163e173-6aee-457e-8ad5-811bbfb7ec70"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:58.112521 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.112414    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9163e173-6aee-457e-8ad5-811bbfb7ec70" (UID: "9163e173-6aee-457e-8ad5-811bbfb7ec70"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:58.112871 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.112847    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-data" (OuterVolumeSpecName: "istio-data") pod "9163e173-6aee-457e-8ad5-811bbfb7ec70" (UID: "9163e173-6aee-457e-8ad5-811bbfb7ec70"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:58.113963 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.113934    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9163e173-6aee-457e-8ad5-811bbfb7ec70" (UID: "9163e173-6aee-457e-8ad5-811bbfb7ec70"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:05:58.114168 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.114148    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-kube-api-access-zfv9c" (OuterVolumeSpecName: "kube-api-access-zfv9c") pod "9163e173-6aee-457e-8ad5-811bbfb7ec70" (UID: "9163e173-6aee-457e-8ad5-811bbfb7ec70"). InnerVolumeSpecName "kube-api-access-zfv9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:58.114360 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.114342    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-token" (OuterVolumeSpecName: "istio-token") pod "9163e173-6aee-457e-8ad5-811bbfb7ec70" (UID: "9163e173-6aee-457e-8ad5-811bbfb7ec70"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:58.114513 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.114492    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9163e173-6aee-457e-8ad5-811bbfb7ec70" (UID: "9163e173-6aee-457e-8ad5-811bbfb7ec70"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:58.212976 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.212935    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:58.212976 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.212969    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfv9c\" (UniqueName: \"kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-kube-api-access-zfv9c\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:58.212976 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.212978    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:58.212976 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.212986    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:58.213285 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.212994    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9163e173-6aee-457e-8ad5-811bbfb7ec70-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:58.213285 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.213003    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:58.213285 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.213010    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:58.213285 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.213019    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9163e173-6aee-457e-8ad5-811bbfb7ec70-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:05:58.340304 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.340270    2561 generic.go:356] "Generic (PLEG): container finished" podID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerID="349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c" exitCode=0
Jul 28 21:05:58.340304 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.340303    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" event={"ID":"9163e173-6aee-457e-8ad5-811bbfb7ec70","Type":"ContainerDied","Data":"349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c"}
Jul 28 21:05:58.340585 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.340321    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"
Jul 28 21:05:58.340585 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.340363    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl" event={"ID":"9163e173-6aee-457e-8ad5-811bbfb7ec70","Type":"ContainerDied","Data":"e7fec1ff105b6f3ecbfd6ece8e993d345764d8ea06fb969397a65e7ca9f20566"}
Jul 28 21:05:58.340585 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.340386    2561 scope.go:117] "RemoveContainer" containerID="349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c"
Jul 28 21:05:58.350255 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.350217    2561 scope.go:117] "RemoveContainer" containerID="51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e"
Jul 28 21:05:58.358549 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.358533    2561 scope.go:117] "RemoveContainer" containerID="349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c"
Jul 28 21:05:58.358866 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:05:58.358837    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c\": container with ID starting with 349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c not found: ID does not exist" containerID="349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c"
Jul 28 21:05:58.359052 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.358873    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c"} err="failed to get container status \"349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c\": rpc error: code = NotFound desc = could not find container \"349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c\": container with ID starting with 349187c1b3aa1c48a8a3f2bb9cdec4c59d10cbd56a0bb49c389bed39623a626c not found: ID does not exist"
Jul 28 21:05:58.359052 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.358896    2561 scope.go:117] "RemoveContainer" containerID="51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e"
Jul 28 21:05:58.359405 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:05:58.359385    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e\": container with ID starting with 51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e not found: ID does not exist" containerID="51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e"
Jul 28 21:05:58.359657 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.359417    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e"} err="failed to get container status \"51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e\": rpc error: code = NotFound desc = could not find container \"51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e\": container with ID starting with 51bd821c04688a2b50451db5cd9edd8b4a63b0e92e5e1215078a1fdd262d445e not found: ID does not exist"
Jul 28 21:05:58.362028 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.361984    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"]
Jul 28 21:05:58.368180 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:05:58.368160    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-cc370c-openshift-default-67788b4df6-fc2bl"]
Jul 28 21:06:00.077477 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:00.077443    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" path="/var/lib/kubelet/pods/9163e173-6aee-457e-8ad5-811bbfb7ec70/volumes"
Jul 28 21:06:03.509841 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.509805    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"]
Jul 28 21:06:03.510353 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.510015    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf" podUID="64de0412-66f8-4bc8-ab84-0a4d9743c7c6" containerName="payload-processing" containerID="cri-o://7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a" gracePeriod=30
Jul 28 21:06:03.656786 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.656707    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"]
Jul 28 21:06:03.659748 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.659719    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-35c841-74x8t"]
Jul 28 21:06:03.768783 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.768719    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 21:06:03.866205 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.866173    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-plugins-config-volume\") pod \"64de0412-66f8-4bc8-ab84-0a4d9743c7c6\" (UID: \"64de0412-66f8-4bc8-ab84-0a4d9743c7c6\") "
Jul 28 21:06:03.866492 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.866216    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptzzm\" (UniqueName: \"kubernetes.io/projected/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-kube-api-access-ptzzm\") pod \"64de0412-66f8-4bc8-ab84-0a4d9743c7c6\" (UID: \"64de0412-66f8-4bc8-ab84-0a4d9743c7c6\") "
Jul 28 21:06:03.866582 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.866551    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64de0412-66f8-4bc8-ab84-0a4d9743c7c6" (UID: "64de0412-66f8-4bc8-ab84-0a4d9743c7c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:06:03.868423 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.868398    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-kube-api-access-ptzzm" (OuterVolumeSpecName: "kube-api-access-ptzzm") pod "64de0412-66f8-4bc8-ab84-0a4d9743c7c6" (UID: "64de0412-66f8-4bc8-ab84-0a4d9743c7c6"). InnerVolumeSpecName "kube-api-access-ptzzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:06:03.967358 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.967315    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-plugins-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:03.967358 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:03.967348    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptzzm\" (UniqueName: \"kubernetes.io/projected/64de0412-66f8-4bc8-ab84-0a4d9743c7c6-kube-api-access-ptzzm\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:04.076242 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:04.076148    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4ea9f43-4e97-4d9b-b77c-9289696cd35f" path="/var/lib/kubelet/pods/e4ea9f43-4e97-4d9b-b77c-9289696cd35f/volumes"
Jul 28 21:06:04.375591 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:04.375502    2561 generic.go:356] "Generic (PLEG): container finished" podID="64de0412-66f8-4bc8-ab84-0a4d9743c7c6" containerID="7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a" exitCode=0
Jul 28 21:06:04.375591 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:04.375546    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"
Jul 28 21:06:04.375591 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:04.375555    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf" event={"ID":"64de0412-66f8-4bc8-ab84-0a4d9743c7c6","Type":"ContainerDied","Data":"7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a"}
Jul 28 21:06:04.375832 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:04.375598    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf" event={"ID":"64de0412-66f8-4bc8-ab84-0a4d9743c7c6","Type":"ContainerDied","Data":"67fbfc7eac97cba4758109de696ffa39a5ef0462afc1d1ea74555708be9f6553"}
Jul 28 21:06:04.375832 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:04.375621    2561 scope.go:117] "RemoveContainer" containerID="7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a"
Jul 28 21:06:04.385692 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:04.385669    2561 scope.go:117] "RemoveContainer" containerID="7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a"
Jul 28 21:06:04.386022 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:06:04.386003    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a\": container with ID starting with 7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a not found: ID does not exist" containerID="7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a"
Jul 28 21:06:04.386068 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:04.386031    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a"} err="failed to get container status \"7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a\": rpc error: code = NotFound desc = could not find container \"7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a\": container with ID starting with 7c561de0c40071c7e276089aa5928b567993bff10fa1a9348ba845def4b6c25a not found: ID does not exist"
Jul 28 21:06:04.392434 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:04.392343    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"]
Jul 28 21:06:04.395186 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:04.395161    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-35c841-67f8b6d554-gbbxf"]
Jul 28 21:06:06.076292 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:06.076253    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64de0412-66f8-4bc8-ab84-0a4d9743c7c6" path="/var/lib/kubelet/pods/64de0412-66f8-4bc8-ab84-0a4d9743c7c6/volumes"
Jul 28 21:06:10.120735 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:10.120696    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"]
Jul 28 21:06:10.121137 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:10.120949    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy" containerID="cri-o://5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2" gracePeriod=30
Jul 28 21:06:10.891738 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:10.891698    2561 patch_prober.go:28] interesting pod/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 21:06:10.891933 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:10.891781    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 21:06:15.375825 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.375799    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 21:06:15.444267 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.444136    2561 generic.go:356] "Generic (PLEG): container finished" podID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerID="5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2" exitCode=0
Jul 28 21:06:15.444267 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.444192    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"
Jul 28 21:06:15.444267 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.444223    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" event={"ID":"007f6530-a24c-4edc-895d-c1a7a5238f0f","Type":"ContainerDied","Data":"5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2"}
Jul 28 21:06:15.444783 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.444311    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68" event={"ID":"007f6530-a24c-4edc-895d-c1a7a5238f0f","Type":"ContainerDied","Data":"15a2e385809574340e02d8a944ff1f3857c0d7143f5f78cd715d45f5ef04e60e"}
Jul 28 21:06:15.444783 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.444342    2561 scope.go:117] "RemoveContainer" containerID="5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2"
Jul 28 21:06:15.453028 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.453009    2561 scope.go:117] "RemoveContainer" containerID="9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531"
Jul 28 21:06:15.461355 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.461336    2561 scope.go:117] "RemoveContainer" containerID="5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2"
Jul 28 21:06:15.461626 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:06:15.461607    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2\": container with ID starting with 5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2 not found: ID does not exist" containerID="5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2"
Jul 28 21:06:15.461695 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.461638    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2"} err="failed to get container status \"5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2\": rpc error: code = NotFound desc = could not find container \"5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2\": container with ID starting with 5883394d5991eea36236738f1a9831c41a74985de4b25b839083f3bcf9e6dba2 not found: ID does not exist"
Jul 28 21:06:15.461695 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.461655    2561 scope.go:117] "RemoveContainer" containerID="9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531"
Jul 28 21:06:15.461906 ip-10-0-136-137 kubenswrapper[2561]: E0728 21:06:15.461888    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531\": container with ID starting with 9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531 not found: ID does not exist" containerID="9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531"
Jul 28 21:06:15.461952 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.461913    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531"} err="failed to get container status \"9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531\": rpc error: code = NotFound desc = could not find container \"9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531\": container with ID starting with 9af1d02c503c5c2a0fd907ad0311c75f65edb0c47c09087e26991d2436037531 not found: ID does not exist"
Jul 28 21:06:15.469205 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/007f6530-a24c-4edc-895d-c1a7a5238f0f-istiod-ca-cert\") pod \"007f6530-a24c-4edc-895d-c1a7a5238f0f\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") "
Jul 28 21:06:15.469289 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469277    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-token\") pod \"007f6530-a24c-4edc-895d-c1a7a5238f0f\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") "
Jul 28 21:06:15.469333 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-socket\") pod \"007f6530-a24c-4edc-895d-c1a7a5238f0f\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") "
Jul 28 21:06:15.469333 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469323    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-credential-socket\") pod \"007f6530-a24c-4edc-895d-c1a7a5238f0f\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") "
Jul 28 21:06:15.469428 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469340    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-data\") pod \"007f6530-a24c-4edc-895d-c1a7a5238f0f\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") "
Jul 28 21:06:15.469428 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469377    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-certs\") pod \"007f6530-a24c-4edc-895d-c1a7a5238f0f\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") "
Jul 28 21:06:15.469607 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469530    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-envoy\") pod \"007f6530-a24c-4edc-895d-c1a7a5238f0f\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") "
Jul 28 21:06:15.469607 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469573    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-podinfo\") pod \"007f6530-a24c-4edc-895d-c1a7a5238f0f\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") "
Jul 28 21:06:15.469607 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469603    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb9vp\" (UniqueName: \"kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-kube-api-access-kb9vp\") pod \"007f6530-a24c-4edc-895d-c1a7a5238f0f\" (UID: \"007f6530-a24c-4edc-895d-c1a7a5238f0f\") "
Jul 28 21:06:15.469795 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469621    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "007f6530-a24c-4edc-895d-c1a7a5238f0f" (UID: "007f6530-a24c-4edc-895d-c1a7a5238f0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:06:15.469795 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469634    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "007f6530-a24c-4edc-895d-c1a7a5238f0f" (UID: "007f6530-a24c-4edc-895d-c1a7a5238f0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:06:15.469795 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469673    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/007f6530-a24c-4edc-895d-c1a7a5238f0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "007f6530-a24c-4edc-895d-c1a7a5238f0f" (UID: "007f6530-a24c-4edc-895d-c1a7a5238f0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:06:15.469795 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469693    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "007f6530-a24c-4edc-895d-c1a7a5238f0f" (UID: "007f6530-a24c-4edc-895d-c1a7a5238f0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:06:15.469980 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469879    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:15.469980 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469896    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/007f6530-a24c-4edc-895d-c1a7a5238f0f-istiod-ca-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:15.469980 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469909    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-workload-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:15.469980 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.469921    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-credential-socket\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:15.470544 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.470513    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "007f6530-a24c-4edc-895d-c1a7a5238f0f" (UID: "007f6530-a24c-4edc-895d-c1a7a5238f0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:06:15.471687 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.471666    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "007f6530-a24c-4edc-895d-c1a7a5238f0f" (UID: "007f6530-a24c-4edc-895d-c1a7a5238f0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:06:15.471772 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.471734    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-kube-api-access-kb9vp" (OuterVolumeSpecName: "kube-api-access-kb9vp") pod "007f6530-a24c-4edc-895d-c1a7a5238f0f" (UID: "007f6530-a24c-4edc-895d-c1a7a5238f0f"). InnerVolumeSpecName "kube-api-access-kb9vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:06:15.472008 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.471987    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "007f6530-a24c-4edc-895d-c1a7a5238f0f" (UID: "007f6530-a24c-4edc-895d-c1a7a5238f0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:06:15.472070 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.471986    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "007f6530-a24c-4edc-895d-c1a7a5238f0f" (UID: "007f6530-a24c-4edc-895d-c1a7a5238f0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:06:15.570614 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.570574    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:15.570614 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.570606    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-data\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:15.570614 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.570614    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-envoy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:15.570614 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.570622    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/007f6530-a24c-4edc-895d-c1a7a5238f0f-istio-podinfo\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:15.570889 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.570631    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb9vp\" (UniqueName: \"kubernetes.io/projected/007f6530-a24c-4edc-895d-c1a7a5238f0f-kube-api-access-kb9vp\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\""
Jul 28 21:06:15.771391 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.771354    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"]
Jul 28 21:06:15.777895 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:15.777831    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-35c841-openshift-default-5c98dbbcb4-8wx68"]
Jul 28 21:06:16.076634 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:16.076554    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" path="/var/lib/kubelet/pods/007f6530-a24c-4edc-895d-c1a7a5238f0f/volumes"
Jul 28 21:06:16.995488 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:16.995459    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v_ffd31c06-4f2e-4d98-900c-5e85caf6c35b/copy-manifests/0.log"
Jul 28 21:06:17.002712 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:17.002668    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v_ffd31c06-4f2e-4d98-900c-5e85caf6c35b/manager/0.log"
Jul 28 21:06:17.734336 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:17.734301    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754510-bmhf2_98bd5c2b-0d86-4071-b076-670a910ef419/cleanup/0.log"
Jul 28 21:06:17.847785 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:17.847756    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754525-msjj8_4060a535-1782-4a46-8f5a-c3645fc1d7ea/cleanup/0.log"
Jul 28 21:06:18.865751 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:18.865719    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq_96134e80-b387-4cd9-8ab4-a28cf778b6f2/util/0.log"
Jul 28 21:06:18.872755 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:18.872725    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq_96134e80-b387-4cd9-8ab4-a28cf778b6f2/pull/0.log"
Jul 28 21:06:18.879043 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:18.879021    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq_96134e80-b387-4cd9-8ab4-a28cf778b6f2/extract/0.log"
Jul 28 21:06:18.994732 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:18.994655    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m_12fd732d-1ce0-4d79-93e4-d98ef509caac/util/0.log"
Jul 28 21:06:19.001471 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:19.001444    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m_12fd732d-1ce0-4d79-93e4-d98ef509caac/pull/0.log"
Jul 28 21:06:19.007864 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:19.007842    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m_12fd732d-1ce0-4d79-93e4-d98ef509caac/extract/0.log"
Jul 28 21:06:19.123482 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:19.123450    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk_d3296c34-fb84-4354-9523-9fce26d250ce/pull/0.log"
Jul 28 21:06:19.130846 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:19.130816    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk_d3296c34-fb84-4354-9523-9fce26d250ce/extract/0.log"
Jul 28 21:06:19.137101 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:19.137082    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk_d3296c34-fb84-4354-9523-9fce26d250ce/util/0.log"
Jul 28 21:06:19.253455 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:19.253431    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz_cfb654b8-9dce-4f2d-a558-a061e087f4a7/extract/0.log"
Jul 28 21:06:19.260515 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:19.260494    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz_cfb654b8-9dce-4f2d-a558-a061e087f4a7/util/0.log"
Jul 28 21:06:19.269677 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:19.269653    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz_cfb654b8-9dce-4f2d-a558-a061e087f4a7/pull/0.log"
Jul 28 21:06:20.607651 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:20.607625    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgz86h_7d5f4f51-8d8e-4220-96ed-204d6256298f/istio-proxy/0.log"
Jul 28 21:06:20.733425 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:20.733391    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-5t5fv_6899ec63-0fe1-4f1c-9a36-00f10837ed8d/discovery/0.log"
Jul 28 21:06:21.086868 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:21.086838    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6jjbz_c285b08d-7c13-49a3-82f7-5be298d970db/istio-proxy/1.log"
Jul 28 21:06:21.335907 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:21.335878    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-864kr_180c0d40-0a50-431e-b082-6ac16adfaf80/payload-processing/0.log"
Jul 28 21:06:21.452557 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:21.452474    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b5458f665-rgvs8_7e34a811-8e3c-4f37-91b8-c3b6f5251ccd/router/0.log"
Jul 28 21:06:21.801078 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:21.801052    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9cllx_af2aac09-4a78-484f-9174-563a6006ec88/main/0.log"
Jul 28 21:06:30.532044 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:30.532010    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8nzjj_600e31fe-6857-4497-8fc5-376fa127489f/global-pull-secret-syncer/0.log"
Jul 28 21:06:30.722637 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:30.722594    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p858f_4163e0d8-9bf6-4df2-8d9a-35a75d8414c3/konnectivity-agent/0.log"
Jul 28 21:06:30.811677 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:30.811588    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-137.ec2.internal_0ed1757eda998924f39fee4dd8c636f2/haproxy/0.log"
Jul 28 21:06:35.375315 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.375284    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq_96134e80-b387-4cd9-8ab4-a28cf778b6f2/extract/0.log"
Jul 28 21:06:35.400358 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.400326    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq_96134e80-b387-4cd9-8ab4-a28cf778b6f2/util/0.log"
Jul 28 21:06:35.426343 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.426313    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rfrlq_96134e80-b387-4cd9-8ab4-a28cf778b6f2/pull/0.log"
Jul 28 21:06:35.454847 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.454818    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m_12fd732d-1ce0-4d79-93e4-d98ef509caac/extract/0.log"
Jul 28 21:06:35.475761 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.475736    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m_12fd732d-1ce0-4d79-93e4-d98ef509caac/util/0.log"
Jul 28 21:06:35.499286 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.499259    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07mg8m_12fd732d-1ce0-4d79-93e4-d98ef509caac/pull/0.log"
Jul 28 21:06:35.527422 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.527386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk_d3296c34-fb84-4354-9523-9fce26d250ce/extract/0.log"
Jul 28 21:06:35.547398 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.547368    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk_d3296c34-fb84-4354-9523-9fce26d250ce/util/0.log"
Jul 28 21:06:35.570585 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.570559    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bqxvk_d3296c34-fb84-4354-9523-9fce26d250ce/pull/0.log"
Jul 28 21:06:35.601953 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.601924    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz_cfb654b8-9dce-4f2d-a558-a061e087f4a7/extract/0.log"
Jul 28 21:06:35.624845 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.624817    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz_cfb654b8-9dce-4f2d-a558-a061e087f4a7/util/0.log"
Jul 28 21:06:35.648688 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:35.648613    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17ttnz_cfb654b8-9dce-4f2d-a558-a061e087f4a7/pull/0.log"
Jul 28 21:06:38.338493 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:38.338460    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-hhkfr_cf4d8ec7-2e28-47cd-873e-0c94c9879609/cluster-monitoring-operator/0.log"
Jul 28 21:06:38.593272 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:38.593164    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h8clp_a8282c6b-3a46-45ca-acc0-db6fcbaa1290/node-exporter/0.log"
Jul 28 21:06:38.614716 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:38.614678    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h8clp_a8282c6b-3a46-45ca-acc0-db6fcbaa1290/kube-rbac-proxy/0.log"
Jul 28 21:06:38.639321 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:38.639295    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h8clp_a8282c6b-3a46-45ca-acc0-db6fcbaa1290/init-textfile/0.log"
Jul 28 21:06:40.254065 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254031    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"]
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254363    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc677cbc-8071-490a-94af-33ed7139b610" containerName="istio-proxy"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254375    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc677cbc-8071-490a-94af-33ed7139b610" containerName="istio-proxy"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254386    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254391    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254398    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64de0412-66f8-4bc8-ab84-0a4d9743c7c6" containerName="payload-processing"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254405    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64de0412-66f8-4bc8-ab84-0a4d9743c7c6" containerName="payload-processing"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254420    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4ea9f43-4e97-4d9b-b77c-9289696cd35f" containerName="revoke-keys"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254425    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ea9f43-4e97-4d9b-b77c-9289696cd35f" containerName="revoke-keys"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254433    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254438    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254444    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254449    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254455    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy"
Jul 28 21:06:40.254469 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254460    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy"
Jul 28 21:06:40.254899 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254512    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9163e173-6aee-457e-8ad5-811bbfb7ec70" containerName="istio-proxy"
Jul 28 21:06:40.254899 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254519    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy"
Jul 28 21:06:40.254899 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254527    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4ea9f43-4e97-4d9b-b77c-9289696cd35f" containerName="revoke-keys"
Jul 28 21:06:40.254899 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254534    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="007f6530-a24c-4edc-895d-c1a7a5238f0f" containerName="istio-proxy"
Jul 28 21:06:40.254899 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.254542    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64de0412-66f8-4bc8-ab84-0a4d9743c7c6" containerName="payload-processing"
Jul 28 21:06:40.257615 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.257599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.259720 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.259701    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cm86f\"/\"kube-root-ca.crt\""
Jul 28 21:06:40.260446 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.260428    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cm86f\"/\"default-dockercfg-xkx86\""
Jul 28 21:06:40.260493 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.260463    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cm86f\"/\"openshift-service-ca.crt\""
Jul 28 21:06:40.265012 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.264326    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"]
Jul 28 21:06:40.385175 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.385139    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88tj5\" (UniqueName: \"kubernetes.io/projected/a718eace-85c2-4ef9-a57a-e3177aa6d0da-kube-api-access-88tj5\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.385387 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.385191    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-podres\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.385387 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.385326    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-lib-modules\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.385479 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.385388    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-sys\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.385479 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.385407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-proc\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.395793 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.395751    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-njdbn_5a73c164-09ba-4337-b1c9-ec9ab07cf91d/networking-console-plugin/0.log"
Jul 28 21:06:40.486787 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.486702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-sys\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.486787 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.486746    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-proc\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.486787 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.486787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88tj5\" (UniqueName: \"kubernetes.io/projected/a718eace-85c2-4ef9-a57a-e3177aa6d0da-kube-api-access-88tj5\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.487035 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.486827    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-podres\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.487035 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.486835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-sys\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.487035 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.486867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-lib-modules\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.487035 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.486899    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-proc\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.487035 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.486975    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-podres\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.487035 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.486987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a718eace-85c2-4ef9-a57a-e3177aa6d0da-lib-modules\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.493579 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.493559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88tj5\" (UniqueName: \"kubernetes.io/projected/a718eace-85c2-4ef9-a57a-e3177aa6d0da-kube-api-access-88tj5\") pod \"perf-node-gather-daemonset-tpds7\" (UID: \"a718eace-85c2-4ef9-a57a-e3177aa6d0da\") " pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.568472 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.568387    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:40.699657 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:40.699632    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"]
Jul 28 21:06:40.701187 ip-10-0-136-137 kubenswrapper[2561]: W0728 21:06:40.701166    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda718eace_85c2_4ef9_a57a_e3177aa6d0da.slice/crio-21637e211501c005d22ca9b6c5068b865a4df76404d8788d90760fb091b86e25 WatchSource:0}: Error finding container 21637e211501c005d22ca9b6c5068b865a4df76404d8788d90760fb091b86e25: Status 404 returned error can't find the container with id 21637e211501c005d22ca9b6c5068b865a4df76404d8788d90760fb091b86e25
Jul 28 21:06:41.010191 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:41.010159    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/1.log"
Jul 28 21:06:41.020164 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:41.020128    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-vprlt_e8521c01-66a2-4a0d-b772-6b52b0ac644f/console-operator/2.log"
Jul 28 21:06:41.584428 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:41.584389    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7" event={"ID":"a718eace-85c2-4ef9-a57a-e3177aa6d0da","Type":"ContainerStarted","Data":"7f74057a0e7a509e1c6aef261c6bd242acf3a1e9433ceaf9299453f9fe8c289e"}
Jul 28 21:06:41.584982 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:41.584448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7" event={"ID":"a718eace-85c2-4ef9-a57a-e3177aa6d0da","Type":"ContainerStarted","Data":"21637e211501c005d22ca9b6c5068b865a4df76404d8788d90760fb091b86e25"}
Jul 28 21:06:41.584982 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:41.584476    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:41.597725 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:41.597696    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-5cvg4_d5d3fc94-1e79-4286-841b-f6740596a1bd/download-server/0.log"
Jul 28 21:06:41.601463 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:41.601417    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7" podStartSLOduration=1.601403523 podStartE2EDuration="1.601403523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 21:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:06:41.600049208 +0000 UTC m=+3503.996752418" watchObservedRunningTime="2026-07-28 21:06:41.601403523 +0000 UTC m=+3503.998106678"
Jul 28 21:06:42.162079 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:42.162046    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-b2wvf_d325844b-c6aa-4ab8-91ff-51276bbbeeba/volume-data-source-validator/0.log"
Jul 28 21:06:43.199157 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:43.199119    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwsms_74a7b7f8-0625-40ac-abfa-a433f4bfec5b/dns/0.log"
Jul 28 21:06:43.219076 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:43.219048    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwsms_74a7b7f8-0625-40ac-abfa-a433f4bfec5b/kube-rbac-proxy/0.log"
Jul 28 21:06:43.310067 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:43.310037    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8w5cw_6ac67f8d-9601-4ea3-b073-2acf0ab559be/dns-node-resolver/0.log"
Jul 28 21:06:43.927621 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:43.927596    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dkw2x_04b71894-3481-4701-b281-895f305778ed/node-ca/0.log"
Jul 28 21:06:44.837534 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:44.837508    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgz86h_7d5f4f51-8d8e-4220-96ed-204d6256298f/istio-proxy/0.log"
Jul 28 21:06:45.105301 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:45.105212    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-5t5fv_6899ec63-0fe1-4f1c-9a36-00f10837ed8d/discovery/0.log"
Jul 28 21:06:45.176845 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:45.176808    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6jjbz_c285b08d-7c13-49a3-82f7-5be298d970db/istio-proxy/0.log"
Jul 28 21:06:45.228056 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:45.228027    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6jjbz_c285b08d-7c13-49a3-82f7-5be298d970db/istio-proxy/1.log"
Jul 28 21:06:45.298673 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:45.298639    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-864kr_180c0d40-0a50-431e-b082-6ac16adfaf80/payload-processing/0.log"
Jul 28 21:06:45.321456 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:45.321421    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b5458f665-rgvs8_7e34a811-8e3c-4f37-91b8-c3b6f5251ccd/router/0.log"
Jul 28 21:06:46.123564 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:46.123531    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5mjp9_e747d2f9-f813-4fcf-a43e-e4562b74decb/serve-healthcheck-canary/0.log"
Jul 28 21:06:46.618222 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:46.618187    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-2sjmh_7e6f21f4-9b6c-4595-bd37-7b4661e09d0c/insights-operator/0.log"
Jul 28 21:06:46.619547 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:46.619519    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-2sjmh_7e6f21f4-9b6c-4595-bd37-7b4661e09d0c/insights-operator/1.log"
Jul 28 21:06:46.638169 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:46.638146    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dfkhg_875957db-e0ed-4178-9d66-855092ecaddc/kube-rbac-proxy/0.log"
Jul 28 21:06:46.657977 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:46.657950    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dfkhg_875957db-e0ed-4178-9d66-855092ecaddc/exporter/0.log"
Jul 28 21:06:46.677521 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:46.677490    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dfkhg_875957db-e0ed-4178-9d66-855092ecaddc/extractor/0.log"
Jul 28 21:06:47.598915 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:47.598888    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cm86f/perf-node-gather-daemonset-tpds7"
Jul 28 21:06:49.421218 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:49.421185    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v_ffd31c06-4f2e-4d98-900c-5e85caf6c35b/manager/0.log"
Jul 28 21:06:49.440139 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:49.440115    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74ff7fbd5d-bwm2v_ffd31c06-4f2e-4d98-900c-5e85caf6c35b/copy-manifests/0.log"
Jul 28 21:06:50.776158 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:50.776068    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgz86h_7d5f4f51-8d8e-4220-96ed-204d6256298f/istio-proxy/0.log"
Jul 28 21:06:51.030993 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:51.030856    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f8978bd54-g4pzf_16c567eb-ed41-419e-a76b-000d67995c0a/manager/0.log"
Jul 28 21:06:51.054447 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:51.054415    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-5t5fv_6899ec63-0fe1-4f1c-9a36-00f10837ed8d/discovery/0.log"
Jul 28 21:06:51.111547 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:51.111515    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6jjbz_c285b08d-7c13-49a3-82f7-5be298d970db/istio-proxy/0.log"
Jul 28 21:06:51.167794 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:51.167760    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6jjbz_c285b08d-7c13-49a3-82f7-5be298d970db/istio-proxy/1.log"
Jul 28 21:06:51.226324 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:51.226289    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-864kr_180c0d40-0a50-431e-b082-6ac16adfaf80/payload-processing/0.log"
Jul 28 21:06:51.240695 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:51.240663    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b5458f665-rgvs8_7e34a811-8e3c-4f37-91b8-c3b6f5251ccd/router/0.log"
Jul 28 21:06:52.608553 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:52.608459    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cgz86h_7d5f4f51-8d8e-4220-96ed-204d6256298f/istio-proxy/0.log"
Jul 28 21:06:52.880395 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:52.880281    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-5t5fv_6899ec63-0fe1-4f1c-9a36-00f10837ed8d/discovery/0.log"
Jul 28 21:06:52.934056 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:52.934025    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6jjbz_c285b08d-7c13-49a3-82f7-5be298d970db/istio-proxy/0.log"
Jul 28 21:06:52.983330 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:52.983292    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-6jjbz_c285b08d-7c13-49a3-82f7-5be298d970db/istio-proxy/1.log"
Jul 28 21:06:53.039171 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:53.039127    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-864kr_180c0d40-0a50-431e-b082-6ac16adfaf80/payload-processing/0.log"
Jul 28 21:06:53.058961 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:53.058933    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b5458f665-rgvs8_7e34a811-8e3c-4f37-91b8-c3b6f5251ccd/router/0.log"
Jul 28 21:06:56.416466 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:56.416421    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz_f735995e-7787-473c-b8a4-46de2510b36f/kube-storage-version-migrator-operator/1.log"
Jul 28 21:06:56.417919 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:56.417897    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-77nxz_f735995e-7787-473c-b8a4-46de2510b36f/kube-storage-version-migrator-operator/0.log"
Jul 28 21:06:57.402739 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:57.402662    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7frw_ad6e3524-1485-4c8c-a362-e07e9592f705/kube-multus-additional-cni-plugins/0.log"
Jul 28 21:06:57.421204 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:57.421175    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7frw_ad6e3524-1485-4c8c-a362-e07e9592f705/egress-router-binary-copy/0.log"
Jul 28 21:06:57.440520 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:57.440494    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7frw_ad6e3524-1485-4c8c-a362-e07e9592f705/cni-plugins/0.log"
Jul 28 21:06:57.459771 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:57.459746    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7frw_ad6e3524-1485-4c8c-a362-e07e9592f705/bond-cni-plugin/0.log"
Jul 28 21:06:57.477994 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:57.477972    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7frw_ad6e3524-1485-4c8c-a362-e07e9592f705/routeoverride-cni/0.log"
Jul 28 21:06:57.496475 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:57.496455    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7frw_ad6e3524-1485-4c8c-a362-e07e9592f705/whereabouts-cni-bincopy/0.log"
Jul 28 21:06:57.515293 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:57.515263    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k7frw_ad6e3524-1485-4c8c-a362-e07e9592f705/whereabouts-cni/0.log"
Jul 28 21:06:57.887073 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:57.887040    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q9d8g_ca6149a8-2b42-4ed4-a70d-f1dc111f9572/kube-multus/0.log"
Jul 28 21:06:57.955435 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:57.955402    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jgs7w_d2581e4e-d2dd-4022-bf6a-669145444f0f/network-metrics-daemon/0.log"
Jul 28 21:06:57.969648 ip-10-0-136-137 kubenswrapper[2561]: I0728 21:06:57.969624    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jgs7w_d2581e4e-d2dd-4022-bf6a-669145444f0f/kube-rbac-proxy/0.log"