Jul 18 01:48:24.082617 ip-10-0-128-229 systemd[1]: Starting Kubernetes Kubelet...
Jul 18 01:48:24.458734 ip-10-0-128-229 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:48:24.458734 ip-10-0-128-229 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 18 01:48:24.458734 ip-10-0-128-229 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:48:24.458734 ip-10-0-128-229 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 18 01:48:24.458734 ip-10-0-128-229 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:48:24.459381 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.458789    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 18 01:48:24.463991 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.463976    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:24.463991 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.463991    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.463995    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.463998    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464003    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464006    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464009    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464012    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464014    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464017    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464019    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464022    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464024    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464027    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464029    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464032    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464034    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464037    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464039    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464042    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464045    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:24.464058 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464048    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464050    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464052    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464055    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464057    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464060    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464063    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464066    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464068    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464071    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464074    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464076    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464078    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464081    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464083    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464086    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464088    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464091    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464093    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464095    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:24.464537 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464098    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464100    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464103    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464105    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464109    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464112    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464116    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464120    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464123    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464125    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464128    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464131    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464133    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464136    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464139    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464142    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464144    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464147    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464150    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464152    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:24.465017 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464155    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464157    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464160    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464162    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464165    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464167    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464170    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464172    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464174    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464177    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464179    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464181    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464184    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464186    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464188    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464191    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464193    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464196    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464199    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464205    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:24.465521 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464209    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464212    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464214    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464217    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464219    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464222    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464225    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464227    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464230    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464234    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464237    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464239    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464242    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464245    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464248    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464251    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464253    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464256    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464954    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:24.465994 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464961    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464964    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464967    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464970    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464972    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464975    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464977    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464979    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464982    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464985    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464987    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464991    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464994    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464997    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.464999    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465002    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465004    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465007    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465009    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465012    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:24.466467 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465015    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465017    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465020    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465024    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465028    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465031    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465034    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465037    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465040    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465042    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465045    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465048    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465050    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465053    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465056    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465058    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465061    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465064    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465066    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:24.466956 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465068    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465071    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465073    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465078    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465081    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465084    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465087    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465090    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465093    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465095    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465098    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465100    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465103    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465105    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465108    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465110    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465113    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465115    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465118    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:24.467432 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465120    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465123    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465125    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465127    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465130    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465132    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465134    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465137    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465139    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465141    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465144    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465146    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465148    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465151    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465153    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465155    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465158    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465160    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465163    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465165    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:24.467922 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465167    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465170    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465174    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465176    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465179    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465183    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465186    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465189    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465191    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465194    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465196    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465199    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465201    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465203    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465206    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465208    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465211    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465213    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465215    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465218    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:24.468433 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465614    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465620    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465624    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465629    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465632    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465635    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465637    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465640    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465643    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465646    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465648    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465651    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465653    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465656    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465659    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465661    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465664    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465667    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465670    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:24.468905 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465672    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465675    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465677    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465680    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465682    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465685    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465688    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465690    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465693    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465695    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465697    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465699    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465702    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465704    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465707    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465710    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465712    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465714    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465716    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465719    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:24.469396 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465721    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465724    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465727    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465729    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465731    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465734    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465736    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465739    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465742    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465744    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465747    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465749    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465752    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465754    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465756    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465759    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465761    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465763    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465766    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465768    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:24.469876 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465770    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465772    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465775    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465777    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465783    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465786    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465788    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465791    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465793    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465795    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465797    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465800    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465803    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465806    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465810    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465813    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465815    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465819    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465822    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:24.470358 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465824    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465827    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465830    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465832    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465835    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465838    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465841    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465845    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465847    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465850    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465853    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465855    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465858    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465860    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465863    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465865    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465868    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465871    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465874    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465876    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:24.470863 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.465878    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.465948    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.465959    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.465967    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.465974    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.465980    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.465985    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.465991    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.465996    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.465999    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466003    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466007    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466010    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466013    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466017    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466019    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466022    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466025    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466027    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466031    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466034    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466037    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466039    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466042    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 18 01:48:24.471336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466046    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466048    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466051    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466054    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466057    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466061    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466064    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466067    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466069    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466073    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466076    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466078    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466081    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466084    2560 flags.go:64] FLAG: --enable-server="true"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466086    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466091    2560 flags.go:64] FLAG: --event-burst="100"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466094    2560 flags.go:64] FLAG: --event-qps="50"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466096    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466100    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466102    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466106    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466109    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466111    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466115    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466118    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 18 01:48:24.471906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466120    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466123    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466126    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466129    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466131    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466134    2560 flags.go:64] FLAG: --feature-gates=""
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466138    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466141    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466144    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466146    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466149    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466152    2560 flags.go:64] FLAG: --help="false"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466157    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466159    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466162    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466165    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466168    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466171    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466174    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466176    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466179    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466182    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466184    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466187    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 18 01:48:24.472705 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466190    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466193    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466195    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466198    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466201    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466204    2560 flags.go:64] FLAG: --lock-file=""
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466206    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466209    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466212    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466217    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466220    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466223    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466225    2560 flags.go:64] FLAG: --logging-format="text"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466228    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466231    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466234    2560 flags.go:64] FLAG: --manifest-url=""
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466236    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466240    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466243    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466246    2560 flags.go:64] FLAG: --max-pods="110"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466251    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466254    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466256    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466259    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466262    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 18 01:48:24.473303 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466265    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466267    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466274    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466277    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466280    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466283    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466286    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466290    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466293    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466296    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466299    2560 flags.go:64] FLAG: --port="10250"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466302    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466304    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03f96a31e6975a0ab"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466307    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466310    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466313    2560 flags.go:64] FLAG: --register-node="true"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466316    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466332    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466335    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466337    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466340    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466344    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466347    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466349    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466352    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 18 01:48:24.473948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466354    2560 flags.go:64] FLAG: --runonce="false"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466357    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466361    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466364    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466367    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466369    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466372    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466375    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466378    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466381    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466383    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466392    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466396    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466398    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466401    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466404    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466410    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466413    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466416    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466419    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466422    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466425    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466427    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466431    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466434    2560 flags.go:64] FLAG: --v="2"
Jul 18 01:48:24.474588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466438    2560 flags.go:64] FLAG: --version="false"
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466441    2560 flags.go:64] FLAG: --vmodule=""
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466445    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466449    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466565    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466569    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466572    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466574    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466577    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466580    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466582    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466585    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466587    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466590    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466593    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466595    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466598    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466600    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466603    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466605    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:24.475188 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466608    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466610    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466613    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466616    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466619    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466621    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466624    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466626    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466628    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466631    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466633    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466636    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466639    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466641    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466645    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466648    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466651    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466653    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466655    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:24.475692 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466658    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466660    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466663    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466665    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466668    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466670    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466673    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466675    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466678    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466680    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466683    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466685    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466687    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466690    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466692    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466695    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466699    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466702    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466704    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:24.476178 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466707    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466709    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466712    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466714    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466716    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466719    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466721    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466724    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466727    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466730    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466734    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466737    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466740    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466742    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466745    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466748    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466750    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466753    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466755    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466757    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:24.476746 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466760    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466762    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466765    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466767    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466770    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466772    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466774    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466777    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466779    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466784    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466786    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466789    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466791    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466794    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466796    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466799    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466801    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466804    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466806    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466809    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:24.477226 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466812    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466814    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466817    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466819    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.466823    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.466828    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.473775    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.473788    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.473808    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.473817    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473873    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473878    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473881    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473884    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:24.477722 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473887    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473890    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473893    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473896    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473898    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473901    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473903    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473906    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473908    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473911    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473913    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473916    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473918    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473921    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473923    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473926    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473928    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473930    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473933    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473935    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:24.478076 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473938    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473940    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473942    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473945    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473947    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473951    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473954    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473957    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473959    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473962    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473964    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473967    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473969    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473972    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473974    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473976    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473980    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473984    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473987    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473989    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:24.478574 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473992    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473994    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473997    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.473999    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474001    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474004    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474006    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474010    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474013    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474016    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474019    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474021    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474024    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474027    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474029    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474032    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474035    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474038    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474042    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:24.479056 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474044    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474046    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474049    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474051    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474054    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474056    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474060    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474063    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474066    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474068    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474071    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474073    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474076    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474078    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474081    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474083    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474085    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474088    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474091    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474093    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:24.479531 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474096    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474098    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474100    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474103    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474105    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474107    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474110    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474112    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474114    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474117    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474120    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474122    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474126    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474128    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474131    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:24.480022 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474133    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.474138    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474250    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474256    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474259    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474262    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474264    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474267    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474270    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474272    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474275    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474277    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474280    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474283    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:24.480464 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474287    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474290    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474292    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474295    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474297    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474300    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474302    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474304    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474307    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474309    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474312    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474314    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474331    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474334    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474337    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474340    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474343    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474345    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474348    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474350    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:24.480807 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474353    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474355    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474358    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474360    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474363    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474365    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474367    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474370    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474372    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474375    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474377    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474380    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474383    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474392    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474395    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474398    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474401    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474403    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474406    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474408    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:24.481302 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474410    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474413    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474415    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474418    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474420    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474423    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474425    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474428    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474430    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474433    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474436    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474440    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474443    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474445    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474448    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474450    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474453    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474455    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474457    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:24.481962 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474460    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474462    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474464    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474467    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474469    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474472    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474474    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474476    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474479    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474481    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474483    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474485    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474488    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474490    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474492    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474494    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474497    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474499    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474502    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474504    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:24.482694 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474507    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474509    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474511    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474514    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474516    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474519    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474521    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:24.474523    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.474529    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.474634    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.476880    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.478209    2560 server.go:1019] "Starting client certificate rotation"
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.478315    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 01:48:24.483176 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.479033    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 01:48:24.483511 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.481255    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 01:48:24.485203 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.485183    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 01:48:24.494663 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.494646    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 18 01:48:24.497089 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.497068    2560 log.go:25] "Validated CRI v1 image API"
Jul 18 01:48:24.497945 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.497931    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 18 01:48:24.501487 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.501466    2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e55a2bb9-2345-4b44-8847-badffeee5166:/dev/nvme0n1p4 f1c9a6c4-5f9e-4370-85ec-a8cf5e09efdc:/dev/nvme0n1p3]
Jul 18 01:48:24.501559 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.501486    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 18 01:48:24.507143 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.507029    2560 manager.go:216] Machine: {Timestamp:2026-07-18 01:48:24.505761287 +0000 UTC m=+0.308005734 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3063326 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e2798ce937107fe95fa30f9286e36 SystemUUID:ec2e2798-ce93-7107-fe95-fa30f9286e36 BootID:3fb4a6d5-7e51-4b9e-adf6-dfbf351b60b6 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:5f:ca:d7:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:5f:ca:d7:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:bb:1f:5a:d6:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 18 01:48:24.507143 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.507136    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 18 01:48:24.507254 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.507228    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 18 01:48:24.509027 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.509012    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 01:48:24.510483 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.510440    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 18 01:48:24.510632 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.510488    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-229.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 18 01:48:24.511614 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.511604    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 18 01:48:24.511656 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.511618    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 18 01:48:24.511656 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.511625    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 01:48:24.512340 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.512315    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 01:48:24.513910 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.513900    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 18 01:48:24.517422 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.517410    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 01:48:24.517553 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.517544    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 18 01:48:24.517587 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.517580    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 18 01:48:24.517624 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.517592    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 18 01:48:24.517624 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.517602    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 18 01:48:24.517624 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.517610    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 18 01:48:24.517624 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.517618    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 18 01:48:24.518252 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.518230    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 01:48:24.518378 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.518258    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 01:48:24.520419 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.520403    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 18 01:48:24.522162 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.522146    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 18 01:48:24.522215 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.522179    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 18 01:48:24.524394 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524377    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 18 01:48:24.524478 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524405    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 18 01:48:24.524478 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524413    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 18 01:48:24.524478 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524419    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 18 01:48:24.524478 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524427    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 18 01:48:24.524478 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524433    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 18 01:48:24.524478 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524449    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 18 01:48:24.524478 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524457    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 18 01:48:24.524478 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524464    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 18 01:48:24.524478 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524470    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 18 01:48:24.524478 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524480    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 18 01:48:24.524747 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.524486    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 18 01:48:24.525236 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.525210    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 18 01:48:24.525449 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.525435    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 18 01:48:24.528271 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.528252    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-229.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 18 01:48:24.528347 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.528269    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 18 01:48:24.528347 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.528293    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 18 01:48:24.528991 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.528971    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7tmqk"
Jul 18 01:48:24.529099 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.529075    2560 server.go:1268] "Started kubelet"
Jul 18 01:48:24.529204 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.529166    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 18 01:48:24.529263 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.529221    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 18 01:48:24.529263 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.529180    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 18 01:48:24.529928 ip-10-0-128-229 systemd[1]: Started Kubernetes Kubelet.
Jul 18 01:48:24.531233 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.531219    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 18 01:48:24.531341 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.531303    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 18 01:48:24.535812 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.534586    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-229.ec2.internal.18c33f24c538a99d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-229.ec2.internal,UID:ip-10-0-128-229.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-229.ec2.internal,},FirstTimestamp:2026-07-18 01:48:24.529045917 +0000 UTC m=+0.331290365,LastTimestamp:2026-07-18 01:48:24.529045917 +0000 UTC m=+0.331290365,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-229.ec2.internal,}"
Jul 18 01:48:24.536731 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.536705    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 18 01:48:24.539046 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.539032    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7tmqk"
Jul 18 01:48:24.539730 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.539599    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 18 01:48:24.539730 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.539606    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 18 01:48:24.539864 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.539745    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:24.540548 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.540402    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 18 01:48:24.540548 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.540410    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 18 01:48:24.540548 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.540444    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 18 01:48:24.540711 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.540592    2560 factory.go:55] Registering systemd factory
Jul 18 01:48:24.540711 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.540605    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 18 01:48:24.540868 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.540826    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 18 01:48:24.540868 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.540866    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 18 01:48:24.540972 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.540926    2560 factory.go:153] Registering CRI-O factory
Jul 18 01:48:24.540972 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.540940    2560 factory.go:223] Registration of the crio container factory successfully
Jul 18 01:48:24.541057 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.540986    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 18 01:48:24.541057 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.541013    2560 factory.go:103] Registering Raw factory
Jul 18 01:48:24.541057 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.541027    2560 manager.go:1196] Started watching for new ooms in manager
Jul 18 01:48:24.541566 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.541552    2560 manager.go:349] Starting recovery of all containers
Jul 18 01:48:24.542846 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.542818    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 18 01:48:24.543013 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.542989    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 18 01:48:24.551736 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.551632    2560 manager.go:354] Recovery completed
Jul 18 01:48:24.557783 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.557767    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:48:24.559799 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.559783    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:48:24.559857 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.559814    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:48:24.559857 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.559829    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:48:24.560308 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.560295    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 18 01:48:24.560308 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.560307    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 18 01:48:24.560417 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.560339    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 01:48:24.560417 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.560341    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:48:24.561125 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.561112    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:48:24.561164 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.561138    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:48:24.561164 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.561148    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:48:24.561542 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.561530    2560 policy_none.go:49] "None policy: Start"
Jul 18 01:48:24.561584 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.561550    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 18 01:48:24.561584 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.561566    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 18 01:48:24.562800 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.562791    2560 policy_none.go:47] "Start"
Jul 18 01:48:24.607895 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.607882    2560 manager.go:337] "Starting Device Plugin manager"
Jul 18 01:48:24.608033 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.607917    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 18 01:48:24.608033 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.607931    2560 server.go:87] "Starting device plugin registration server"
Jul 18 01:48:24.608170 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.608158    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 18 01:48:24.608217 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.608192    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 18 01:48:24.608302 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.608286    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 18 01:48:24.608397 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.608383    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 18 01:48:24.608447 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.608397    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 18 01:48:24.608953 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.608935    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 18 01:48:24.609033 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.608981    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:24.708774 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.708727    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:48:24.709802 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.709658    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:48:24.709802 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.709683    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:48:24.709802 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.709695    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:48:24.709802 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.709719    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.717212 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.717191    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.717293 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.717214    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-229.ec2.internal\": node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:24.732606 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.732584    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:24.737907 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.737888    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 18 01:48:24.739130 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.739110    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 18 01:48:24.739209 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.739146    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 18 01:48:24.739209 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.739168    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 18 01:48:24.739209 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.739198    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 18 01:48:24.741148 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.741132    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:48:24.833548 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.833521    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:24.839674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.839656    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"]
Jul 18 01:48:24.839726 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.839709    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:48:24.841213 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.841191    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:48:24.841295 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.841226    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:48:24.841295 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.841251    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:48:24.842361 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.842345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a885deaa6d8704209113b7204e1dc8e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a885deaa6d8704209113b7204e1dc8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.842426 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.842370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a885deaa6d8704209113b7204e1dc8e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a885deaa6d8704209113b7204e1dc8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.842485 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.842474    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:48:24.842608 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.842590    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.842663 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.842629    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:48:24.843306 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.843280    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:48:24.843387 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.843313    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:48:24.843387 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.843288    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:48:24.843387 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.843345    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:48:24.843387 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.843352    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:48:24.843387 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.843365    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:48:24.844494 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.844478    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.844538 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.844502    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:48:24.845152 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.845137    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:48:24.845213 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.845160    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:48:24.845213 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.845172    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:48:24.874962 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.874940    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-229.ec2.internal\" not found" node="ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.879398 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.879385    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-229.ec2.internal\" not found" node="ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.933595 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:24.933578    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:24.943001 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.942982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a885deaa6d8704209113b7204e1dc8e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a885deaa6d8704209113b7204e1dc8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.943065 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.943008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a885deaa6d8704209113b7204e1dc8e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a885deaa6d8704209113b7204e1dc8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.943065 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.943028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a916a73ea0727afb0c62c6111b95f497-config\") pod \"kube-apiserver-proxy-ip-10-0-128-229.ec2.internal\" (UID: \"a916a73ea0727afb0c62c6111b95f497\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.943137 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.943083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a885deaa6d8704209113b7204e1dc8e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a885deaa6d8704209113b7204e1dc8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:24.943137 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:24.943088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a885deaa6d8704209113b7204e1dc8e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"a885deaa6d8704209113b7204e1dc8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:25.034654 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:25.034611    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:25.043967 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.043942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a916a73ea0727afb0c62c6111b95f497-config\") pod \"kube-apiserver-proxy-ip-10-0-128-229.ec2.internal\" (UID: \"a916a73ea0727afb0c62c6111b95f497\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:25.044033 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.043985    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a916a73ea0727afb0c62c6111b95f497-config\") pod \"kube-apiserver-proxy-ip-10-0-128-229.ec2.internal\" (UID: \"a916a73ea0727afb0c62c6111b95f497\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:25.135113 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:25.135094    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:25.178652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.178632    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:25.183503 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.183288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:25.235485 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:25.235463    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:25.335996 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:25.335951    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:25.436527 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:25.436504    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:25.478768 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.478742    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 18 01:48:25.479180 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.478912    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 01:48:25.536589 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:25.536564    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 18 01:48:25.545640 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.545608    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 01:43:24 +0000 UTC" deadline="2027-12-21 17:52:37.33995995 +0000 UTC"
Jul 18 01:48:25.545711 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.545641    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12520h4m11.794322768s"
Jul 18 01:48:25.608324 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.608299    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:48:25.640075 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.640052    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:25.651044 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.651027    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 01:48:25.652785 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.652770    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 18 01:48:25.661749 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.661732    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 01:48:25.699765 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:25.699732    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda885deaa6d8704209113b7204e1dc8e8.slice/crio-7db102b70d5ae4319097d19a536c91b7b9f82638c508f0732fa60e73e65e5cfe WatchSource:0}: Error finding container 7db102b70d5ae4319097d19a536c91b7b9f82638c508f0732fa60e73e65e5cfe: Status 404 returned error can't find the container with id 7db102b70d5ae4319097d19a536c91b7b9f82638c508f0732fa60e73e65e5cfe
Jul 18 01:48:25.700999 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:25.700977    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda916a73ea0727afb0c62c6111b95f497.slice/crio-c01266e82049cfe7e3e395989db3c599204e42255d815d78acaba8154034aec0 WatchSource:0}: Error finding container c01266e82049cfe7e3e395989db3c599204e42255d815d78acaba8154034aec0: Status 404 returned error can't find the container with id c01266e82049cfe7e3e395989db3c599204e42255d815d78acaba8154034aec0
Jul 18 01:48:25.706198 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.706183    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:48:25.741943 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.741896    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" event={"ID":"a885deaa6d8704209113b7204e1dc8e8","Type":"ContainerStarted","Data":"7db102b70d5ae4319097d19a536c91b7b9f82638c508f0732fa60e73e65e5cfe"}
Jul 18 01:48:25.743011 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.742979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" event={"ID":"a916a73ea0727afb0c62c6111b95f497","Type":"ContainerStarted","Data":"c01266e82049cfe7e3e395989db3c599204e42255d815d78acaba8154034aec0"}
Jul 18 01:48:25.984135 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:25.984055    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:48:26.056631 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.056604    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:48:26.519514 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.519481    2560 apiserver.go:52] "Watching apiserver"
Jul 18 01:48:26.530268 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.530235    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 18 01:48:26.530717 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.530687    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-nw226","openshift-network-operator/iptables-alerter-jpfzk","kube-system/global-pull-secret-syncer-5wzcl","kube-system/konnectivity-agent-zg85n","openshift-image-registry/node-ca-mhngd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal","openshift-multus/multus-9ql7m","openshift-ovn-kubernetes/ovnkube-node-cb6rk","kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5","openshift-cluster-node-tuning-operator/tuned-gdf8m","openshift-dns/node-resolver-44g5s","openshift-multus/multus-additional-cni-plugins-cvs5l","openshift-multus/network-metrics-daemon-8csvn"]
Jul 18 01:48:26.532674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.532645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.535920 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.535903    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 18 01:48:26.536467 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.536447    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 18 01:48:26.536683 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.536640    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 18 01:48:26.536870 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.536852    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-426dm\""
Jul 18 01:48:26.539859 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.539835    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.540152 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.540083    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.541821 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.541802    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 18 01:48:26.542515 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.542480    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.542604 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.542525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:26.542994 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.542480    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:26.543075 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.543037    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:26.543140 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.542964    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:26.543210 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.543155    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:26.543454 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.543380    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.545254 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.545060    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.545769 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.545747    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 18 01:48:26.545895 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.545805    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 18 01:48:26.545961 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.545942    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 18 01:48:26.546192 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.546174    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 18 01:48:26.546382 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.546357    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 18 01:48:26.546628 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.546611    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.547747 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.547728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.549560 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.549537    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:26.549661 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.549624    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:26.551525 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551502    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 18 01:48:26.551646 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d178fdd8-e4a8-4251-bd75-2de893a6994c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.551713 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-run-ovn\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.551713 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551679    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6rmd5\""
Jul 18 01:48:26.551713 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551696    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-log-socket\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.551862 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-conf-dir\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.551862 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-var-lib-openvswitch\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.551862 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-node-log\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.551862 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551845    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 18 01:48:26.552063 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-cni-netd\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552063 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48phn\" (UniqueName: \"kubernetes.io/projected/58fe661b-1a1e-4afc-8721-4b124aad547c-kube-api-access-48phn\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552063 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-var-lib-cni-bin\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.552063 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-run-systemd\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552063 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.551978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552063 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552006    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 18 01:48:26.552063 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-system-cni-dir\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.552063 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5617181b-0119-4bd1-b5cb-25f0ab09ce41-konnectivity-ca\") pod \"konnectivity-agent-zg85n\" (UID: \"5617181b-0119-4bd1-b5cb-25f0ab09ce41\") " pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-kubelet-config\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-run-netns\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-var-lib-cni-multus\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552190    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d178fdd8-e4a8-4251-bd75-2de893a6994c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552216    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58fe661b-1a1e-4afc-8721-4b124aad547c-ovn-node-metrics-cert\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-os-release\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552343    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-etc-kubernetes\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p8sx\" (UniqueName: \"kubernetes.io/projected/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-kube-api-access-9p8sx\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.552499 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctwmm\" (UniqueName: \"kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm\") pod \"network-check-target-nw226\" (UID: \"8f77203a-02f4-49ad-9123-7eda0c6c8091\") " pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552537    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-systemd-units\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552590    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-run-multus-certs\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-run-openvswitch\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-kubelet\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552697    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-slash\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-run-netns\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2knrg\" (UniqueName: \"kubernetes.io/projected/d178fdd8-e4a8-4251-bd75-2de893a6994c-kube-api-access-2knrg\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552780    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552799    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58fe661b-1a1e-4afc-8721-4b124aad547c-env-overrides\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-daemon-config\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-dbus\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-cnibin\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.552957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.552916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-var-lib-kubelet\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553093    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cacba113-1053-4df9-b5fe-954e50d6bb34-serviceca\") pod \"node-ca-mhngd\" (UID: \"cacba113-1053-4df9-b5fe-954e50d6bb34\") " pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553170    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58fe661b-1a1e-4afc-8721-4b124aad547c-ovnkube-config\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553196    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-system-cni-dir\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-cni-dir\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-cni-binary-copy\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553293    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-hostroot\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cacba113-1053-4df9-b5fe-954e50d6bb34-host\") pod \"node-ca-mhngd\" (UID: \"cacba113-1053-4df9-b5fe-954e50d6bb34\") " pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-os-release\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d178fdd8-e4a8-4251-bd75-2de893a6994c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553475    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-cni-bin\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58fe661b-1a1e-4afc-8721-4b124aad547c-ovnkube-script-lib\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553544    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96kj9\" (UniqueName: \"kubernetes.io/projected/cacba113-1053-4df9-b5fe-954e50d6bb34-kube-api-access-96kj9\") pod \"node-ca-mhngd\" (UID: \"cacba113-1053-4df9-b5fe-954e50d6bb34\") " pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-etc-openvswitch\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.553643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553616    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qjmhb\""
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553638    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-run-k8s-cni-cncf-io\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-cnibin\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5617181b-0119-4bd1-b5cb-25f0ab09ce41-agent-certs\") pod \"konnectivity-agent-zg85n\" (UID: \"5617181b-0119-4bd1-b5cb-25f0ab09ce41\") " pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553757    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-socket-dir-parent\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553816    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553950    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l7p4d\""
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.553984    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.554178    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.554465    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k64gx\""
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.554575    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 18 01:48:26.554652 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.554619    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 18 01:48:26.555229 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.554730    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 18 01:48:26.556405 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.556366    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-22s56\""
Jul 18 01:48:26.556495 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.556375    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5k774\""
Jul 18 01:48:26.559140 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.559115    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:48:26.559429 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.559410    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 18 01:48:26.559945 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.559926    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rx8t9\""
Jul 18 01:48:26.560114 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.560098    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 18 01:48:26.560664 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.560639    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8hnd4\""
Jul 18 01:48:26.564127 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.564101    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 01:48:26.580163 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.580134    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m7ncd"
Jul 18 01:48:26.588578 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.588559    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m7ncd"
Jul 18 01:48:26.641879 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.641856    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 18 01:48:26.654307 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:26.654424 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-run-k8s-cni-cncf-io\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.654424 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-sys-fs\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.654424 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654375    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-var-lib-kubelet\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.654424 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ksmb\" (UniqueName: \"kubernetes.io/projected/3a769686-904f-4c18-9432-4312baa4cec6-kube-api-access-6ksmb\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.654668 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-cnibin\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.654668 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.654445    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:26.654668 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5617181b-0119-4bd1-b5cb-25f0ab09ce41-agent-certs\") pod \"konnectivity-agent-zg85n\" (UID: \"5617181b-0119-4bd1-b5cb-25f0ab09ce41\") " pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:26.654668 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654518    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-cnibin\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.654668 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-run-k8s-cni-cncf-io\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.654668 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.654617    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret podName:6b8627d7-e095-4a0e-a025-3a6f488d3bdc nodeName:}" failed. No retries permitted until 2026-07-18 01:48:27.154582672 +0000 UTC m=+2.956827132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret") pod "global-pull-secret-syncer-5wzcl" (UID: "6b8627d7-e095-4a0e-a025-3a6f488d3bdc") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:26.654668 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654657    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-socket-dir-parent\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa2641fc-b98a-40a4-a4c2-c8b3011b7377-tmp-dir\") pod \"node-resolver-44g5s\" (UID: \"aa2641fc-b98a-40a4-a4c2-c8b3011b7377\") " pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2ls8\" (UniqueName: \"kubernetes.io/projected/aa2641fc-b98a-40a4-a4c2-c8b3011b7377-kube-api-access-s2ls8\") pod \"node-resolver-44g5s\" (UID: \"aa2641fc-b98a-40a4-a4c2-c8b3011b7377\") " pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-sysconfig\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-socket-dir-parent\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-host\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654796    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-registration-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d178fdd8-e4a8-4251-bd75-2de893a6994c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-run-ovn\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-log-socket\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-run-ovn\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.654929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-conf-dir\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-var-lib-openvswitch\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-log-socket\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-conf-dir\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-node-log\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-cni-netd\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655069 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655069    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-var-lib-openvswitch\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48phn\" (UniqueName: \"kubernetes.io/projected/58fe661b-1a1e-4afc-8721-4b124aad547c-kube-api-access-48phn\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-cni-netd\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655126    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-sys\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655077    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-node-log\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg999\" (UniqueName: \"kubernetes.io/projected/ae5f2f1e-83b8-4f95-b567-4dca37380e26-kube-api-access-wg999\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-socket-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-var-lib-cni-bin\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-run-systemd\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655258    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-var-lib-cni-bin\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655285    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655374    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-system-cni-dir\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5617181b-0119-4bd1-b5cb-25f0ab09ce41-konnectivity-ca\") pod \"konnectivity-agent-zg85n\" (UID: \"5617181b-0119-4bd1-b5cb-25f0ab09ce41\") " pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655414    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-system-cni-dir\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.655869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-run-systemd\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-kubelet-config\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-run-netns\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d178fdd8-e4a8-4251-bd75-2de893a6994c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-var-lib-cni-multus\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-sysctl-d\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655569    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-run-netns\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-kubelet-config\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-systemd\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-var-lib-cni-multus\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d178fdd8-e4a8-4251-bd75-2de893a6994c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58fe661b-1a1e-4afc-8721-4b124aad547c-ovn-node-metrics-cert\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-os-release\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-etc-kubernetes\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655772    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p8sx\" (UniqueName: \"kubernetes.io/projected/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-kube-api-access-9p8sx\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655799    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-modprobe-d\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.656725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae5f2f1e-83b8-4f95-b567-4dca37380e26-tmp\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655835    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5617181b-0119-4bd1-b5cb-25f0ab09ce41-konnectivity-ca\") pod \"konnectivity-agent-zg85n\" (UID: \"5617181b-0119-4bd1-b5cb-25f0ab09ce41\") " pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655849    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwmm\" (UniqueName: \"kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm\") pod \"network-check-target-nw226\" (UID: \"8f77203a-02f4-49ad-9123-7eda0c6c8091\") " pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655888    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-etc-kubernetes\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-systemd-units\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-run-multus-certs\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-kubernetes\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-tuned\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.655999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa2641fc-b98a-40a4-a4c2-c8b3011b7377-hosts-file\") pod \"node-resolver-44g5s\" (UID: \"aa2641fc-b98a-40a4-a4c2-c8b3011b7377\") " pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/945fc519-0461-4a8e-a94f-5ce5db26d97d-iptables-alerter-script\") pod \"iptables-alerter-jpfzk\" (UID: \"945fc519-0461-4a8e-a94f-5ce5db26d97d\") " pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xm97\" (UniqueName: \"kubernetes.io/projected/945fc519-0461-4a8e-a94f-5ce5db26d97d-kube-api-access-9xm97\") pod \"iptables-alerter-jpfzk\" (UID: \"945fc519-0461-4a8e-a94f-5ce5db26d97d\") " pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-run-openvswitch\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-run-multus-certs\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-kubelet\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-slash\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-run-netns\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.657673 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-sysctl-conf\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-device-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2knrg\" (UniqueName: \"kubernetes.io/projected/d178fdd8-e4a8-4251-bd75-2de893a6994c-kube-api-access-2knrg\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-systemd-units\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-run-netns\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-slash\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58fe661b-1a1e-4afc-8721-4b124aad547c-env-overrides\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-run-openvswitch\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656379    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-daemon-config\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x682\" (UniqueName: \"kubernetes.io/projected/418cbc40-4789-4ca8-b465-6abeeacf0c11-kube-api-access-5x682\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-dbus\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656474    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-cnibin\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656489    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-os-release\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-var-lib-kubelet\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-lib-modules\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cacba113-1053-4df9-b5fe-954e50d6bb34-serviceca\") pod \"node-ca-mhngd\" (UID: \"cacba113-1053-4df9-b5fe-954e50d6bb34\") " pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58fe661b-1a1e-4afc-8721-4b124aad547c-ovnkube-config\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-system-cni-dir\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-cni-dir\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/945fc519-0461-4a8e-a94f-5ce5db26d97d-host-slash\") pod \"iptables-alerter-jpfzk\" (UID: \"945fc519-0461-4a8e-a94f-5ce5db26d97d\") " pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-cni-binary-copy\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-kubelet\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-hostroot\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.656847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-hostroot\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-cni-dir\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-system-cni-dir\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-cnibin\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-multus-daemon-config\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657169    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-host-var-lib-kubelet\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-dbus\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cacba113-1053-4df9-b5fe-954e50d6bb34-host\") pod \"node-ca-mhngd\" (UID: \"cacba113-1053-4df9-b5fe-954e50d6bb34\") " pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cacba113-1053-4df9-b5fe-954e50d6bb34-serviceca\") pod \"node-ca-mhngd\" (UID: \"cacba113-1053-4df9-b5fe-954e50d6bb34\") " pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-os-release\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d178fdd8-e4a8-4251-bd75-2de893a6994c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d178fdd8-e4a8-4251-bd75-2de893a6994c-os-release\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-cni-bin\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.658921 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58fe661b-1a1e-4afc-8721-4b124aad547c-ovnkube-script-lib\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657340    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cacba113-1053-4df9-b5fe-954e50d6bb34-host\") pod \"node-ca-mhngd\" (UID: \"cacba113-1053-4df9-b5fe-954e50d6bb34\") " pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657352    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96kj9\" (UniqueName: \"kubernetes.io/projected/cacba113-1053-4df9-b5fe-954e50d6bb34-kube-api-access-96kj9\") pod \"node-ca-mhngd\" (UID: \"cacba113-1053-4df9-b5fe-954e50d6bb34\") " pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-cni-bin\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-etc-openvswitch\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657499    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-run\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657512    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58fe661b-1a1e-4afc-8721-4b124aad547c-env-overrides\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-etc-selinux\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-etc-openvswitch\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657563    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fe661b-1a1e-4afc-8721-4b124aad547c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-cni-binary-copy\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d178fdd8-e4a8-4251-bd75-2de893a6994c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.657831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d178fdd8-e4a8-4251-bd75-2de893a6994c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.658093    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58fe661b-1a1e-4afc-8721-4b124aad547c-ovnkube-script-lib\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.659674 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.658151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58fe661b-1a1e-4afc-8721-4b124aad547c-ovnkube-config\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.660462 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.660421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58fe661b-1a1e-4afc-8721-4b124aad547c-ovn-node-metrics-cert\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.660581 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.660560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5617181b-0119-4bd1-b5cb-25f0ab09ce41-agent-certs\") pod \"konnectivity-agent-zg85n\" (UID: \"5617181b-0119-4bd1-b5cb-25f0ab09ce41\") " pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:26.664024 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.664004    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:26.664193 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.664040    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:26.664193 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.664055    2560 projected.go:196] Error preparing data for projected volume kube-api-access-ctwmm for pod openshift-network-diagnostics/network-check-target-nw226: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:26.664193 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.664116    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm podName:8f77203a-02f4-49ad-9123-7eda0c6c8091 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:27.164098958 +0000 UTC m=+2.966343398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ctwmm" (UniqueName: "kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm") pod "network-check-target-nw226" (UID: "8f77203a-02f4-49ad-9123-7eda0c6c8091") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:26.667577 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.667555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2knrg\" (UniqueName: \"kubernetes.io/projected/d178fdd8-e4a8-4251-bd75-2de893a6994c-kube-api-access-2knrg\") pod \"multus-additional-cni-plugins-cvs5l\" (UID: \"d178fdd8-e4a8-4251-bd75-2de893a6994c\") " pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.667665 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.667648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p8sx\" (UniqueName: \"kubernetes.io/projected/4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc-kube-api-access-9p8sx\") pod \"multus-9ql7m\" (UID: \"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc\") " pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.667732 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.667697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96kj9\" (UniqueName: \"kubernetes.io/projected/cacba113-1053-4df9-b5fe-954e50d6bb34-kube-api-access-96kj9\") pod \"node-ca-mhngd\" (UID: \"cacba113-1053-4df9-b5fe-954e50d6bb34\") " pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.668140 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.668123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48phn\" (UniqueName: \"kubernetes.io/projected/58fe661b-1a1e-4afc-8721-4b124aad547c-kube-api-access-48phn\") pod \"ovnkube-node-cb6rk\" (UID: \"58fe661b-1a1e-4afc-8721-4b124aad547c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.758245 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2ls8\" (UniqueName: \"kubernetes.io/projected/aa2641fc-b98a-40a4-a4c2-c8b3011b7377-kube-api-access-s2ls8\") pod \"node-resolver-44g5s\" (UID: \"aa2641fc-b98a-40a4-a4c2-c8b3011b7377\") " pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.758245 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-sysconfig\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.758476 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-sysconfig\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.758476 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-host\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.758476 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-registration-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.758476 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-sys\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.758476 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg999\" (UniqueName: \"kubernetes.io/projected/ae5f2f1e-83b8-4f95-b567-4dca37380e26-kube-api-access-wg999\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.758476 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-host\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-registration-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-sys\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-socket-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758675    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-socket-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-sysctl-d\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-systemd\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758733    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-modprobe-d\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.758744    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:26.758808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae5f2f1e-83b8-4f95-b567-4dca37380e26-tmp\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758815    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-systemd\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:26.758849    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs podName:418cbc40-4789-4ca8-b465-6abeeacf0c11 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:27.258829475 +0000 UTC m=+3.061073911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs") pod "network-metrics-daemon-8csvn" (UID: "418cbc40-4789-4ca8-b465-6abeeacf0c11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758866    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-sysctl-d\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-kubernetes\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-modprobe-d\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-tuned\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758949    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-kubernetes\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.758980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa2641fc-b98a-40a4-a4c2-c8b3011b7377-hosts-file\") pod \"node-resolver-44g5s\" (UID: \"aa2641fc-b98a-40a4-a4c2-c8b3011b7377\") " pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/945fc519-0461-4a8e-a94f-5ce5db26d97d-iptables-alerter-script\") pod \"iptables-alerter-jpfzk\" (UID: \"945fc519-0461-4a8e-a94f-5ce5db26d97d\") " pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xm97\" (UniqueName: \"kubernetes.io/projected/945fc519-0461-4a8e-a94f-5ce5db26d97d-kube-api-access-9xm97\") pod \"iptables-alerter-jpfzk\" (UID: \"945fc519-0461-4a8e-a94f-5ce5db26d97d\") " pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa2641fc-b98a-40a4-a4c2-c8b3011b7377-hosts-file\") pod \"node-resolver-44g5s\" (UID: \"aa2641fc-b98a-40a4-a4c2-c8b3011b7377\") " pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-sysctl-conf\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-device-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x682\" (UniqueName: \"kubernetes.io/projected/418cbc40-4789-4ca8-b465-6abeeacf0c11-kube-api-access-5x682\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:26.759188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759175    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-lib-modules\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/945fc519-0461-4a8e-a94f-5ce5db26d97d-host-slash\") pod \"iptables-alerter-jpfzk\" (UID: \"945fc519-0461-4a8e-a94f-5ce5db26d97d\") " pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-run\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-sysctl-conf\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-run\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/945fc519-0461-4a8e-a94f-5ce5db26d97d-host-slash\") pod \"iptables-alerter-jpfzk\" (UID: \"945fc519-0461-4a8e-a94f-5ce5db26d97d\") " pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759380    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-device-dir\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-etc-selinux\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-sys-fs\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-etc-selinux\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-var-lib-kubelet\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ksmb\" (UniqueName: \"kubernetes.io/projected/3a769686-904f-4c18-9432-4312baa4cec6-kube-api-access-6ksmb\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa2641fc-b98a-40a4-a4c2-c8b3011b7377-tmp-dir\") pod \"node-resolver-44g5s\" (UID: \"aa2641fc-b98a-40a4-a4c2-c8b3011b7377\") " pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-var-lib-kubelet\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae5f2f1e-83b8-4f95-b567-4dca37380e26-lib-modules\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a769686-904f-4c18-9432-4312baa4cec6-sys-fs\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.760028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.759808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa2641fc-b98a-40a4-a4c2-c8b3011b7377-tmp-dir\") pod \"node-resolver-44g5s\" (UID: \"aa2641fc-b98a-40a4-a4c2-c8b3011b7377\") " pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.760869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.760462    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/945fc519-0461-4a8e-a94f-5ce5db26d97d-iptables-alerter-script\") pod \"iptables-alerter-jpfzk\" (UID: \"945fc519-0461-4a8e-a94f-5ce5db26d97d\") " pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.762715 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.762693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae5f2f1e-83b8-4f95-b567-4dca37380e26-etc-tuned\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.764580 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.764549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae5f2f1e-83b8-4f95-b567-4dca37380e26-tmp\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.771273 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.771202    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg999\" (UniqueName: \"kubernetes.io/projected/ae5f2f1e-83b8-4f95-b567-4dca37380e26-kube-api-access-wg999\") pod \"tuned-gdf8m\" (UID: \"ae5f2f1e-83b8-4f95-b567-4dca37380e26\") " pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.771679 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.771653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2ls8\" (UniqueName: \"kubernetes.io/projected/aa2641fc-b98a-40a4-a4c2-c8b3011b7377-kube-api-access-s2ls8\") pod \"node-resolver-44g5s\" (UID: \"aa2641fc-b98a-40a4-a4c2-c8b3011b7377\") " pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.772086 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.772062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x682\" (UniqueName: \"kubernetes.io/projected/418cbc40-4789-4ca8-b465-6abeeacf0c11-kube-api-access-5x682\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:26.772751 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.772726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ksmb\" (UniqueName: \"kubernetes.io/projected/3a769686-904f-4c18-9432-4312baa4cec6-kube-api-access-6ksmb\") pod \"aws-ebs-csi-driver-node-l9pp5\" (UID: \"3a769686-904f-4c18-9432-4312baa4cec6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.772835 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.772762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xm97\" (UniqueName: \"kubernetes.io/projected/945fc519-0461-4a8e-a94f-5ce5db26d97d-kube-api-access-9xm97\") pod \"iptables-alerter-jpfzk\" (UID: \"945fc519-0461-4a8e-a94f-5ce5db26d97d\") " pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.857778 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.857742    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mhngd"
Jul 18 01:48:26.877569 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.877535    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gdf8m"
Jul 18 01:48:26.892444 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.892423    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9ql7m"
Jul 18 01:48:26.897492 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.897470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cvs5l"
Jul 18 01:48:26.904278 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.904255    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:26.913206 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.913184    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:26.920915 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.920898    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5"
Jul 18 01:48:26.928975 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.928957    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-44g5s"
Jul 18 01:48:26.934942 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.934920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jpfzk"
Jul 18 01:48:26.936557 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:26.936536    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:48:27.162971 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:27.162871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:27.163117 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:27.162997    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:27.163117 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:27.163069    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret podName:6b8627d7-e095-4a0e-a025-3a6f488d3bdc nodeName:}" failed. No retries permitted until 2026-07-18 01:48:28.163052433 +0000 UTC m=+3.965296875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret") pod "global-pull-secret-syncer-5wzcl" (UID: "6b8627d7-e095-4a0e-a025-3a6f488d3bdc") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:27.263572 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:27.263529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:27.263738 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:27.263587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwmm\" (UniqueName: \"kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm\") pod \"network-check-target-nw226\" (UID: \"8f77203a-02f4-49ad-9123-7eda0c6c8091\") " pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:27.263738 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:27.263681    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:27.263863 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:27.263741    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:27.263863 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:27.263759    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:27.263863 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:27.263770    2560 projected.go:196] Error preparing data for projected volume kube-api-access-ctwmm for pod openshift-network-diagnostics/network-check-target-nw226: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:27.263863 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:27.263759    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs podName:418cbc40-4789-4ca8-b465-6abeeacf0c11 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:28.263735879 +0000 UTC m=+4.065980317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs") pod "network-metrics-daemon-8csvn" (UID: "418cbc40-4789-4ca8-b465-6abeeacf0c11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:27.263863 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:27.263822    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm podName:8f77203a-02f4-49ad-9123-7eda0c6c8091 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:28.263808653 +0000 UTC m=+4.066053094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctwmm" (UniqueName: "kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm") pod "network-check-target-nw226" (UID: "8f77203a-02f4-49ad-9123-7eda0c6c8091") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:27.591566 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:27.591530    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 01:43:26 +0000 UTC" deadline="2028-03-02 00:17:03.1661699 +0000 UTC"
Jul 18 01:48:27.591566 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:27.591557    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14230h28m35.574616433s"
Jul 18 01:48:27.740512 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:27.740484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:27.740685 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:27.740659    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:27.754307 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:27.754273    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd178fdd8_e4a8_4251_bd75_2de893a6994c.slice/crio-b63a7703851384f87de024bc148b9ad504d7db95c52f90e93fd810b9e18af377 WatchSource:0}: Error finding container b63a7703851384f87de024bc148b9ad504d7db95c52f90e93fd810b9e18af377: Status 404 returned error can't find the container with id b63a7703851384f87de024bc148b9ad504d7db95c52f90e93fd810b9e18af377
Jul 18 01:48:27.757452 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:27.756450    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e96af37_6c7d_4bde_9a5b_ccd31c2c18bc.slice/crio-a2e2883281e8449ff9e5c962bdad9e748dabd1d8481094b0ec7f2d2e8c06235c WatchSource:0}: Error finding container a2e2883281e8449ff9e5c962bdad9e748dabd1d8481094b0ec7f2d2e8c06235c: Status 404 returned error can't find the container with id a2e2883281e8449ff9e5c962bdad9e748dabd1d8481094b0ec7f2d2e8c06235c
Jul 18 01:48:27.763462 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:27.763051    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a769686_904f_4c18_9432_4312baa4cec6.slice/crio-da276d4b3bd773a2e586eff0aef11e01993507437e2416fee725aa4eeab0705c WatchSource:0}: Error finding container da276d4b3bd773a2e586eff0aef11e01993507437e2416fee725aa4eeab0705c: Status 404 returned error can't find the container with id da276d4b3bd773a2e586eff0aef11e01993507437e2416fee725aa4eeab0705c
Jul 18 01:48:27.764127 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:27.764104    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945fc519_0461_4a8e_a94f_5ce5db26d97d.slice/crio-f784272a02d2cf41d55b88b7204f53aedc02cce2734ec06ccad0037ec1d0872e WatchSource:0}: Error finding container f784272a02d2cf41d55b88b7204f53aedc02cce2734ec06ccad0037ec1d0872e: Status 404 returned error can't find the container with id f784272a02d2cf41d55b88b7204f53aedc02cce2734ec06ccad0037ec1d0872e
Jul 18 01:48:27.765255 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:27.765231    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5f2f1e_83b8_4f95_b567_4dca37380e26.slice/crio-baee655b83caa2e9c8cee88555c58f32e27859f0161f77fca1c5ab156cb35f43 WatchSource:0}: Error finding container baee655b83caa2e9c8cee88555c58f32e27859f0161f77fca1c5ab156cb35f43: Status 404 returned error can't find the container with id baee655b83caa2e9c8cee88555c58f32e27859f0161f77fca1c5ab156cb35f43
Jul 18 01:48:27.766134 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:27.766097    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58fe661b_1a1e_4afc_8721_4b124aad547c.slice/crio-4c71044df826e78498625d31ab1078116a53868eb5f1c69d853871a71b54535a WatchSource:0}: Error finding container 4c71044df826e78498625d31ab1078116a53868eb5f1c69d853871a71b54535a: Status 404 returned error can't find the container with id 4c71044df826e78498625d31ab1078116a53868eb5f1c69d853871a71b54535a
Jul 18 01:48:27.767039 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:48:27.767020    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcacba113_1053_4df9_b5fe_954e50d6bb34.slice/crio-060689c4683f8b817e452180ee2013f37423033734dbf3445bdd3364fcd9de3d WatchSource:0}: Error finding container 060689c4683f8b817e452180ee2013f37423033734dbf3445bdd3364fcd9de3d: Status 404 returned error can't find the container with id 060689c4683f8b817e452180ee2013f37423033734dbf3445bdd3364fcd9de3d
Jul 18 01:48:28.171906 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.171632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:28.172108 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:28.171886    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:28.172108 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:28.172006    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret podName:6b8627d7-e095-4a0e-a025-3a6f488d3bdc nodeName:}" failed. No retries permitted until 2026-07-18 01:48:30.171980087 +0000 UTC m=+5.974224528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret") pod "global-pull-secret-syncer-5wzcl" (UID: "6b8627d7-e095-4a0e-a025-3a6f488d3bdc") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:28.274364 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.273392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwmm\" (UniqueName: \"kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm\") pod \"network-check-target-nw226\" (UID: \"8f77203a-02f4-49ad-9123-7eda0c6c8091\") " pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:28.274364 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.273495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:28.274364 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:28.273630    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:28.274364 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:28.273699    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs podName:418cbc40-4789-4ca8-b465-6abeeacf0c11 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:30.273678209 +0000 UTC m=+6.075922667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs") pod "network-metrics-daemon-8csvn" (UID: "418cbc40-4789-4ca8-b465-6abeeacf0c11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:28.274364 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:28.274181    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:28.274364 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:28.274207    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:28.274364 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:28.274221    2560 projected.go:196] Error preparing data for projected volume kube-api-access-ctwmm for pod openshift-network-diagnostics/network-check-target-nw226: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:28.274364 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:28.274273    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm podName:8f77203a-02f4-49ad-9123-7eda0c6c8091 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:30.274256118 +0000 UTC m=+6.076500557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctwmm" (UniqueName: "kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm") pod "network-check-target-nw226" (UID: "8f77203a-02f4-49ad-9123-7eda0c6c8091") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:28.592633 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.592478    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 01:43:26 +0000 UTC" deadline="2028-01-11 05:01:27.563728694 +0000 UTC"
Jul 18 01:48:28.592633 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.592540    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13011h12m58.971193135s"
Jul 18 01:48:28.742071 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.742029    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:28.742268 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:28.742167    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:28.742620 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.742593    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:28.742726 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:28.742699    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:28.778532 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.778493    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-44g5s" event={"ID":"aa2641fc-b98a-40a4-a4c2-c8b3011b7377","Type":"ContainerStarted","Data":"3d264b0fb330c261807fa6db5ee435b3eb8ea348a1c11e6c5d885b706660d9bd"}
Jul 18 01:48:28.784781 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.784744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" event={"ID":"58fe661b-1a1e-4afc-8721-4b124aad547c","Type":"ContainerStarted","Data":"4c71044df826e78498625d31ab1078116a53868eb5f1c69d853871a71b54535a"}
Jul 18 01:48:28.787459 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.787418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jpfzk" event={"ID":"945fc519-0461-4a8e-a94f-5ce5db26d97d","Type":"ContainerStarted","Data":"f784272a02d2cf41d55b88b7204f53aedc02cce2734ec06ccad0037ec1d0872e"}
Jul 18 01:48:28.790057 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.790006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5" event={"ID":"3a769686-904f-4c18-9432-4312baa4cec6","Type":"ContainerStarted","Data":"da276d4b3bd773a2e586eff0aef11e01993507437e2416fee725aa4eeab0705c"}
Jul 18 01:48:28.800439 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.799376    2560 generic.go:356] "Generic (PLEG): container finished" podID="a885deaa6d8704209113b7204e1dc8e8" containerID="5b7b38e460282df4475d33c5e5b0353d67d79880da786fc7efcb9111b3e7cd91" exitCode=0
Jul 18 01:48:28.800439 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.800226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" event={"ID":"a885deaa6d8704209113b7204e1dc8e8","Type":"ContainerDied","Data":"5b7b38e460282df4475d33c5e5b0353d67d79880da786fc7efcb9111b3e7cd91"}
Jul 18 01:48:28.816510 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.816483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" event={"ID":"a916a73ea0727afb0c62c6111b95f497","Type":"ContainerStarted","Data":"0a23f748a22f193d204b4718545ce466a3df02e8a2c4ce8c476f8de82daa726f"}
Jul 18 01:48:28.821436 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.821391    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gdf8m" event={"ID":"ae5f2f1e-83b8-4f95-b567-4dca37380e26","Type":"ContainerStarted","Data":"baee655b83caa2e9c8cee88555c58f32e27859f0161f77fca1c5ab156cb35f43"}
Jul 18 01:48:28.830993 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.830942    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" podStartSLOduration=3.830923812 podStartE2EDuration="3.830923812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:28.830508023 +0000 UTC m=+4.632752486" watchObservedRunningTime="2026-07-18 01:48:28.830923812 +0000 UTC m=+4.633168275"
Jul 18 01:48:28.835373 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.835296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zg85n" event={"ID":"5617181b-0119-4bd1-b5cb-25f0ab09ce41","Type":"ContainerStarted","Data":"b065e0d3c2272e6bdb0187bf06c451399cfff9266286b9997467f84d37090adb"}
Jul 18 01:48:28.837834 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.837755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mhngd" event={"ID":"cacba113-1053-4df9-b5fe-954e50d6bb34","Type":"ContainerStarted","Data":"060689c4683f8b817e452180ee2013f37423033734dbf3445bdd3364fcd9de3d"}
Jul 18 01:48:28.850880 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.850821    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9ql7m" event={"ID":"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc","Type":"ContainerStarted","Data":"a2e2883281e8449ff9e5c962bdad9e748dabd1d8481094b0ec7f2d2e8c06235c"}
Jul 18 01:48:28.868378 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:28.868278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cvs5l" event={"ID":"d178fdd8-e4a8-4251-bd75-2de893a6994c","Type":"ContainerStarted","Data":"b63a7703851384f87de024bc148b9ad504d7db95c52f90e93fd810b9e18af377"}
Jul 18 01:48:29.740043 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:29.739897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:29.740544 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:29.740042    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:29.903410 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:29.903375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" event={"ID":"a885deaa6d8704209113b7204e1dc8e8","Type":"ContainerStarted","Data":"d46252103d0fff8d5e7d88b0ec8058dd8d60b53964f9af8c11e41fc544615627"}
Jul 18 01:48:30.191382 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:30.188972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:30.191382 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:30.189074    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:30.191382 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:30.189120    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret podName:6b8627d7-e095-4a0e-a025-3a6f488d3bdc nodeName:}" failed. No retries permitted until 2026-07-18 01:48:34.189107321 +0000 UTC m=+9.991351756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret") pod "global-pull-secret-syncer-5wzcl" (UID: "6b8627d7-e095-4a0e-a025-3a6f488d3bdc") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:30.289947 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:30.289911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwmm\" (UniqueName: \"kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm\") pod \"network-check-target-nw226\" (UID: \"8f77203a-02f4-49ad-9123-7eda0c6c8091\") " pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:30.290105 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:30.290000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:30.290162 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:30.290124    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:30.290221 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:30.290184    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs podName:418cbc40-4789-4ca8-b465-6abeeacf0c11 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:34.29016634 +0000 UTC m=+10.092410779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs") pod "network-metrics-daemon-8csvn" (UID: "418cbc40-4789-4ca8-b465-6abeeacf0c11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:30.290634 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:30.290610    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:30.290747 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:30.290641    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:30.290747 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:30.290653    2560 projected.go:196] Error preparing data for projected volume kube-api-access-ctwmm for pod openshift-network-diagnostics/network-check-target-nw226: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:30.290747 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:30.290701    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm podName:8f77203a-02f4-49ad-9123-7eda0c6c8091 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:34.290685907 +0000 UTC m=+10.092930359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctwmm" (UniqueName: "kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm") pod "network-check-target-nw226" (UID: "8f77203a-02f4-49ad-9123-7eda0c6c8091") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:30.740894 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:30.740432    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:30.740894 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:30.740443    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:30.740894 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:30.740558    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:30.740894 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:30.740625    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:31.739489 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:31.739454    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:31.739665 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:31.739582    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:32.740448 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:32.740417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:32.740898 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:32.740551    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:32.740898 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:32.740617    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:32.740898 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:32.740700    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:33.740047 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:33.740012    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:33.740306 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:33.740157    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:34.225922 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:34.225886    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:34.230410 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:34.229507    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:34.230410 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:34.229613    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret podName:6b8627d7-e095-4a0e-a025-3a6f488d3bdc nodeName:}" failed. No retries permitted until 2026-07-18 01:48:42.229589311 +0000 UTC m=+18.031833752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret") pod "global-pull-secret-syncer-5wzcl" (UID: "6b8627d7-e095-4a0e-a025-3a6f488d3bdc") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:34.326988 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:34.326950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:34.327146 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:34.327013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwmm\" (UniqueName: \"kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm\") pod \"network-check-target-nw226\" (UID: \"8f77203a-02f4-49ad-9123-7eda0c6c8091\") " pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:34.327146 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:34.327121    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:34.327220 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:34.327176    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:34.327220 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:34.327205    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:34.327220 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:34.327218    2560 projected.go:196] Error preparing data for projected volume kube-api-access-ctwmm for pod openshift-network-diagnostics/network-check-target-nw226: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:34.327363 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:34.327185    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs podName:418cbc40-4789-4ca8-b465-6abeeacf0c11 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:42.327170832 +0000 UTC m=+18.129415270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs") pod "network-metrics-daemon-8csvn" (UID: "418cbc40-4789-4ca8-b465-6abeeacf0c11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:34.327363 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:34.327273    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm podName:8f77203a-02f4-49ad-9123-7eda0c6c8091 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:42.327258754 +0000 UTC m=+18.129503189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctwmm" (UniqueName: "kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm") pod "network-check-target-nw226" (UID: "8f77203a-02f4-49ad-9123-7eda0c6c8091") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:34.741118 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:34.740676    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:34.741118 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:34.740778    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:34.741118 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:34.740861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:34.741118 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:34.740989    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:35.740650 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:35.740124    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:35.740650 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:35.740250    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:36.741811 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:36.741778    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:36.742241 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:36.741895    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:36.742241 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:36.742194    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:36.742409 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:36.742268    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:37.740088 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:37.740052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:37.740248 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:37.740177    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:38.739789 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:38.739705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:38.740233 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:38.739846    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:38.740233 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:38.740142    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:38.740378 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:38.740243    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:39.739756 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:39.739715    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:39.739924 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:39.739873    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:40.740945 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:40.740426    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:40.740945 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:40.740466    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:40.740945 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:40.740564    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:40.740945 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:40.740669    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:41.740177 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:41.740137    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:41.740438 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:41.740279    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:42.289747 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:42.289712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:42.290182 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:42.289834    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:42.290182 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:42.289889    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret podName:6b8627d7-e095-4a0e-a025-3a6f488d3bdc nodeName:}" failed. No retries permitted until 2026-07-18 01:48:58.28987588 +0000 UTC m=+34.092120315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret") pod "global-pull-secret-syncer-5wzcl" (UID: "6b8627d7-e095-4a0e-a025-3a6f488d3bdc") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:42.390193 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:42.390158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:42.390452 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:42.390204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwmm\" (UniqueName: \"kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm\") pod \"network-check-target-nw226\" (UID: \"8f77203a-02f4-49ad-9123-7eda0c6c8091\") " pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:42.390452 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:42.390334    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:42.390452 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:42.390355    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:42.390452 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:42.390371    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:42.390452 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:42.390384    2560 projected.go:196] Error preparing data for projected volume kube-api-access-ctwmm for pod openshift-network-diagnostics/network-check-target-nw226: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:42.390452 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:42.390407    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs podName:418cbc40-4789-4ca8-b465-6abeeacf0c11 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:58.390389381 +0000 UTC m=+34.192633816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs") pod "network-metrics-daemon-8csvn" (UID: "418cbc40-4789-4ca8-b465-6abeeacf0c11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:42.390452 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:42.390426    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm podName:8f77203a-02f4-49ad-9123-7eda0c6c8091 nodeName:}" failed. No retries permitted until 2026-07-18 01:48:58.39041707 +0000 UTC m=+34.192661506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctwmm" (UniqueName: "kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm") pod "network-check-target-nw226" (UID: "8f77203a-02f4-49ad-9123-7eda0c6c8091") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:42.740027 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:42.739951    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:42.740172 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:42.739950    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:42.740172 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:42.740089    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:42.740278 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:42.740199    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:43.739375 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:43.739340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:43.739816 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:43.739483    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:44.740957 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:44.740916    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:44.741438 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:44.741051    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:44.741546 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:44.741479    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:44.741615 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:44.741591    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:45.740239 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:45.740201    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:45.740446 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:45.740370    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:46.740875 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.740673    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:46.741220 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:46.741025    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:46.741220 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.741140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:46.741220 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:46.741199    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:46.938224 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.938195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-44g5s" event={"ID":"aa2641fc-b98a-40a4-a4c2-c8b3011b7377","Type":"ContainerStarted","Data":"52ffdf5296e3b6c11cffc3ec5a6dcd4ada11bf313345da93f98428b78d673096"}
Jul 18 01:48:46.940054 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.940034    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 01:48:46.940411 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.940380    2560 generic.go:356] "Generic (PLEG): container finished" podID="58fe661b-1a1e-4afc-8721-4b124aad547c" containerID="1127dfd225395c7bb22c4d29674f28268b5c863c54218b70cd36a6c2478a9a02" exitCode=1
Jul 18 01:48:46.940489 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.940441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" event={"ID":"58fe661b-1a1e-4afc-8721-4b124aad547c","Type":"ContainerDied","Data":"1127dfd225395c7bb22c4d29674f28268b5c863c54218b70cd36a6c2478a9a02"}
Jul 18 01:48:46.940540 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.940528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" event={"ID":"58fe661b-1a1e-4afc-8721-4b124aad547c","Type":"ContainerStarted","Data":"e7dc6c17aa3165c098b52c21840f2cca504ab4be50435b416ecb54b7eadb7d12"}
Jul 18 01:48:46.942148 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.942123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5" event={"ID":"3a769686-904f-4c18-9432-4312baa4cec6","Type":"ContainerStarted","Data":"4888f347e91affdc2af4cc941dd3559078886d7d23dbfa9e07c7071876af6d1c"}
Jul 18 01:48:46.943753 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.943733    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gdf8m" event={"ID":"ae5f2f1e-83b8-4f95-b567-4dca37380e26","Type":"ContainerStarted","Data":"481aee2444cd92eb33ac8fbc1b431de6927b3e757f0572cd9d1f9f806f474625"}
Jul 18 01:48:46.945465 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.945443    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zg85n" event={"ID":"5617181b-0119-4bd1-b5cb-25f0ab09ce41","Type":"ContainerStarted","Data":"caf604fdaaa08eefaccfc8c1c0d15a598cb59063bf1a83d62a4a941421cc9a5d"}
Jul 18 01:48:46.946987 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.946965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mhngd" event={"ID":"cacba113-1053-4df9-b5fe-954e50d6bb34","Type":"ContainerStarted","Data":"1cf6194fe878445b79bf8c2e0b58aa02f17e445e80b70c8ffccaffae5b75992c"}
Jul 18 01:48:46.948706 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.948687    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9ql7m" event={"ID":"4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc","Type":"ContainerStarted","Data":"9141fa83bb5e5727830e877addfc80e922045a8deca17c12c7d875639ca409a8"}
Jul 18 01:48:46.950148 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.950122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cvs5l" event={"ID":"d178fdd8-e4a8-4251-bd75-2de893a6994c","Type":"ContainerStarted","Data":"25f679f42a06ddce9c31ae4afdb858d6c5391aa38d3120929f5ad08b36c9fa79"}
Jul 18 01:48:46.963515 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.963466    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" podStartSLOduration=21.963453413 podStartE2EDuration="21.963453413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:29.918848028 +0000 UTC m=+5.721092486" watchObservedRunningTime="2026-07-18 01:48:46.963453413 +0000 UTC m=+22.765697870"
Jul 18 01:48:46.963922 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.963875    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-44g5s" podStartSLOduration=3.176037739 podStartE2EDuration="21.963868653s" totalImagesPullingTime="18.787830914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:46.963139171 +0000 UTC m=+22.765383629" watchObservedRunningTime="2026-07-18 01:48:46.963868653 +0000 UTC m=+22.766113110"
Jul 18 01:48:46.994027 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:46.993968    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9ql7m" podStartSLOduration=3.117470961 podStartE2EDuration="21.993949562s" totalImagesPullingTime="18.876478601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:46.992352737 +0000 UTC m=+22.794597191" watchObservedRunningTime="2026-07-18 01:48:46.993949562 +0000 UTC m=+22.796194023"
Jul 18 01:48:47.012692 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.012581    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zg85n" podStartSLOduration=7.303468307 podStartE2EDuration="22.012456141s" totalImagesPullingTime="14.708987834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:47.011544198 +0000 UTC m=+22.813788645" watchObservedRunningTime="2026-07-18 01:48:47.012456141 +0000 UTC m=+22.814700601"
Jul 18 01:48:47.031647 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.031422    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gdf8m" podStartSLOduration=3.220318272 podStartE2EDuration="22.031400762s" totalImagesPullingTime="18.81108249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:47.030810426 +0000 UTC m=+22.833054882" watchObservedRunningTime="2026-07-18 01:48:47.031400762 +0000 UTC m=+22.833645221"
Jul 18 01:48:47.052367 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.052312    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mhngd" podStartSLOduration=4.247473173 podStartE2EDuration="23.052298187s" totalImagesPullingTime="18.804825014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:47.051221117 +0000 UTC m=+22.853465573" watchObservedRunningTime="2026-07-18 01:48:47.052298187 +0000 UTC m=+22.854542644"
Jul 18 01:48:47.186585 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.186455    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:47.186930 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.186913    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:47.739904 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.739875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:47.740111 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:47.740018    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:47.954400 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.954369    2560 generic.go:356] "Generic (PLEG): container finished" podID="d178fdd8-e4a8-4251-bd75-2de893a6994c" containerID="25f679f42a06ddce9c31ae4afdb858d6c5391aa38d3120929f5ad08b36c9fa79" exitCode=0
Jul 18 01:48:47.955109 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.954458    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cvs5l" event={"ID":"d178fdd8-e4a8-4251-bd75-2de893a6994c","Type":"ContainerDied","Data":"25f679f42a06ddce9c31ae4afdb858d6c5391aa38d3120929f5ad08b36c9fa79"}
Jul 18 01:48:47.963706 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.963685    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 01:48:47.964502 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.964285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" event={"ID":"58fe661b-1a1e-4afc-8721-4b124aad547c","Type":"ContainerStarted","Data":"9e6dcddc5e4c5547c388a0205d2eb9ab91be1f2785a72d8a682bec192a94bc91"}
Jul 18 01:48:47.964502 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.964387    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" event={"ID":"58fe661b-1a1e-4afc-8721-4b124aad547c","Type":"ContainerStarted","Data":"5ec8df9cb98b2c1e29068825f1fd6ee857c16ba80afe1ca3ae2c753924dd2825"}
Jul 18 01:48:47.964502 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.964437    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" event={"ID":"58fe661b-1a1e-4afc-8721-4b124aad547c","Type":"ContainerStarted","Data":"b89db94e561435b2ad0718289afba2ddf22b39b6576e6c15aeeca65477348974"}
Jul 18 01:48:47.964502 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.964484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" event={"ID":"58fe661b-1a1e-4afc-8721-4b124aad547c","Type":"ContainerStarted","Data":"7c961d1f7a93e2c771b5d54d1f54c5b997cd9026fad04248a44801e8bafea1e7"}
Jul 18 01:48:47.965377 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.965355    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:47.965918 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:47.965900    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zg85n"
Jul 18 01:48:48.106483 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:48.106455    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 18 01:48:48.621298 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:48.621201    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T01:48:48.106474636Z","UUID":"918ce740-eb2a-44d9-886a-78ca96cb9590","Handler":null,"Name":"","Endpoint":""}
Jul 18 01:48:48.623544 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:48.623517    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 18 01:48:48.623693 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:48.623565    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 18 01:48:48.739443 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:48.739413    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:48.739587 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:48.739413    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:48.739587 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:48.739538    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:48.739710 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:48.739653    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:48.968858 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:48.968776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jpfzk" event={"ID":"945fc519-0461-4a8e-a94f-5ce5db26d97d","Type":"ContainerStarted","Data":"5eda0176f99f8295094f00786d45d3afdc805364ca14b7e7cf6da0864bba50a9"}
Jul 18 01:48:48.970784 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:48.970746    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5" event={"ID":"3a769686-904f-4c18-9432-4312baa4cec6","Type":"ContainerStarted","Data":"d452928cd6c88331ec36cb51ebf6691d6b463f72f5c97b4506450f0a820ba9e0"}
Jul 18 01:48:48.985592 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:48.985543    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jpfzk" podStartSLOduration=5.189720787 podStartE2EDuration="23.985522785s" totalImagesPullingTime="18.795801998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:48.98517426 +0000 UTC m=+24.787418718" watchObservedRunningTime="2026-07-18 01:48:48.985522785 +0000 UTC m=+24.787767242"
Jul 18 01:48:49.739382 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:49.739304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:49.739531 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:49.739452    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:49.976843 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:49.976813    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 01:48:49.977266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:49.977237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" event={"ID":"58fe661b-1a1e-4afc-8721-4b124aad547c","Type":"ContainerStarted","Data":"6d92f5979bd0105822a7ff9956515a08daf1e999c28b139a197166328da5a620"}
Jul 18 01:48:49.979578 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:49.979551    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5" event={"ID":"3a769686-904f-4c18-9432-4312baa4cec6","Type":"ContainerStarted","Data":"01130e32a34a1473b62af86ff09a1e655e814276f82f6ea5dac5988b5ec02517"}
Jul 18 01:48:49.999598 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:49.999519    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l9pp5" podStartSLOduration=4.057828996 podStartE2EDuration="24.999505235s" totalImagesPullingTime="20.941676239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:49.998003571 +0000 UTC m=+25.800248030" watchObservedRunningTime="2026-07-18 01:48:49.999505235 +0000 UTC m=+25.801749693"
Jul 18 01:48:50.740264 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:50.740020    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:50.740434 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:50.740087    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:50.740434 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:50.740396    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:50.740553 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:50.740458    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:51.739824 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:51.739611    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:51.740566 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:51.739878    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:51.985103 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:51.985070    2560 generic.go:356] "Generic (PLEG): container finished" podID="d178fdd8-e4a8-4251-bd75-2de893a6994c" containerID="c423ef0de40ce21168fbf553181e649458daaf7fb7ad8e51e71377655d94b50f" exitCode=0
Jul 18 01:48:51.985252 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:51.985155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cvs5l" event={"ID":"d178fdd8-e4a8-4251-bd75-2de893a6994c","Type":"ContainerDied","Data":"c423ef0de40ce21168fbf553181e649458daaf7fb7ad8e51e71377655d94b50f"}
Jul 18 01:48:51.989055 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:51.989036    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 01:48:51.989423 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:51.989401    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" event={"ID":"58fe661b-1a1e-4afc-8721-4b124aad547c","Type":"ContainerStarted","Data":"638595260b81c7a197878ed23c4e2348312439499396dd71e307d92b24400be0"}
Jul 18 01:48:51.989667 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:51.989644    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:51.989746 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:51.989701    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:51.989937 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:51.989869    2560 scope.go:117] "RemoveContainer" containerID="1127dfd225395c7bb22c4d29674f28268b5c863c54218b70cd36a6c2478a9a02"
Jul 18 01:48:52.007793 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:52.007773    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:52.008758 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:52.008737    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:52.741432 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:52.740487    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:52.741432 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:52.740620    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:52.741432 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:52.741192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:52.741432 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:52.741303    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:52.997588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:52.997508    2560 generic.go:356] "Generic (PLEG): container finished" podID="d178fdd8-e4a8-4251-bd75-2de893a6994c" containerID="525641b86dacc30eb838f8bbb51024f54b74db1cc42c5bd59e5840bd1bc27d5e" exitCode=0
Jul 18 01:48:52.997588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:52.997575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cvs5l" event={"ID":"d178fdd8-e4a8-4251-bd75-2de893a6994c","Type":"ContainerDied","Data":"525641b86dacc30eb838f8bbb51024f54b74db1cc42c5bd59e5840bd1bc27d5e"}
Jul 18 01:48:53.001528 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:53.001512    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 01:48:53.001892 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:53.001866    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" event={"ID":"58fe661b-1a1e-4afc-8721-4b124aad547c","Type":"ContainerStarted","Data":"e216d3db44bd5c8fd6f15e41d5a140bd19a37e4db4707f07596b5c36e535e670"}
Jul 18 01:48:53.001972 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:53.001958    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 18 01:48:53.043535 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:53.043492    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk" podStartSLOduration=9.193171454 podStartE2EDuration="28.043478009s" totalImagesPullingTime="18.850306555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:53.041838529 +0000 UTC m=+28.844082996" watchObservedRunningTime="2026-07-18 01:48:53.043478009 +0000 UTC m=+28.845722466"
Jul 18 01:48:53.441205 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:53.441172    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nw226"]
Jul 18 01:48:53.441386 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:53.441307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:53.441444 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:53.441421    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:53.444359 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:53.444313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5wzcl"]
Jul 18 01:48:53.444502 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:53.444451    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:53.444574 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:53.444554    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:53.445253 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:53.445224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8csvn"]
Jul 18 01:48:53.445384 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:53.445367    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:53.445509 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:53.445475    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:54.009409 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:54.009206    2560 generic.go:356] "Generic (PLEG): container finished" podID="d178fdd8-e4a8-4251-bd75-2de893a6994c" containerID="00f99d9f467b574b7ba123ab288ff380b02fcc3f902868f50810c67c4c2024c6" exitCode=0
Jul 18 01:48:54.009409 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:54.009251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cvs5l" event={"ID":"d178fdd8-e4a8-4251-bd75-2de893a6994c","Type":"ContainerDied","Data":"00f99d9f467b574b7ba123ab288ff380b02fcc3f902868f50810c67c4c2024c6"}
Jul 18 01:48:54.009831 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:54.009578    2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 18 01:48:54.740758 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:54.740717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:54.740970 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:54.740835    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:54.741179 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:54.741134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:54.741313 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:54.741290    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:55.739865 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:55.739828    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:55.740614 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:55.739971    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:55.810195 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:55.810160    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:48:56.739686 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:56.739652    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:56.739867 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:56.739657    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:56.739867 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:56.739794    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:56.740478 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:56.739858    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:57.739473 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:57.739438    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:57.739658 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:57.739577    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nw226" podUID="8f77203a-02f4-49ad-9123-7eda0c6c8091"
Jul 18 01:48:58.304944 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:58.304911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:58.305385 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:58.305055    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:58.305385 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:58.305113    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret podName:6b8627d7-e095-4a0e-a025-3a6f488d3bdc nodeName:}" failed. No retries permitted until 2026-07-18 01:49:30.305099037 +0000 UTC m=+66.107343472 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret") pod "global-pull-secret-syncer-5wzcl" (UID: "6b8627d7-e095-4a0e-a025-3a6f488d3bdc") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:58.405969 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:58.405935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:58.406156 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:58.405985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwmm\" (UniqueName: \"kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm\") pod \"network-check-target-nw226\" (UID: \"8f77203a-02f4-49ad-9123-7eda0c6c8091\") " pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:58.406156 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:58.406088    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:58.406156 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:58.406095    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:58.406314 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:58.406167    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs podName:418cbc40-4789-4ca8-b465-6abeeacf0c11 nodeName:}" failed. No retries permitted until 2026-07-18 01:49:30.406145638 +0000 UTC m=+66.208390079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs") pod "network-metrics-daemon-8csvn" (UID: "418cbc40-4789-4ca8-b465-6abeeacf0c11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:58.406314 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:58.406100    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:58.406314 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:58.406196    2560 projected.go:196] Error preparing data for projected volume kube-api-access-ctwmm for pod openshift-network-diagnostics/network-check-target-nw226: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:58.406314 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:58.406234    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm podName:8f77203a-02f4-49ad-9123-7eda0c6c8091 nodeName:}" failed. No retries permitted until 2026-07-18 01:49:30.406223862 +0000 UTC m=+66.208468297 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctwmm" (UniqueName: "kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm") pod "network-check-target-nw226" (UID: "8f77203a-02f4-49ad-9123-7eda0c6c8091") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:58.739672 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:58.739639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:48:58.739858 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:58.739787    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8csvn" podUID="418cbc40-4789-4ca8-b465-6abeeacf0c11"
Jul 18 01:48:58.739858 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:58.739841    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:48:58.739981 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:58.739958    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5wzcl" podUID="6b8627d7-e095-4a0e-a025-3a6f488d3bdc"
Jul 18 01:48:59.024605 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.024567    2560 generic.go:356] "Generic (PLEG): container finished" podID="d178fdd8-e4a8-4251-bd75-2de893a6994c" containerID="1e19c00c1739c0512807bbc1a641c8281cf57f57f37b145453b7ad3261e31b3a" exitCode=0
Jul 18 01:48:59.024767 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.024632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cvs5l" event={"ID":"d178fdd8-e4a8-4251-bd75-2de893a6994c","Type":"ContainerDied","Data":"1e19c00c1739c0512807bbc1a641c8281cf57f57f37b145453b7ad3261e31b3a"}
Jul 18 01:48:59.489285 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.489221    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeReady"
Jul 18 01:48:59.489806 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.489348    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 18 01:48:59.562149 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.562118    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gwhfr"]
Jul 18 01:48:59.582416 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.582396    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t5zbz"]
Jul 18 01:48:59.582521 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.582497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.598677 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.598657    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gwhfr"]
Jul 18 01:48:59.598790 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.598705    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t5zbz"]
Jul 18 01:48:59.598790 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.598773    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t5zbz"
Jul 18 01:48:59.602742 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.602723    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s6gqx\""
Jul 18 01:48:59.603607 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.603591    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 18 01:48:59.603721 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.603594    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 18 01:48:59.605816 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.605790    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 18 01:48:59.605932 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.605856    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4j2w9\""
Jul 18 01:48:59.608315 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.605799    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 18 01:48:59.609460 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.609440    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 18 01:48:59.716001 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.715971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e29a00-1353-4740-84df-438e861f1dad-tmp-dir\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.716113 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.716011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.716113 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.716029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brs96\" (UniqueName: \"kubernetes.io/projected/93e29a00-1353-4740-84df-438e861f1dad-kube-api-access-brs96\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.716113 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.716044    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93e29a00-1353-4740-84df-438e861f1dad-config-volume\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.716113 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.716094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wj6g\" (UniqueName: \"kubernetes.io/projected/d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b-kube-api-access-6wj6g\") pod \"ingress-canary-t5zbz\" (UID: \"d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b\") " pod="openshift-ingress-canary/ingress-canary-t5zbz"
Jul 18 01:48:59.716243 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.716129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b-cert\") pod \"ingress-canary-t5zbz\" (UID: \"d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b\") " pod="openshift-ingress-canary/ingress-canary-t5zbz"
Jul 18 01:48:59.740250 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.740203    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:48:59.743103 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.743086    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2rqj2\""
Jul 18 01:48:59.743206 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.743176    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 01:48:59.743259 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.743222    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 01:48:59.817078 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.817058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.817200 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.817084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brs96\" (UniqueName: \"kubernetes.io/projected/93e29a00-1353-4740-84df-438e861f1dad-kube-api-access-brs96\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.817200 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.817099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93e29a00-1353-4740-84df-438e861f1dad-config-volume\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.817200 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.817117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wj6g\" (UniqueName: \"kubernetes.io/projected/d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b-kube-api-access-6wj6g\") pod \"ingress-canary-t5zbz\" (UID: \"d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b\") " pod="openshift-ingress-canary/ingress-canary-t5zbz"
Jul 18 01:48:59.817200 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.817134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b-cert\") pod \"ingress-canary-t5zbz\" (UID: \"d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b\") " pod="openshift-ingress-canary/ingress-canary-t5zbz"
Jul 18 01:48:59.817375 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:59.817231    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:48:59.817375 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:48:59.817287    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls podName:93e29a00-1353-4740-84df-438e861f1dad nodeName:}" failed. No retries permitted until 2026-07-18 01:49:00.3172696 +0000 UTC m=+36.119514052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls") pod "dns-default-gwhfr" (UID: "93e29a00-1353-4740-84df-438e861f1dad") : secret "dns-default-metrics-tls" not found
Jul 18 01:48:59.817375 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.817349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e29a00-1353-4740-84df-438e861f1dad-tmp-dir\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.817666 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.817647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e29a00-1353-4740-84df-438e861f1dad-tmp-dir\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.817734 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.817717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93e29a00-1353-4740-84df-438e861f1dad-config-volume\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.821482 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.821363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b-cert\") pod \"ingress-canary-t5zbz\" (UID: \"d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b\") " pod="openshift-ingress-canary/ingress-canary-t5zbz"
Jul 18 01:48:59.826019 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.826000    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wj6g\" (UniqueName: \"kubernetes.io/projected/d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b-kube-api-access-6wj6g\") pod \"ingress-canary-t5zbz\" (UID: \"d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b\") " pod="openshift-ingress-canary/ingress-canary-t5zbz"
Jul 18 01:48:59.826469 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.826452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brs96\" (UniqueName: \"kubernetes.io/projected/93e29a00-1353-4740-84df-438e861f1dad-kube-api-access-brs96\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:48:59.906352 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:48:59.906315    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t5zbz"
Jul 18 01:49:00.031424 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.030832    2560 generic.go:356] "Generic (PLEG): container finished" podID="d178fdd8-e4a8-4251-bd75-2de893a6994c" containerID="a4985f6d8829a2e593e6aab3194ec97bc3dac581e8c1b8d51a323a2dbec8f7a7" exitCode=0
Jul 18 01:49:00.031424 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.030872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cvs5l" event={"ID":"d178fdd8-e4a8-4251-bd75-2de893a6994c","Type":"ContainerDied","Data":"a4985f6d8829a2e593e6aab3194ec97bc3dac581e8c1b8d51a323a2dbec8f7a7"}
Jul 18 01:49:00.106251 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.106227    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t5zbz"]
Jul 18 01:49:00.110376 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:00.110351    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ff6ba7_1174_46a5_bcb9_5d5e1c2f680b.slice/crio-720e3d6f2101d87906e7ab4473cb5a2b903b6ef51ed764e9ac1c11e98b2bcf57 WatchSource:0}: Error finding container 720e3d6f2101d87906e7ab4473cb5a2b903b6ef51ed764e9ac1c11e98b2bcf57: Status 404 returned error can't find the container with id 720e3d6f2101d87906e7ab4473cb5a2b903b6ef51ed764e9ac1c11e98b2bcf57
Jul 18 01:49:00.260558 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.260531    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zg2gb"]
Jul 18 01:49:00.279917 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.279893    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zg2gb"]
Jul 18 01:49:00.280075 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.279999    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.282682 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.282620    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 18 01:49:00.282682 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.282640    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 18 01:49:00.282860 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.282632    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jz89w\""
Jul 18 01:49:00.283028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.283009    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 18 01:49:00.283028 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.283019    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 18 01:49:00.321593 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.321564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:49:00.321741 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:00.321669    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:49:00.321741 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:00.321719    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls podName:93e29a00-1353-4740-84df-438e861f1dad nodeName:}" failed. No retries permitted until 2026-07-18 01:49:01.321704906 +0000 UTC m=+37.123949340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls") pod "dns-default-gwhfr" (UID: "93e29a00-1353-4740-84df-438e861f1dad") : secret "dns-default-metrics-tls" not found
Jul 18 01:49:00.422043 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.422018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-data-volume\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.422205 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.422069    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.422205 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.422095    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwpfm\" (UniqueName: \"kubernetes.io/projected/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-api-access-hwpfm\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.422205 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.422143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.422205 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.422191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-crio-socket\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.523412 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.523374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.523911 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.523446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-crio-socket\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.523911 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.523489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-data-volume\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.523911 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:00.523561    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:49:00.523911 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.523632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-crio-socket\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.523911 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:00.523639    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls podName:c72d7ce5-cc9a-443d-a35d-96e37d9893dd nodeName:}" failed. No retries permitted until 2026-07-18 01:49:01.023616877 +0000 UTC m=+36.825861314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg2gb" (UID: "c72d7ce5-cc9a-443d-a35d-96e37d9893dd") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:49:00.523911 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.523679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.523911 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.523705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwpfm\" (UniqueName: \"kubernetes.io/projected/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-api-access-hwpfm\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.523911 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:00.523883    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:49:00.524348 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:00.523925    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm podName:c72d7ce5-cc9a-443d-a35d-96e37d9893dd nodeName:}" failed. No retries permitted until 2026-07-18 01:49:01.023914171 +0000 UTC m=+36.826158618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zg2gb" (UID: "c72d7ce5-cc9a-443d-a35d-96e37d9893dd") : configmap "kube-rbac-proxy" not found
Jul 18 01:49:00.531813 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.531536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-data-volume\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.534824 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.534773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwpfm\" (UniqueName: \"kubernetes.io/projected/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-api-access-hwpfm\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:00.740004 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.739968    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:49:00.740191 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.740159    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:49:00.743031 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.743005    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 01:49:00.743183 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.743070    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mcksx\""
Jul 18 01:49:00.743277 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:00.743262    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 01:49:01.027871 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.027839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:01.028151 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.027913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:01.028151 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:01.027972    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:49:01.028151 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:01.028052    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm podName:c72d7ce5-cc9a-443d-a35d-96e37d9893dd nodeName:}" failed. No retries permitted until 2026-07-18 01:49:02.028029295 +0000 UTC m=+37.830273731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zg2gb" (UID: "c72d7ce5-cc9a-443d-a35d-96e37d9893dd") : configmap "kube-rbac-proxy" not found
Jul 18 01:49:01.028151 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:01.028105    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:49:01.028401 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:01.028175    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls podName:c72d7ce5-cc9a-443d-a35d-96e37d9893dd nodeName:}" failed. No retries permitted until 2026-07-18 01:49:02.028156795 +0000 UTC m=+37.830401253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg2gb" (UID: "c72d7ce5-cc9a-443d-a35d-96e37d9893dd") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:49:01.035313 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.035281    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t5zbz" event={"ID":"d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b","Type":"ContainerStarted","Data":"720e3d6f2101d87906e7ab4473cb5a2b903b6ef51ed764e9ac1c11e98b2bcf57"}
Jul 18 01:49:01.039349 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.039303    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cvs5l" event={"ID":"d178fdd8-e4a8-4251-bd75-2de893a6994c","Type":"ContainerStarted","Data":"ac7ccd325a4c2e91f962e73a294d4cf8a36f03b7446a2ae5464db79e19714597"}
Jul 18 01:49:01.063494 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.063411    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cvs5l" podStartSLOduration=8.076958193 podStartE2EDuration="37.063397035s" totalImagesPullingTime="28.986438842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:01.061435206 +0000 UTC m=+36.863679663" watchObservedRunningTime="2026-07-18 01:49:01.063397035 +0000 UTC m=+36.865641492"
Jul 18 01:49:01.330512 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.330425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:49:01.330772 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:01.330593    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:49:01.330772 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:01.330663    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls podName:93e29a00-1353-4740-84df-438e861f1dad nodeName:}" failed. No retries permitted until 2026-07-18 01:49:03.330641852 +0000 UTC m=+39.132886289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls") pod "dns-default-gwhfr" (UID: "93e29a00-1353-4740-84df-438e861f1dad") : secret "dns-default-metrics-tls" not found
Jul 18 01:49:01.389486 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.389454    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd"]
Jul 18 01:49:01.402035 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.402009    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd"
Jul 18 01:49:01.404242 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.404221    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd"]
Jul 18 01:49:01.404975 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.404948    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 18 01:49:01.405055 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.404993    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-h2q5d\""
Jul 18 01:49:01.405106 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.405066    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 18 01:49:01.533150 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.533112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t85m6\" (UniqueName: \"kubernetes.io/projected/a5dbfe05-4b26-445b-83cc-63e57944ea97-kube-api-access-t85m6\") pod \"migrator-7cc9c7ffd7-ksrbd\" (UID: \"a5dbfe05-4b26-445b-83cc-63e57944ea97\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd"
Jul 18 01:49:01.633795 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.633717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t85m6\" (UniqueName: \"kubernetes.io/projected/a5dbfe05-4b26-445b-83cc-63e57944ea97-kube-api-access-t85m6\") pod \"migrator-7cc9c7ffd7-ksrbd\" (UID: \"a5dbfe05-4b26-445b-83cc-63e57944ea97\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd"
Jul 18 01:49:01.642933 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.642899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t85m6\" (UniqueName: \"kubernetes.io/projected/a5dbfe05-4b26-445b-83cc-63e57944ea97-kube-api-access-t85m6\") pod \"migrator-7cc9c7ffd7-ksrbd\" (UID: \"a5dbfe05-4b26-445b-83cc-63e57944ea97\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd"
Jul 18 01:49:01.711998 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:01.711966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd"
Jul 18 01:49:02.037429 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:02.037396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:02.037594 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:02.037483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:02.037594 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:02.037532    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:49:02.037680 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:02.037609    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm podName:c72d7ce5-cc9a-443d-a35d-96e37d9893dd nodeName:}" failed. No retries permitted until 2026-07-18 01:49:04.037586048 +0000 UTC m=+39.839830483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zg2gb" (UID: "c72d7ce5-cc9a-443d-a35d-96e37d9893dd") : configmap "kube-rbac-proxy" not found
Jul 18 01:49:02.037680 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:02.037647    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:49:02.037806 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:02.037695    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls podName:c72d7ce5-cc9a-443d-a35d-96e37d9893dd nodeName:}" failed. No retries permitted until 2026-07-18 01:49:04.03768209 +0000 UTC m=+39.839926550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg2gb" (UID: "c72d7ce5-cc9a-443d-a35d-96e37d9893dd") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:49:02.308414 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:02.308313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd"]
Jul 18 01:49:02.340933 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:02.340910    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44g5s_aa2641fc-b98a-40a4-a4c2-c8b3011b7377/dns-node-resolver/0.log"
Jul 18 01:49:02.368723 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:02.368692    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5dbfe05_4b26_445b_83cc_63e57944ea97.slice/crio-130dcd0ac86955177b85faacf45ff3fbc1ca8bbc2bce7852820f150d32855d32 WatchSource:0}: Error finding container 130dcd0ac86955177b85faacf45ff3fbc1ca8bbc2bce7852820f150d32855d32: Status 404 returned error can't find the container with id 130dcd0ac86955177b85faacf45ff3fbc1ca8bbc2bce7852820f150d32855d32
Jul 18 01:49:03.045799 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:03.045769    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t5zbz" event={"ID":"d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b","Type":"ContainerStarted","Data":"0beba98498e9619bc43ffe760ab903be24c8a27355c21abdd699557f994a8570"}
Jul 18 01:49:03.046939 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:03.046917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd" event={"ID":"a5dbfe05-4b26-445b-83cc-63e57944ea97","Type":"ContainerStarted","Data":"130dcd0ac86955177b85faacf45ff3fbc1ca8bbc2bce7852820f150d32855d32"}
Jul 18 01:49:03.065513 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:03.065463    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t5zbz" podStartSLOduration=1.795667822 podStartE2EDuration="4.065444457s" totalImagesPullingTime="2.269776635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:03.064912731 +0000 UTC m=+38.867157189" watchObservedRunningTime="2026-07-18 01:49:03.065444457 +0000 UTC m=+38.867688915"
Jul 18 01:49:03.341888 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:03.341717    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mhngd_cacba113-1053-4df9-b5fe-954e50d6bb34/node-ca/0.log"
Jul 18 01:49:03.347042 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:03.347021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:49:03.347172 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:03.347157    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:49:03.347220 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:03.347212    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls podName:93e29a00-1353-4740-84df-438e861f1dad nodeName:}" failed. No retries permitted until 2026-07-18 01:49:07.347199448 +0000 UTC m=+43.149443883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls") pod "dns-default-gwhfr" (UID: "93e29a00-1353-4740-84df-438e861f1dad") : secret "dns-default-metrics-tls" not found
Jul 18 01:49:04.050459 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:04.050427    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd" event={"ID":"a5dbfe05-4b26-445b-83cc-63e57944ea97","Type":"ContainerStarted","Data":"b5cd43d6884cb62be925b9cb2c4bb502149f59173380512e3e4d569a675e70ff"}
Jul 18 01:49:04.050830 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:04.050476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd" event={"ID":"a5dbfe05-4b26-445b-83cc-63e57944ea97","Type":"ContainerStarted","Data":"2faa7fcf20a3b4f745cb537879908f3ef58a591bbe570a825b8fe96fc972074e"}
Jul 18 01:49:04.051877 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:04.051859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:04.051941 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:04.051917    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:04.052003 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:04.051991    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:49:04.052054 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:04.052018    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:49:04.052054 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:04.052040    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm podName:c72d7ce5-cc9a-443d-a35d-96e37d9893dd nodeName:}" failed. No retries permitted until 2026-07-18 01:49:08.052027742 +0000 UTC m=+43.854272177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zg2gb" (UID: "c72d7ce5-cc9a-443d-a35d-96e37d9893dd") : configmap "kube-rbac-proxy" not found
Jul 18 01:49:04.052146 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:04.052079    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls podName:c72d7ce5-cc9a-443d-a35d-96e37d9893dd nodeName:}" failed. No retries permitted until 2026-07-18 01:49:08.05206186 +0000 UTC m=+43.854306295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg2gb" (UID: "c72d7ce5-cc9a-443d-a35d-96e37d9893dd") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:49:04.341997 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:04.341919    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t5zbz_d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b/serve-healthcheck-canary/0.log"
Jul 18 01:49:07.376137 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:07.376094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:49:07.376681 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:07.376280    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:49:07.376681 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:07.376413    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls podName:93e29a00-1353-4740-84df-438e861f1dad nodeName:}" failed. No retries permitted until 2026-07-18 01:49:15.376388857 +0000 UTC m=+51.178633295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls") pod "dns-default-gwhfr" (UID: "93e29a00-1353-4740-84df-438e861f1dad") : secret "dns-default-metrics-tls" not found
Jul 18 01:49:08.080618 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:08.080590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:08.080813 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:08.080640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:08.080813 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:08.080756    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:49:08.080813 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:08.080811    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls podName:c72d7ce5-cc9a-443d-a35d-96e37d9893dd nodeName:}" failed. No retries permitted until 2026-07-18 01:49:16.080794333 +0000 UTC m=+51.883038769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zg2gb" (UID: "c72d7ce5-cc9a-443d-a35d-96e37d9893dd") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:49:08.081260 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:08.081234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:15.435287 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:15.435245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:49:15.438930 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:15.438897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e29a00-1353-4740-84df-438e861f1dad-metrics-tls\") pod \"dns-default-gwhfr\" (UID: \"93e29a00-1353-4740-84df-438e861f1dad\") " pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:49:15.492729 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:15.492697    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:49:15.635049 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:15.634982    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ksrbd" podStartSLOduration=13.369382682 podStartE2EDuration="14.634963365s" totalImagesPullingTime="1.265580683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:04.078474218 +0000 UTC m=+39.880718675" watchObservedRunningTime="2026-07-18 01:49:15.634963365 +0000 UTC m=+51.437207833"
Jul 18 01:49:15.635446 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:15.635428    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gwhfr"]
Jul 18 01:49:15.638666 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:15.638636    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e29a00_1353_4740_84df_438e861f1dad.slice/crio-9495a21aceca0668a8fb4281b264251c69c8260881f9459a21a10931a5c42037 WatchSource:0}: Error finding container 9495a21aceca0668a8fb4281b264251c69c8260881f9459a21a10931a5c42037: Status 404 returned error can't find the container with id 9495a21aceca0668a8fb4281b264251c69c8260881f9459a21a10931a5c42037
Jul 18 01:49:16.083434 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:16.083402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gwhfr" event={"ID":"93e29a00-1353-4740-84df-438e861f1dad","Type":"ContainerStarted","Data":"9495a21aceca0668a8fb4281b264251c69c8260881f9459a21a10931a5c42037"}
Jul 18 01:49:16.140929 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:16.140892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:16.143354 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:16.143311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72d7ce5-cc9a-443d-a35d-96e37d9893dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zg2gb\" (UID: \"c72d7ce5-cc9a-443d-a35d-96e37d9893dd\") " pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:16.189272 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:16.189243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zg2gb"
Jul 18 01:49:16.344779 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:16.344698    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zg2gb"]
Jul 18 01:49:16.348676 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:16.348650    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72d7ce5_cc9a_443d_a35d_96e37d9893dd.slice/crio-02b3c34d69194a3c11b19d97f74caf4635ab19cc90aee9d742276c4139cc82e1 WatchSource:0}: Error finding container 02b3c34d69194a3c11b19d97f74caf4635ab19cc90aee9d742276c4139cc82e1: Status 404 returned error can't find the container with id 02b3c34d69194a3c11b19d97f74caf4635ab19cc90aee9d742276c4139cc82e1
Jul 18 01:49:17.088343 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:17.088278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zg2gb" event={"ID":"c72d7ce5-cc9a-443d-a35d-96e37d9893dd","Type":"ContainerStarted","Data":"02b3c34d69194a3c11b19d97f74caf4635ab19cc90aee9d742276c4139cc82e1"}
Jul 18 01:49:18.093815 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:18.093772    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gwhfr" event={"ID":"93e29a00-1353-4740-84df-438e861f1dad","Type":"ContainerStarted","Data":"4704e504246a571a2e63cf8639c8b4854e5e56b244a7bcc26578fba6f6a17e1a"}
Jul 18 01:49:18.094233 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:18.093848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gwhfr" event={"ID":"93e29a00-1353-4740-84df-438e861f1dad","Type":"ContainerStarted","Data":"646049cb676b492178b073b37c7d358842436ba754e6ad82b68dda4b0f8506b8"}
Jul 18 01:49:18.094233 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:18.094006    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:49:18.110789 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:18.110742    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gwhfr" podStartSLOduration=17.127814404 podStartE2EDuration="19.110727783s" totalImagesPullingTime="1.982913379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:18.109822223 +0000 UTC m=+53.912066684" watchObservedRunningTime="2026-07-18 01:49:18.110727783 +0000 UTC m=+53.912972247"
Jul 18 01:49:22.109925 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:22.109773    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zg2gb" event={"ID":"c72d7ce5-cc9a-443d-a35d-96e37d9893dd","Type":"ContainerStarted","Data":"f44bf008954d77da527f2858f017c90e64558ee4f10a0b88003bbeb3c7f41fca"}
Jul 18 01:49:23.983081 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:23.983048    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6484c9655d-5dbdt"]
Jul 18 01:49:24.002481 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.002449    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6484c9655d-5dbdt"]
Jul 18 01:49:24.002656 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.002542    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.005623 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.005595    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 18 01:49:24.005759 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.005716    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 18 01:49:24.005883 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.005863    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 18 01:49:24.007043 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.007024    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tsvv8\""
Jul 18 01:49:24.012007 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.011988    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 18 01:49:24.105691 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.105658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4579162-c023-4512-b7f1-ba5108ce0a2b-registry-tls\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.105843 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.105700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4579162-c023-4512-b7f1-ba5108ce0a2b-ca-trust-extracted\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.105843 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.105783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4579162-c023-4512-b7f1-ba5108ce0a2b-image-registry-private-configuration\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.105843 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.105818    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4579162-c023-4512-b7f1-ba5108ce0a2b-trusted-ca\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.105843 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.105837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9hgq\" (UniqueName: \"kubernetes.io/projected/c4579162-c023-4512-b7f1-ba5108ce0a2b-kube-api-access-n9hgq\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.105969 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.105869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4579162-c023-4512-b7f1-ba5108ce0a2b-registry-certificates\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.105969 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.105901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4579162-c023-4512-b7f1-ba5108ce0a2b-bound-sa-token\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.106032 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.105972    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4579162-c023-4512-b7f1-ba5108ce0a2b-installation-pull-secrets\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.206829 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.206790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4579162-c023-4512-b7f1-ba5108ce0a2b-ca-trust-extracted\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.206997 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.206846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4579162-c023-4512-b7f1-ba5108ce0a2b-image-registry-private-configuration\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.206997 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.206935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4579162-c023-4512-b7f1-ba5108ce0a2b-trusted-ca\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.206997 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.206966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9hgq\" (UniqueName: \"kubernetes.io/projected/c4579162-c023-4512-b7f1-ba5108ce0a2b-kube-api-access-n9hgq\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.206997 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.206994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4579162-c023-4512-b7f1-ba5108ce0a2b-registry-certificates\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.207214 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.207018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4579162-c023-4512-b7f1-ba5108ce0a2b-bound-sa-token\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.207214 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.207073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4579162-c023-4512-b7f1-ba5108ce0a2b-installation-pull-secrets\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.207214 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.207139    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4579162-c023-4512-b7f1-ba5108ce0a2b-registry-tls\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.207396 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.207216    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4579162-c023-4512-b7f1-ba5108ce0a2b-ca-trust-extracted\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.208049 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.207994    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4579162-c023-4512-b7f1-ba5108ce0a2b-registry-certificates\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.208186 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.208167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4579162-c023-4512-b7f1-ba5108ce0a2b-trusted-ca\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.210029 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.210007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4579162-c023-4512-b7f1-ba5108ce0a2b-registry-tls\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.210141 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.210074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4579162-c023-4512-b7f1-ba5108ce0a2b-image-registry-private-configuration\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.210188 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.210150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4579162-c023-4512-b7f1-ba5108ce0a2b-installation-pull-secrets\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.215715 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.215693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4579162-c023-4512-b7f1-ba5108ce0a2b-bound-sa-token\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.216177 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.216158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9hgq\" (UniqueName: \"kubernetes.io/projected/c4579162-c023-4512-b7f1-ba5108ce0a2b-kube-api-access-n9hgq\") pod \"image-registry-6484c9655d-5dbdt\" (UID: \"c4579162-c023-4512-b7f1-ba5108ce0a2b\") " pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.313977 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.313937    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:24.930232 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:24.930210    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6484c9655d-5dbdt"]
Jul 18 01:49:24.931827 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:24.931796    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4579162_c023_4512_b7f1_ba5108ce0a2b.slice/crio-ed62c2e77b9431bbf7d86608ce34e69e261a6d76c983820bea478955b1d94757 WatchSource:0}: Error finding container ed62c2e77b9431bbf7d86608ce34e69e261a6d76c983820bea478955b1d94757: Status 404 returned error can't find the container with id ed62c2e77b9431bbf7d86608ce34e69e261a6d76c983820bea478955b1d94757
Jul 18 01:49:25.123080 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:25.122995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6484c9655d-5dbdt" event={"ID":"c4579162-c023-4512-b7f1-ba5108ce0a2b","Type":"ContainerStarted","Data":"c6bff4003f9c7db6a1fa2f1ff10f88651330bda1b6a209b292797452f2121cd8"}
Jul 18 01:49:25.123080 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:25.123058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6484c9655d-5dbdt" event={"ID":"c4579162-c023-4512-b7f1-ba5108ce0a2b","Type":"ContainerStarted","Data":"ed62c2e77b9431bbf7d86608ce34e69e261a6d76c983820bea478955b1d94757"}
Jul 18 01:49:25.123617 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:25.123183    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:25.124903 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:25.124880    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zg2gb" event={"ID":"c72d7ce5-cc9a-443d-a35d-96e37d9893dd","Type":"ContainerStarted","Data":"743a9f89fc21a2deb1f67bb8b8bdfedf12414d1f5205308e07bf76bf14f1a416"}
Jul 18 01:49:25.146077 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:25.146028    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6484c9655d-5dbdt" podStartSLOduration=2.146015156 podStartE2EDuration="2.146015156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:25.144908508 +0000 UTC m=+60.947152964" watchObservedRunningTime="2026-07-18 01:49:25.146015156 +0000 UTC m=+60.948259613"
Jul 18 01:49:25.822745 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:25.822715    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cb6rk"
Jul 18 01:49:28.099813 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:28.099778    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gwhfr"
Jul 18 01:49:29.141482 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:29.141442    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zg2gb" event={"ID":"c72d7ce5-cc9a-443d-a35d-96e37d9893dd","Type":"ContainerStarted","Data":"4b368f79348ed8c9fe4b58f5bcb3e66052e049c19e3b3b5ae537eb43e33b81af"}
Jul 18 01:49:29.159740 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:29.159625    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zg2gb" podStartSLOduration=17.26506667 podStartE2EDuration="29.159606597s" totalImagesPullingTime="11.894539927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:49:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:29.159350597 +0000 UTC m=+64.961595054" watchObservedRunningTime="2026-07-18 01:49:29.159606597 +0000 UTC m=+64.961851055"
Jul 18 01:49:30.356477 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.356440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:49:30.359020 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.359000    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 01:49:30.369456 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.369431    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b8627d7-e095-4a0e-a025-3a6f488d3bdc-original-pull-secret\") pod \"global-pull-secret-syncer-5wzcl\" (UID: \"6b8627d7-e095-4a0e-a025-3a6f488d3bdc\") " pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:49:30.451733 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.451699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5wzcl"
Jul 18 01:49:30.457738 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.457710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:49:30.457859 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.457749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwmm\" (UniqueName: \"kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm\") pod \"network-check-target-nw226\" (UID: \"8f77203a-02f4-49ad-9123-7eda0c6c8091\") " pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:49:30.461592 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.461568    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 01:49:30.461717 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.461620    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 01:49:30.470853 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.470830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418cbc40-4789-4ca8-b465-6abeeacf0c11-metrics-certs\") pod \"network-metrics-daemon-8csvn\" (UID: \"418cbc40-4789-4ca8-b465-6abeeacf0c11\") " pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:49:30.471078 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.471065    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 01:49:30.481891 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.481867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctwmm\" (UniqueName: \"kubernetes.io/projected/8f77203a-02f4-49ad-9123-7eda0c6c8091-kube-api-access-ctwmm\") pod \"network-check-target-nw226\" (UID: \"8f77203a-02f4-49ad-9123-7eda0c6c8091\") " pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:49:30.576099 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.576070    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5wzcl"]
Jul 18 01:49:30.579018 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:30.578994    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8627d7_e095_4a0e_a025_3a6f488d3bdc.slice/crio-7de0e47cb9211b5f48b8a1e9aaec686f69b7f38e0d297b7b1fcc346b6a43b75b WatchSource:0}: Error finding container 7de0e47cb9211b5f48b8a1e9aaec686f69b7f38e0d297b7b1fcc346b6a43b75b: Status 404 returned error can't find the container with id 7de0e47cb9211b5f48b8a1e9aaec686f69b7f38e0d297b7b1fcc346b6a43b75b
Jul 18 01:49:30.650647 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.650571    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2rqj2\""
Jul 18 01:49:30.658853 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.658836    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:49:30.761269 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.761240    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mcksx\""
Jul 18 01:49:30.769373 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.769348    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8csvn"
Jul 18 01:49:30.780582 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.780555    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nw226"]
Jul 18 01:49:30.783736 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:30.783713    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f77203a_02f4_49ad_9123_7eda0c6c8091.slice/crio-a5e8bb6618bb0e35c8d8c345fea928105f1093a27907ed7a014d64423efd9d4a WatchSource:0}: Error finding container a5e8bb6618bb0e35c8d8c345fea928105f1093a27907ed7a014d64423efd9d4a: Status 404 returned error can't find the container with id a5e8bb6618bb0e35c8d8c345fea928105f1093a27907ed7a014d64423efd9d4a
Jul 18 01:49:30.891840 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:30.891808    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8csvn"]
Jul 18 01:49:30.894737 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:30.894712    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418cbc40_4789_4ca8_b465_6abeeacf0c11.slice/crio-438bdcc6a17450c48d4e1059b5cef006983250369edaf5db2f6706f38c75f53f WatchSource:0}: Error finding container 438bdcc6a17450c48d4e1059b5cef006983250369edaf5db2f6706f38c75f53f: Status 404 returned error can't find the container with id 438bdcc6a17450c48d4e1059b5cef006983250369edaf5db2f6706f38c75f53f
Jul 18 01:49:31.149576 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.149527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nw226" event={"ID":"8f77203a-02f4-49ad-9123-7eda0c6c8091","Type":"ContainerStarted","Data":"a5e8bb6618bb0e35c8d8c345fea928105f1093a27907ed7a014d64423efd9d4a"}
Jul 18 01:49:31.151036 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.151004    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8csvn" event={"ID":"418cbc40-4789-4ca8-b465-6abeeacf0c11","Type":"ContainerStarted","Data":"438bdcc6a17450c48d4e1059b5cef006983250369edaf5db2f6706f38c75f53f"}
Jul 18 01:49:31.152266 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.152238    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5wzcl" event={"ID":"6b8627d7-e095-4a0e-a025-3a6f488d3bdc","Type":"ContainerStarted","Data":"7de0e47cb9211b5f48b8a1e9aaec686f69b7f38e0d297b7b1fcc346b6a43b75b"}
Jul 18 01:49:31.380741 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.380710    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66568dd586-r89lm"]
Jul 18 01:49:31.384443 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.384283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.387672 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.387479    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 18 01:49:31.388477 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.388457    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 18 01:49:31.388759 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.388742    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 18 01:49:31.388948 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.388934    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 18 01:49:31.389998 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.389155    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 18 01:49:31.389998 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.389301    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 18 01:49:31.389998 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.389728    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 18 01:49:31.389998 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.389831    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tffsz\""
Jul 18 01:49:31.401901 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.401682    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 18 01:49:31.411773 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.411748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66568dd586-r89lm"]
Jul 18 01:49:31.463106 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.463066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-oauth-config\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.463355 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.463111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-trusted-ca-bundle\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.463355 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.463140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-oauth-serving-cert\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.463355 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.463269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-config\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.463355 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.463302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-service-ca\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.463584 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.463355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-serving-cert\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.463584 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.463391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cqv6\" (UniqueName: \"kubernetes.io/projected/eb6a1f7d-1b91-427b-ac4c-d1388393a998-kube-api-access-6cqv6\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.565783 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.563892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-oauth-config\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.565783 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.563941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-trusted-ca-bundle\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.565783 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.563968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-oauth-serving-cert\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.565783 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.564081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-config\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.565783 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.564110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-service-ca\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.565783 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.564141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-serving-cert\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.565783 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.564172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cqv6\" (UniqueName: \"kubernetes.io/projected/eb6a1f7d-1b91-427b-ac4c-d1388393a998-kube-api-access-6cqv6\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.565783 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.565737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-oauth-serving-cert\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.566294 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.566055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-trusted-ca-bundle\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.566633 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.566592    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-config\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.566633 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.566601    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-service-ca\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.570724 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.570687    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-serving-cert\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.573154 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.573129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-oauth-config\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.575455 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.575409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cqv6\" (UniqueName: \"kubernetes.io/projected/eb6a1f7d-1b91-427b-ac4c-d1388393a998-kube-api-access-6cqv6\") pod \"console-66568dd586-r89lm\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") " pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:31.697550 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:31.697470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:32.150651 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:32.150444    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66568dd586-r89lm"]
Jul 18 01:49:32.161588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:32.161550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8csvn" event={"ID":"418cbc40-4789-4ca8-b465-6abeeacf0c11","Type":"ContainerStarted","Data":"c86990a7de4c11072bcb8d2243c35f4ae56b19ac65b0e6e41eb5435306b64527"}
Jul 18 01:49:33.168115 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:33.168065    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66568dd586-r89lm" event={"ID":"eb6a1f7d-1b91-427b-ac4c-d1388393a998","Type":"ContainerStarted","Data":"9fee6906ebce6fb8d74cd4938c6ab54eaf60cb7ca8b4f7fcc566a03db230a718"}
Jul 18 01:49:33.171273 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:33.171243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8csvn" event={"ID":"418cbc40-4789-4ca8-b465-6abeeacf0c11","Type":"ContainerStarted","Data":"9356acdca3f3954d499a65e94f090151f578fb440c317de7a47d1cc05f96a464"}
Jul 18 01:49:33.190053 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:33.189450    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8csvn" podStartSLOduration=67.057208078 podStartE2EDuration="1m8.189400472s" totalImagesPullingTime="1.132192394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:33.188576435 +0000 UTC m=+68.990820887" watchObservedRunningTime="2026-07-18 01:49:33.189400472 +0000 UTC m=+68.991644930"
Jul 18 01:49:37.188607 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:37.188562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66568dd586-r89lm" event={"ID":"eb6a1f7d-1b91-427b-ac4c-d1388393a998","Type":"ContainerStarted","Data":"83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7"}
Jul 18 01:49:37.189975 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:37.189948    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5wzcl" event={"ID":"6b8627d7-e095-4a0e-a025-3a6f488d3bdc","Type":"ContainerStarted","Data":"8fde6f40b7dd36d7ef4fc55977f63f27061cf4ce7564bfece10dab46730aa81b"}
Jul 18 01:49:37.191217 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:37.191192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nw226" event={"ID":"8f77203a-02f4-49ad-9123-7eda0c6c8091","Type":"ContainerStarted","Data":"22a12d9a1aa84feaa5df3c018b1ed1a78a42c7c3671ed6a2bae1dae3e814c8db"}
Jul 18 01:49:37.191450 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:37.191352    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:49:37.218203 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:37.218161    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66568dd586-r89lm" podStartSLOduration=1.868496473 podStartE2EDuration="6.218147928s" totalImagesPullingTime="4.349651455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:37.217610892 +0000 UTC m=+73.019855349" watchObservedRunningTime="2026-07-18 01:49:37.218147928 +0000 UTC m=+73.020392385"
Jul 18 01:49:37.250648 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:37.250604    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5wzcl" podStartSLOduration=66.31768252 podStartE2EDuration="1m12.250588786s" totalImagesPullingTime="5.932906266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:37.249839863 +0000 UTC m=+73.052084332" watchObservedRunningTime="2026-07-18 01:49:37.250588786 +0000 UTC m=+73.052833242"
Jul 18 01:49:37.270129 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:37.270085    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nw226" podStartSLOduration=66.553265067 podStartE2EDuration="1m12.270076339s" totalImagesPullingTime="5.716811272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:37.269772482 +0000 UTC m=+73.072016939" watchObservedRunningTime="2026-07-18 01:49:37.270076339 +0000 UTC m=+73.072320796"
Jul 18 01:49:41.698135 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:41.698083    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:41.698626 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:41.698160    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:41.702940 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:41.702915    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:42.210377 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:42.210352    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:49:46.133143 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:46.133023    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6484c9655d-5dbdt"
Jul 18 01:49:49.915300 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.915267    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jhp2m"]
Jul 18 01:49:49.919612 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.919593    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:49.921943 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.921927    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 18 01:49:49.922020 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.921979    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 18 01:49:49.922070 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.922044    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fc5s8\""
Jul 18 01:49:49.922128 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.922113    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 18 01:49:49.922370 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.922358    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 18 01:49:49.923259 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.923245    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 18 01:49:49.923313 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.923297    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 18 01:49:49.998315 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.998277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-sys\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:49.998315 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.998338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-metrics-client-ca\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:49.998587 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.998403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:49.998587 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.998456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:49.998587 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.998482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-wtmp\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:49.998587 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.998508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-tls\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:49.998587 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.998537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-textfile\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:49.998587 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.998562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m626d\" (UniqueName: \"kubernetes.io/projected/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-kube-api-access-m626d\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:49.998773 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:49.998620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-root\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.099723 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-textfile\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.099723 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m626d\" (UniqueName: \"kubernetes.io/projected/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-kube-api-access-m626d\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.099926 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-root\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.099926 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-sys\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.099926 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-metrics-client-ca\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.099926 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.099926 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-root\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.099926 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.099926 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-sys\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.100225 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-wtmp\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.100225 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.099957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-tls\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.100225 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:50.100055    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 18 01:49:50.100225 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.100083    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-textfile\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.100225 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:50.100120    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-tls podName:d639b91e-1c97-4efa-ad5b-1eee8d5a55a0 nodeName:}" failed. No retries permitted until 2026-07-18 01:49:50.600101654 +0000 UTC m=+86.402346092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-tls") pod "node-exporter-jhp2m" (UID: "d639b91e-1c97-4efa-ad5b-1eee8d5a55a0") : secret "node-exporter-tls" not found
Jul 18 01:49:50.100225 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.100131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-wtmp\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.100501 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.100430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-metrics-client-ca\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.100501 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.100464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-accelerators-collector-config\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.102305 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.102278    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.109337 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.109302    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m626d\" (UniqueName: \"kubernetes.io/projected/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-kube-api-access-m626d\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.603782 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:50.603727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-tls\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:50.603970 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:50.603886    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 18 01:49:50.603970 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:50.603947    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-tls podName:d639b91e-1c97-4efa-ad5b-1eee8d5a55a0 nodeName:}" failed. No retries permitted until 2026-07-18 01:49:51.60393253 +0000 UTC m=+87.406176965 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-tls") pod "node-exporter-jhp2m" (UID: "d639b91e-1c97-4efa-ad5b-1eee8d5a55a0") : secret "node-exporter-tls" not found
Jul 18 01:49:51.611427 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:51.611394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-tls\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:51.613754 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:51.613733    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d639b91e-1c97-4efa-ad5b-1eee8d5a55a0-node-exporter-tls\") pod \"node-exporter-jhp2m\" (UID: \"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0\") " pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:51.728300 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:51.728266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jhp2m"
Jul 18 01:49:51.739695 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:51.739667    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd639b91e_1c97_4efa_ad5b_1eee8d5a55a0.slice/crio-89ff89b0bb980f1c6a545b71a2a948452d8b5d784a793b5899b4f30245aae91c WatchSource:0}: Error finding container 89ff89b0bb980f1c6a545b71a2a948452d8b5d784a793b5899b4f30245aae91c: Status 404 returned error can't find the container with id 89ff89b0bb980f1c6a545b71a2a948452d8b5d784a793b5899b4f30245aae91c
Jul 18 01:49:52.241995 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:52.241953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jhp2m" event={"ID":"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0","Type":"ContainerStarted","Data":"89ff89b0bb980f1c6a545b71a2a948452d8b5d784a793b5899b4f30245aae91c"}
Jul 18 01:49:53.011171 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.011139    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"]
Jul 18 01:49:53.041942 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.041910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"]
Jul 18 01:49:53.042106 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.042051    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.046304 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.046280    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 18 01:49:53.046452 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.046430    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 18 01:49:53.046546 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.046518    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a7fts3fmoepno\""
Jul 18 01:49:53.046704 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.046689    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 18 01:49:53.046774 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.046741    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 18 01:49:53.046846 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.046829    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 18 01:49:53.047554 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.047535    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8cwkg\""
Jul 18 01:49:53.121858 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.121780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5v5q\" (UniqueName: \"kubernetes.io/projected/adff932f-0cfc-407f-911c-fd191fbac351-kube-api-access-m5v5q\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.121858 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.121821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adff932f-0cfc-407f-911c-fd191fbac351-metrics-client-ca\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.121858 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.121845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.122077 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.121902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.122077 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.121962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-grpc-tls\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.122077 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.122000    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-tls\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.122077 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.122024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.122195 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.122085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.223134 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.223093    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.223134 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.223141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5v5q\" (UniqueName: \"kubernetes.io/projected/adff932f-0cfc-407f-911c-fd191fbac351-kube-api-access-m5v5q\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.223360 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.223162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adff932f-0cfc-407f-911c-fd191fbac351-metrics-client-ca\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.223360 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.223278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.223360 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.223334    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.223520 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.223366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-grpc-tls\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.223520 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.223414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-tls\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.223520 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.223442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.223937 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.223907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adff932f-0cfc-407f-911c-fd191fbac351-metrics-client-ca\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.225981 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.225961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.226092 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.226061    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.226489 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.226461    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.226572 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.226537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-tls\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.226612 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.226588    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-grpc-tls\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.226782 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.226758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/adff932f-0cfc-407f-911c-fd191fbac351-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.232760 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.232739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5v5q\" (UniqueName: \"kubernetes.io/projected/adff932f-0cfc-407f-911c-fd191fbac351-kube-api-access-m5v5q\") pod \"thanos-querier-679f7dcd9c-jhtc4\" (UID: \"adff932f-0cfc-407f-911c-fd191fbac351\") " pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.246771 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.246741    2560 generic.go:356] "Generic (PLEG): container finished" podID="d639b91e-1c97-4efa-ad5b-1eee8d5a55a0" containerID="0d261347508b5dd7d513d877901d4e61653e2b1da87eee6fb6b76444333ea44a" exitCode=0
Jul 18 01:49:53.246871 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.246806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jhp2m" event={"ID":"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0","Type":"ContainerDied","Data":"0d261347508b5dd7d513d877901d4e61653e2b1da87eee6fb6b76444333ea44a"}
Jul 18 01:49:53.351663 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.351635    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:53.502064 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:53.502033    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"]
Jul 18 01:49:53.504679 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:53.504650    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadff932f_0cfc_407f_911c_fd191fbac351.slice/crio-c4e8f2e9bdac216923e1dec212c0f032e5fb371cb7c20f8df54241f87ced903d WatchSource:0}: Error finding container c4e8f2e9bdac216923e1dec212c0f032e5fb371cb7c20f8df54241f87ced903d: Status 404 returned error can't find the container with id c4e8f2e9bdac216923e1dec212c0f032e5fb371cb7c20f8df54241f87ced903d
Jul 18 01:49:54.252446 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.252404    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4" event={"ID":"adff932f-0cfc-407f-911c-fd191fbac351","Type":"ContainerStarted","Data":"c4e8f2e9bdac216923e1dec212c0f032e5fb371cb7c20f8df54241f87ced903d"}
Jul 18 01:49:54.254494 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.254468    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jhp2m" event={"ID":"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0","Type":"ContainerStarted","Data":"d99d4dc59c0bced901d7a3be0f06ec72f7d1d7241b6e6bcbfd78981e9d9f63f7"}
Jul 18 01:49:54.254637 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.254512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jhp2m" event={"ID":"d639b91e-1c97-4efa-ad5b-1eee8d5a55a0","Type":"ContainerStarted","Data":"c38e015ceed789de545beeb4660d13511d5b403a83fa3637acd1ae3f3f0c8d02"}
Jul 18 01:49:54.692229 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.692126    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jhp2m" podStartSLOduration=4.486395789 podStartE2EDuration="5.692110732s" totalImagesPullingTime="1.126093429s" totalInitContainerRuntime="79.621514ms" isStatefulPod=true podCreationTimestamp="2026-07-18 01:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:54.273943659 +0000 UTC m=+90.076188116" watchObservedRunningTime="2026-07-18 01:49:54.692110732 +0000 UTC m=+90.494355276"
Jul 18 01:49:54.692594 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.692579    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"]
Jul 18 01:49:54.713459 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.713432    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"]
Jul 18 01:49:54.713601 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.713528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:54.716117 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.716093    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 18 01:49:54.716233 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.716120    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2svkr\""
Jul 18 01:49:54.835636 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.835598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k982r\" (UniqueName: \"kubernetes.io/projected/7b3e5c0e-90fb-4af8-b8f1-ab049f506481-kube-api-access-k982r\") pod \"monitoring-plugin-7b7b7bc8bf-m94p4\" (UID: \"7b3e5c0e-90fb-4af8-b8f1-ab049f506481\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:54.835807 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.835677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3e5c0e-90fb-4af8-b8f1-ab049f506481-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m94p4\" (UID: \"7b3e5c0e-90fb-4af8-b8f1-ab049f506481\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:54.936956 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.936910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3e5c0e-90fb-4af8-b8f1-ab049f506481-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m94p4\" (UID: \"7b3e5c0e-90fb-4af8-b8f1-ab049f506481\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:54.937155 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.936969    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k982r\" (UniqueName: \"kubernetes.io/projected/7b3e5c0e-90fb-4af8-b8f1-ab049f506481-kube-api-access-k982r\") pod \"monitoring-plugin-7b7b7bc8bf-m94p4\" (UID: \"7b3e5c0e-90fb-4af8-b8f1-ab049f506481\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:54.937155 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:54.937036    2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 18 01:49:54.937155 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:49:54.937121    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3e5c0e-90fb-4af8-b8f1-ab049f506481-monitoring-plugin-cert podName:7b3e5c0e-90fb-4af8-b8f1-ab049f506481 nodeName:}" failed. No retries permitted until 2026-07-18 01:49:55.437099679 +0000 UTC m=+91.239344115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7b3e5c0e-90fb-4af8-b8f1-ab049f506481-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-m94p4" (UID: "7b3e5c0e-90fb-4af8-b8f1-ab049f506481") : secret "monitoring-plugin-cert" not found
Jul 18 01:49:54.945624 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:54.945564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k982r\" (UniqueName: \"kubernetes.io/projected/7b3e5c0e-90fb-4af8-b8f1-ab049f506481-kube-api-access-k982r\") pod \"monitoring-plugin-7b7b7bc8bf-m94p4\" (UID: \"7b3e5c0e-90fb-4af8-b8f1-ab049f506481\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:55.442861 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:55.442821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3e5c0e-90fb-4af8-b8f1-ab049f506481-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m94p4\" (UID: \"7b3e5c0e-90fb-4af8-b8f1-ab049f506481\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:55.445950 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:55.445916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3e5c0e-90fb-4af8-b8f1-ab049f506481-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m94p4\" (UID: \"7b3e5c0e-90fb-4af8-b8f1-ab049f506481\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:55.622641 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:55.622606    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:55.765560 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:55.765531    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"]
Jul 18 01:49:55.894969 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:55.894929    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b3e5c0e_90fb_4af8_b8f1_ab049f506481.slice/crio-c3121049a126ca54304257dda024014d826af8d0852532a192b09d9c362452ad WatchSource:0}: Error finding container c3121049a126ca54304257dda024014d826af8d0852532a192b09d9c362452ad: Status 404 returned error can't find the container with id c3121049a126ca54304257dda024014d826af8d0852532a192b09d9c362452ad
Jul 18 01:49:56.153089 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.153060    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:49:56.175224 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.175193    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:49:56.175360 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.175300    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.178314 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.178290    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 01:49:56.178435 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.178309    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 01:49:56.178435 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.178380    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 01:49:56.178595 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.178309    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 01:49:56.179439 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.179419    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 01:49:56.179553 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.179497    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 18 01:49:56.179553 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.179505    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 01:49:56.179553 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.179527    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 01:49:56.179716 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.179553    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 01:49:56.179716 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.179625    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 01:49:56.179845 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.179832    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 01:49:56.179965 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.179951    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hgbdx\""
Jul 18 01:49:56.180122 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.180100    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ce4qj5g2ao3o4\""
Jul 18 01:49:56.180166 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.180115    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 01:49:56.180740 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.180721    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 01:49:56.183667 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.183644    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 01:49:56.185741 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.185717    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 01:49:56.250335 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250301    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250449 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250449 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/338ddee9-fe8d-4477-9a1d-4f5f40685c66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250449 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250595 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250595 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/338ddee9-fe8d-4477-9a1d-4f5f40685c66-config-out\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250595 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250595 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250595 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250595 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250804 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250804 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-web-config\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250804 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz5kp\" (UniqueName: \"kubernetes.io/projected/338ddee9-fe8d-4477-9a1d-4f5f40685c66-kube-api-access-fz5kp\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250804 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250804 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250804 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250804 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250804 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.250804 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-config\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.251074 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.250821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.263501 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.263471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4" event={"ID":"7b3e5c0e-90fb-4af8-b8f1-ab049f506481","Type":"ContainerStarted","Data":"c3121049a126ca54304257dda024014d826af8d0852532a192b09d9c362452ad"}
Jul 18 01:49:56.265853 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.265832    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4" event={"ID":"adff932f-0cfc-407f-911c-fd191fbac351","Type":"ContainerStarted","Data":"a7c00b5d3885480a63872904a5e54c3f8e7d982e2e24a8790a94469a65351b45"}
Jul 18 01:49:56.265927 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.265882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4" event={"ID":"adff932f-0cfc-407f-911c-fd191fbac351","Type":"ContainerStarted","Data":"0df6966cfff508ab0029be34de61a86ff396d22e66d91260b61e265d5061484d"}
Jul 18 01:49:56.351989 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.351953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/338ddee9-fe8d-4477-9a1d-4f5f40685c66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.351989 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.351991    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.351989 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.352009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.352258 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.352118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/338ddee9-fe8d-4477-9a1d-4f5f40685c66-config-out\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.352258 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.352137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.352258 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.352165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.352258 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.352189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.352258 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.352222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.352626 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.352577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.352769 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.352633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-web-config\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.352769 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.352669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz5kp\" (UniqueName: \"kubernetes.io/projected/338ddee9-fe8d-4477-9a1d-4f5f40685c66-kube-api-access-fz5kp\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.354446 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.353743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.354446 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.353961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.354633 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.354591    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.354812 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.352707    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.354812 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.354748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.354812 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.354787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.354984 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.354827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.354984 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.354870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.354984 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.354907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-config\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.354984 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.354945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.355165 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.354991    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.355165 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.355016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.356098 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.355801    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.358677 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.356926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.358677 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.357598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.358677 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.357881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.359253 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.359230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.360227 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.360205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/338ddee9-fe8d-4477-9a1d-4f5f40685c66-config-out\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.360662 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.360630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.362396 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.362359    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/338ddee9-fe8d-4477-9a1d-4f5f40685c66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.365968 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.365383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/338ddee9-fe8d-4477-9a1d-4f5f40685c66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.365968 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.365553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-config\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.365968 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.365869    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-web-config\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.365968 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.365914    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.366213 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.366118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.366267 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.366252    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.367082 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.367046    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.368215 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.368192    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz5kp\" (UniqueName: \"kubernetes.io/projected/338ddee9-fe8d-4477-9a1d-4f5f40685c66-kube-api-access-fz5kp\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.368388 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.368362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/338ddee9-fe8d-4477-9a1d-4f5f40685c66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"338ddee9-fe8d-4477-9a1d-4f5f40685c66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.487817 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.487729    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:56.684605 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:56.684557    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:49:56.687194 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:49:56.687164    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338ddee9_fe8d_4477_9a1d_4f5f40685c66.slice/crio-8e64c5a483b369dab9179a9129a618705390a03e4794f68ab1778ac23a56596f WatchSource:0}: Error finding container 8e64c5a483b369dab9179a9129a618705390a03e4794f68ab1778ac23a56596f: Status 404 returned error can't find the container with id 8e64c5a483b369dab9179a9129a618705390a03e4794f68ab1778ac23a56596f
Jul 18 01:49:57.272073 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:57.272030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4" event={"ID":"adff932f-0cfc-407f-911c-fd191fbac351","Type":"ContainerStarted","Data":"083bc8cbf90d5659ad10a2ea4e35f98c837ae74086057504c8618b6420839a08"}
Jul 18 01:49:57.273604 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:57.273570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"338ddee9-fe8d-4477-9a1d-4f5f40685c66","Type":"ContainerStarted","Data":"8e64c5a483b369dab9179a9129a618705390a03e4794f68ab1778ac23a56596f"}
Jul 18 01:49:58.279050 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:58.279022    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4" event={"ID":"adff932f-0cfc-407f-911c-fd191fbac351","Type":"ContainerStarted","Data":"667d41008c705f3799514ca393f1c6a46e57344fd993836679e9d5036ebc6e76"}
Jul 18 01:49:58.280758 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:58.280739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4" event={"ID":"7b3e5c0e-90fb-4af8-b8f1-ab049f506481","Type":"ContainerStarted","Data":"ae20f8fa197e6a5ff7b34a7d5425ab0d0e6b07e0553e0c0675173cf19e995b7c"}
Jul 18 01:49:58.301194 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:58.301156    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:58.306983 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:58.306959    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4"
Jul 18 01:49:58.317228 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:58.317172    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m94p4" podStartSLOduration=2.261492888 podStartE2EDuration="4.317157276s" totalImagesPullingTime="2.055664388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:58.315498635 +0000 UTC m=+94.117743094" watchObservedRunningTime="2026-07-18 01:49:58.317157276 +0000 UTC m=+94.119401777"
Jul 18 01:49:59.287670 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:59.287632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4" event={"ID":"adff932f-0cfc-407f-911c-fd191fbac351","Type":"ContainerStarted","Data":"16e58da52aab2e8c3bc8f4b137b800ea3c2c13aa1982c25e2fbe6838c077942d"}
Jul 18 01:49:59.288129 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:59.287718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4" event={"ID":"adff932f-0cfc-407f-911c-fd191fbac351","Type":"ContainerStarted","Data":"2477408f76042486fbc22f76605089df638c09f3370fe455f585b6e49766fa50"}
Jul 18 01:49:59.288129 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:59.287766    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:49:59.289130 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:59.289106    2560 generic.go:356] "Generic (PLEG): container finished" podID="338ddee9-fe8d-4477-9a1d-4f5f40685c66" containerID="2d478523023906edbe5865102f326ff6fd3dfb5f4a6b6661e4e87208386927fa" exitCode=0
Jul 18 01:49:59.289225 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:59.289143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"338ddee9-fe8d-4477-9a1d-4f5f40685c66","Type":"ContainerDied","Data":"2d478523023906edbe5865102f326ff6fd3dfb5f4a6b6661e4e87208386927fa"}
Jul 18 01:49:59.314904 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:49:59.314857    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4" podStartSLOduration=3.204491586 podStartE2EDuration="7.314841437s" totalImagesPullingTime="4.110349851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:59.313141734 +0000 UTC m=+95.115386208" watchObservedRunningTime="2026-07-18 01:49:59.314841437 +0000 UTC m=+95.117085914"
Jul 18 01:50:02.303678 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:02.303652    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"338ddee9-fe8d-4477-9a1d-4f5f40685c66","Type":"ContainerStarted","Data":"306d8659d08f0fd5ec1c6a5e8223b20412ac028cdbd6fbd82aae91b668773581"}
Jul 18 01:50:03.310489 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:03.310450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"338ddee9-fe8d-4477-9a1d-4f5f40685c66","Type":"ContainerStarted","Data":"f2f7531fa5bb0bd270a359e26bfa6778c5f8f3b7b5444e794b67178f7384c6d3"}
Jul 18 01:50:03.310849 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:03.310513    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"338ddee9-fe8d-4477-9a1d-4f5f40685c66","Type":"ContainerStarted","Data":"f28f9626cea521f1cb70293da61b7b19717acf36a798f848ec1153f7cc4cb31d"}
Jul 18 01:50:03.310849 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:03.310540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"338ddee9-fe8d-4477-9a1d-4f5f40685c66","Type":"ContainerStarted","Data":"4d5184876e07a79f3d3fc3283f55105fe1e8792f1b6db44de099eab5eab0c3cf"}
Jul 18 01:50:03.310849 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:03.310562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"338ddee9-fe8d-4477-9a1d-4f5f40685c66","Type":"ContainerStarted","Data":"8fe12876f9fe623b44dc9b566c303a34232a2d30cbcc0e86df78946d894860fd"}
Jul 18 01:50:03.310849 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:03.310591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"338ddee9-fe8d-4477-9a1d-4f5f40685c66","Type":"ContainerStarted","Data":"7d9194ad1951eb68cac07dd92ca0c68a1dab9e3ed15b1eebe39264c1b84e113d"}
Jul 18 01:50:03.342487 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:03.342438    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.838584473 podStartE2EDuration="7.34241696s" totalImagesPullingTime="4.470062208s" totalInitContainerRuntime="33.770279ms" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:50:03.339713372 +0000 UTC m=+99.141957848" watchObservedRunningTime="2026-07-18 01:50:03.34241696 +0000 UTC m=+99.144661422"
Jul 18 01:50:05.300176 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:05.300147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-679f7dcd9c-jhtc4"
Jul 18 01:50:05.786410 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:05.786376    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66568dd586-r89lm"]
Jul 18 01:50:06.488692 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:06.488656    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:08.197801 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:08.197769    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nw226"
Jul 18 01:50:16.444119 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:16.444064    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t5zbz_d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b/serve-healthcheck-canary/0.log"
Jul 18 01:50:30.806588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:30.806541    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66568dd586-r89lm" podUID="eb6a1f7d-1b91-427b-ac4c-d1388393a998" containerName="console" containerID="cri-o://83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7" gracePeriod=15
Jul 18 01:50:31.037711 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.037680    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:50:31.144016 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.143934    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cqv6\" (UniqueName: \"kubernetes.io/projected/eb6a1f7d-1b91-427b-ac4c-d1388393a998-kube-api-access-6cqv6\") pod \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") "
Jul 18 01:50:31.144016 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.143974    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-serving-cert\") pod \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") "
Jul 18 01:50:31.144016 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.143998    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-config\") pod \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") "
Jul 18 01:50:31.144274 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.144022    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-service-ca\") pod \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") "
Jul 18 01:50:31.144274 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.144056    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-oauth-config\") pod \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") "
Jul 18 01:50:31.144274 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.144095    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-trusted-ca-bundle\") pod \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") "
Jul 18 01:50:31.144274 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.144263    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-oauth-serving-cert\") pod \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\" (UID: \"eb6a1f7d-1b91-427b-ac4c-d1388393a998\") "
Jul 18 01:50:31.144663 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.144503    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-service-ca" (OuterVolumeSpecName: "service-ca") pod "eb6a1f7d-1b91-427b-ac4c-d1388393a998" (UID: "eb6a1f7d-1b91-427b-ac4c-d1388393a998"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:31.144729 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.144513    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-config" (OuterVolumeSpecName: "console-config") pod "eb6a1f7d-1b91-427b-ac4c-d1388393a998" (UID: "eb6a1f7d-1b91-427b-ac4c-d1388393a998"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:31.144812 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.144559    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eb6a1f7d-1b91-427b-ac4c-d1388393a998" (UID: "eb6a1f7d-1b91-427b-ac4c-d1388393a998"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:31.144812 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.144617    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eb6a1f7d-1b91-427b-ac4c-d1388393a998" (UID: "eb6a1f7d-1b91-427b-ac4c-d1388393a998"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:31.145007 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.144988    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-trusted-ca-bundle\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 01:50:31.145046 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.145015    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-oauth-serving-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 01:50:31.145046 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.145031    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-config\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 01:50:31.145116 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.145045    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6a1f7d-1b91-427b-ac4c-d1388393a998-service-ca\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 01:50:31.146564 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.146540    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eb6a1f7d-1b91-427b-ac4c-d1388393a998" (UID: "eb6a1f7d-1b91-427b-ac4c-d1388393a998"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:31.146851 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.146822    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eb6a1f7d-1b91-427b-ac4c-d1388393a998" (UID: "eb6a1f7d-1b91-427b-ac4c-d1388393a998"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:31.146851 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.146841    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb6a1f7d-1b91-427b-ac4c-d1388393a998-kube-api-access-6cqv6" (OuterVolumeSpecName: "kube-api-access-6cqv6") pod "eb6a1f7d-1b91-427b-ac4c-d1388393a998" (UID: "eb6a1f7d-1b91-427b-ac4c-d1388393a998"). InnerVolumeSpecName "kube-api-access-6cqv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:50:31.246233 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.246197    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cqv6\" (UniqueName: \"kubernetes.io/projected/eb6a1f7d-1b91-427b-ac4c-d1388393a998-kube-api-access-6cqv6\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 01:50:31.246233 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.246225    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-serving-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 01:50:31.246233 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.246234    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb6a1f7d-1b91-427b-ac4c-d1388393a998-console-oauth-config\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 01:50:31.419448 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.419369    2560 generic.go:356] "Generic (PLEG): container finished" podID="eb6a1f7d-1b91-427b-ac4c-d1388393a998" containerID="83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7" exitCode=0
Jul 18 01:50:31.419448 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.419424    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66568dd586-r89lm"
Jul 18 01:50:31.419616 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.419456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66568dd586-r89lm" event={"ID":"eb6a1f7d-1b91-427b-ac4c-d1388393a998","Type":"ContainerDied","Data":"83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7"}
Jul 18 01:50:31.419616 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.419536    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66568dd586-r89lm" event={"ID":"eb6a1f7d-1b91-427b-ac4c-d1388393a998","Type":"ContainerDied","Data":"9fee6906ebce6fb8d74cd4938c6ab54eaf60cb7ca8b4f7fcc566a03db230a718"}
Jul 18 01:50:31.419616 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.419568    2560 scope.go:117] "RemoveContainer" containerID="83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7"
Jul 18 01:50:31.428092 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.428073    2560 scope.go:117] "RemoveContainer" containerID="83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7"
Jul 18 01:50:31.428372 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:50:31.428352    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7\": container with ID starting with 83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7 not found: ID does not exist" containerID="83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7"
Jul 18 01:50:31.428433 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.428383    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7"} err="failed to get container status \"83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7\": rpc error: code = NotFound desc = could not find container \"83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7\": container with ID starting with 83f65e211bfdc266d48616b6738a48a2094e69f4f903b40ba61098e0b960fee7 not found: ID does not exist"
Jul 18 01:50:31.439783 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.439760    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66568dd586-r89lm"]
Jul 18 01:50:31.443143 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:31.443123    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66568dd586-r89lm"]
Jul 18 01:50:32.743900 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:32.743870    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb6a1f7d-1b91-427b-ac4c-d1388393a998" path="/var/lib/kubelet/pods/eb6a1f7d-1b91-427b-ac4c-d1388393a998/volumes"
Jul 18 01:50:56.488105 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:56.488067    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:56.507952 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:56.507928    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:56.523970 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:50:56.523946    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:53:00.905856 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.905779    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-twf76"]
Jul 18 01:53:00.906314 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.906053    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb6a1f7d-1b91-427b-ac4c-d1388393a998" containerName="console"
Jul 18 01:53:00.906314 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.906067    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb6a1f7d-1b91-427b-ac4c-d1388393a998" containerName="console"
Jul 18 01:53:00.906314 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.906129    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb6a1f7d-1b91-427b-ac4c-d1388393a998" containerName="console"
Jul 18 01:53:00.908016 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.908001    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76"
Jul 18 01:53:00.910662 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.910644    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 18 01:53:00.910750 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.910730    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 18 01:53:00.911747 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.911724    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vvmsm\""
Jul 18 01:53:00.917257 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.917233    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-twf76"]
Jul 18 01:53:00.945358 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.945334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-twf76\" (UID: \"fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76"
Jul 18 01:53:00.945496 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:00.945407    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29kmf\" (UniqueName: \"kubernetes.io/projected/fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae-kube-api-access-29kmf\") pod \"cert-manager-cainjector-559cdd8c87-twf76\" (UID: \"fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76"
Jul 18 01:53:01.045908 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:01.045867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-twf76\" (UID: \"fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76"
Jul 18 01:53:01.046072 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:01.045938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29kmf\" (UniqueName: \"kubernetes.io/projected/fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae-kube-api-access-29kmf\") pod \"cert-manager-cainjector-559cdd8c87-twf76\" (UID: \"fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76"
Jul 18 01:53:01.054110 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:01.054087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29kmf\" (UniqueName: \"kubernetes.io/projected/fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae-kube-api-access-29kmf\") pod \"cert-manager-cainjector-559cdd8c87-twf76\" (UID: \"fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76"
Jul 18 01:53:01.054219 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:01.054122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-twf76\" (UID: \"fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76"
Jul 18 01:53:01.227249 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:01.227169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76"
Jul 18 01:53:01.353813 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:01.353783    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-twf76"]
Jul 18 01:53:01.356840 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:53:01.356816    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcd0bf3b_39e0_4f95_8077_fe9ae12f29ae.slice/crio-e8a3e4bb5d2a22068d31753a5a0642bc30919ac8e38e9a5d980f27e6072e5be0 WatchSource:0}: Error finding container e8a3e4bb5d2a22068d31753a5a0642bc30919ac8e38e9a5d980f27e6072e5be0: Status 404 returned error can't find the container with id e8a3e4bb5d2a22068d31753a5a0642bc30919ac8e38e9a5d980f27e6072e5be0
Jul 18 01:53:01.952955 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:01.952914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76" event={"ID":"fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae","Type":"ContainerStarted","Data":"e8a3e4bb5d2a22068d31753a5a0642bc30919ac8e38e9a5d980f27e6072e5be0"}
Jul 18 01:53:04.965984 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:04.965950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76" event={"ID":"fcd0bf3b-39e0-4f95-8077-fe9ae12f29ae","Type":"ContainerStarted","Data":"712156f8b3cec534189e080c7e1c6cbaa93335ef9658fbe80a565fd7c10f1ba7"}
Jul 18 01:53:04.996953 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:04.996904    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-twf76" podStartSLOduration=2.096672316 podStartE2EDuration="4.996887596s" totalImagesPullingTime="2.90021528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:53:04.996820005 +0000 UTC m=+280.799064473" watchObservedRunningTime="2026-07-18 01:53:04.996887596 +0000 UTC m=+280.799132055"
Jul 18 01:53:08.165242 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.165209    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m7l8s"]
Jul 18 01:53:08.167526 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.167509    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m7l8s"
Jul 18 01:53:08.170545 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.170520    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4kbbx\""
Jul 18 01:53:08.180412 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.180392    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m7l8s"]
Jul 18 01:53:08.201394 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.201372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7jdc\" (UniqueName: \"kubernetes.io/projected/06e42022-14db-438c-b4fe-cb1cd91f3968-kube-api-access-x7jdc\") pod \"cert-manager-55b4d954d5-m7l8s\" (UID: \"06e42022-14db-438c-b4fe-cb1cd91f3968\") " pod="cert-manager/cert-manager-55b4d954d5-m7l8s"
Jul 18 01:53:08.201511 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.201409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06e42022-14db-438c-b4fe-cb1cd91f3968-bound-sa-token\") pod \"cert-manager-55b4d954d5-m7l8s\" (UID: \"06e42022-14db-438c-b4fe-cb1cd91f3968\") " pod="cert-manager/cert-manager-55b4d954d5-m7l8s"
Jul 18 01:53:08.301813 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.301781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7jdc\" (UniqueName: \"kubernetes.io/projected/06e42022-14db-438c-b4fe-cb1cd91f3968-kube-api-access-x7jdc\") pod \"cert-manager-55b4d954d5-m7l8s\" (UID: \"06e42022-14db-438c-b4fe-cb1cd91f3968\") " pod="cert-manager/cert-manager-55b4d954d5-m7l8s"
Jul 18 01:53:08.301956 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.301827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06e42022-14db-438c-b4fe-cb1cd91f3968-bound-sa-token\") pod \"cert-manager-55b4d954d5-m7l8s\" (UID: \"06e42022-14db-438c-b4fe-cb1cd91f3968\") " pod="cert-manager/cert-manager-55b4d954d5-m7l8s"
Jul 18 01:53:08.311950 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.311925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06e42022-14db-438c-b4fe-cb1cd91f3968-bound-sa-token\") pod \"cert-manager-55b4d954d5-m7l8s\" (UID: \"06e42022-14db-438c-b4fe-cb1cd91f3968\") " pod="cert-manager/cert-manager-55b4d954d5-m7l8s"
Jul 18 01:53:08.312066 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.312005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7jdc\" (UniqueName: \"kubernetes.io/projected/06e42022-14db-438c-b4fe-cb1cd91f3968-kube-api-access-x7jdc\") pod \"cert-manager-55b4d954d5-m7l8s\" (UID: \"06e42022-14db-438c-b4fe-cb1cd91f3968\") " pod="cert-manager/cert-manager-55b4d954d5-m7l8s"
Jul 18 01:53:08.476426 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.476314    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m7l8s"
Jul 18 01:53:08.628800 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.628766    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m7l8s"]
Jul 18 01:53:08.632554 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:53:08.632525    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06e42022_14db_438c_b4fe_cb1cd91f3968.slice/crio-5fc92c8c11b572a5bbad733871c1bbf424381cb61aa39e7a2bc9ece03f038e53 WatchSource:0}: Error finding container 5fc92c8c11b572a5bbad733871c1bbf424381cb61aa39e7a2bc9ece03f038e53: Status 404 returned error can't find the container with id 5fc92c8c11b572a5bbad733871c1bbf424381cb61aa39e7a2bc9ece03f038e53
Jul 18 01:53:08.982030 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.981995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m7l8s" event={"ID":"06e42022-14db-438c-b4fe-cb1cd91f3968","Type":"ContainerStarted","Data":"202738df437dd540c7cf16ca3d0eac30679dce4977333a2d6a6f3e11b531efa5"}
Jul 18 01:53:08.982204 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:08.982044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m7l8s" event={"ID":"06e42022-14db-438c-b4fe-cb1cd91f3968","Type":"ContainerStarted","Data":"5fc92c8c11b572a5bbad733871c1bbf424381cb61aa39e7a2bc9ece03f038e53"}
Jul 18 01:53:09.001568 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:09.001521    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-m7l8s" podStartSLOduration=1.001507628 podStartE2EDuration="1.001507628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:53:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:53:09.000492925 +0000 UTC m=+284.802737411" watchObservedRunningTime="2026-07-18 01:53:09.001507628 +0000 UTC m=+284.803752085"
Jul 18 01:53:24.554194 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:24.554167    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 01:53:24.558133 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:24.558098    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 01:53:24.561269 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:24.561249    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 18 01:53:30.722936 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.722899    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"]
Jul 18 01:53:30.725401 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.725382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.729763 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.729747    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 18 01:53:30.730723 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.730707    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8n9fz\""
Jul 18 01:53:30.731245 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.731225    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 18 01:53:30.731710 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.731350    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 18 01:53:30.731710 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.731395    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 18 01:53:30.755416 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.755390    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"]
Jul 18 01:53:30.774930 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.774896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsc5z\" (UniqueName: \"kubernetes.io/projected/6f8ebde1-915e-420b-8864-8716b46aedb3-kube-api-access-xsc5z\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.775057 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.774932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f8ebde1-915e-420b-8864-8716b46aedb3-tmp\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.775057 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.774958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f8ebde1-915e-420b-8864-8716b46aedb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.775140 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.775048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f8ebde1-915e-420b-8864-8716b46aedb3-manifests\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.775140 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.775104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f8ebde1-915e-420b-8864-8716b46aedb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.875972 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.875944    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f8ebde1-915e-420b-8864-8716b46aedb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.876095 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.875988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f8ebde1-915e-420b-8864-8716b46aedb3-manifests\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.876095 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.876025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f8ebde1-915e-420b-8864-8716b46aedb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.876095 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.876054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsc5z\" (UniqueName: \"kubernetes.io/projected/6f8ebde1-915e-420b-8864-8716b46aedb3-kube-api-access-xsc5z\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.876095 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.876071    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f8ebde1-915e-420b-8864-8716b46aedb3-tmp\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.876474 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.876452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f8ebde1-915e-420b-8864-8716b46aedb3-manifests\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.878628 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.878603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f8ebde1-915e-420b-8864-8716b46aedb3-tmp\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.878739 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.878724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f8ebde1-915e-420b-8864-8716b46aedb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.878790 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.878769    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f8ebde1-915e-420b-8864-8716b46aedb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:30.884451 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:30.884432    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsc5z\" (UniqueName: \"kubernetes.io/projected/6f8ebde1-915e-420b-8864-8716b46aedb3-kube-api-access-xsc5z\") pod \"opendatahub-operator-controller-manager-6b7456dd48-lbfs7\" (UID: \"6f8ebde1-915e-420b-8864-8716b46aedb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:31.034936 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:31.034904    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:31.185779 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:31.185746    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"]
Jul 18 01:53:31.192947 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:53:31.192918    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8ebde1_915e_420b_8864_8716b46aedb3.slice/crio-985dc48ed7ec77c345688d51d9edaf107df31ac4519f465b63967a6fdefc8666 WatchSource:0}: Error finding container 985dc48ed7ec77c345688d51d9edaf107df31ac4519f465b63967a6fdefc8666: Status 404 returned error can't find the container with id 985dc48ed7ec77c345688d51d9edaf107df31ac4519f465b63967a6fdefc8666
Jul 18 01:53:31.194802 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:31.194782    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:53:32.064571 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:32.064525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7" event={"ID":"6f8ebde1-915e-420b-8864-8716b46aedb3","Type":"ContainerStarted","Data":"985dc48ed7ec77c345688d51d9edaf107df31ac4519f465b63967a6fdefc8666"}
Jul 18 01:53:34.073101 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:34.073064    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7" event={"ID":"6f8ebde1-915e-420b-8864-8716b46aedb3","Type":"ContainerStarted","Data":"91d5479a0a7ea05107e95fb4912e006d41b8164f53cfd4799c62dd0e0234490e"}
Jul 18 01:53:36.082216 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:36.082184    2560 generic.go:356] "Generic (PLEG): container finished" podID="6f8ebde1-915e-420b-8864-8716b46aedb3" containerID="91d5479a0a7ea05107e95fb4912e006d41b8164f53cfd4799c62dd0e0234490e" exitCode=0
Jul 18 01:53:36.082618 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:36.082250    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7" event={"ID":"6f8ebde1-915e-420b-8864-8716b46aedb3","Type":"ContainerDied","Data":"91d5479a0a7ea05107e95fb4912e006d41b8164f53cfd4799c62dd0e0234490e"}
Jul 18 01:53:37.092434 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:37.092397    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7" event={"ID":"6f8ebde1-915e-420b-8864-8716b46aedb3","Type":"ContainerStarted","Data":"bb919f09cbc7501a229dafc0c3c452bc91df1f3568d05a7a95c27320599529eb"}
Jul 18 01:53:37.092850 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:37.092737    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:37.119882 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:37.119834    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7" podStartSLOduration=2.822008711 podStartE2EDuration="7.119820694s" totalImagesPullingTime="3.222707907s" totalInitContainerRuntime="1.075104076s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:53:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:53:37.11773738 +0000 UTC m=+312.919981830" watchObservedRunningTime="2026-07-18 01:53:37.119820694 +0000 UTC m=+312.922065151"
Jul 18 01:53:48.097785 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:48.097754    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b7456dd48-lbfs7"
Jul 18 01:53:50.446973 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.446941    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"]
Jul 18 01:53:50.455791 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.455761    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.459200 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.459173    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 18 01:53:50.459458 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.459442    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2j52c\""
Jul 18 01:53:50.460409 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.460394    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 18 01:53:50.460521 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.460413    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 18 01:53:50.460521 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.460433    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 18 01:53:50.472406 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.472386    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"]
Jul 18 01:53:50.633596 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.633563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/721c48c1-82f0-4fbc-9742-3fa9a4ccc90c-tmp\") pod \"kube-auth-proxy-58f5976ff9-zt5c5\" (UID: \"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c\") " pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.633735 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.633615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhjdh\" (UniqueName: \"kubernetes.io/projected/721c48c1-82f0-4fbc-9742-3fa9a4ccc90c-kube-api-access-mhjdh\") pod \"kube-auth-proxy-58f5976ff9-zt5c5\" (UID: \"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c\") " pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.633735 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.633648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721c48c1-82f0-4fbc-9742-3fa9a4ccc90c-tls-certs\") pod \"kube-auth-proxy-58f5976ff9-zt5c5\" (UID: \"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c\") " pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.734524 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.734456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhjdh\" (UniqueName: \"kubernetes.io/projected/721c48c1-82f0-4fbc-9742-3fa9a4ccc90c-kube-api-access-mhjdh\") pod \"kube-auth-proxy-58f5976ff9-zt5c5\" (UID: \"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c\") " pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.734524 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.734494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721c48c1-82f0-4fbc-9742-3fa9a4ccc90c-tls-certs\") pod \"kube-auth-proxy-58f5976ff9-zt5c5\" (UID: \"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c\") " pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.734698 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.734677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/721c48c1-82f0-4fbc-9742-3fa9a4ccc90c-tmp\") pod \"kube-auth-proxy-58f5976ff9-zt5c5\" (UID: \"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c\") " pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.736897 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.736875    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/721c48c1-82f0-4fbc-9742-3fa9a4ccc90c-tmp\") pod \"kube-auth-proxy-58f5976ff9-zt5c5\" (UID: \"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c\") " pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.737001 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.736970    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721c48c1-82f0-4fbc-9742-3fa9a4ccc90c-tls-certs\") pod \"kube-auth-proxy-58f5976ff9-zt5c5\" (UID: \"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c\") " pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.749152 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.749132    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhjdh\" (UniqueName: \"kubernetes.io/projected/721c48c1-82f0-4fbc-9742-3fa9a4ccc90c-kube-api-access-mhjdh\") pod \"kube-auth-proxy-58f5976ff9-zt5c5\" (UID: \"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c\") " pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.765154 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.765131    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"
Jul 18 01:53:50.898125 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:50.898100    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5"]
Jul 18 01:53:50.900656 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:53:50.900631    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721c48c1_82f0_4fbc_9742_3fa9a4ccc90c.slice/crio-43db0f3b896b89acfe92427f7313321ce62248990384a61d1764430ad5dda071 WatchSource:0}: Error finding container 43db0f3b896b89acfe92427f7313321ce62248990384a61d1764430ad5dda071: Status 404 returned error can't find the container with id 43db0f3b896b89acfe92427f7313321ce62248990384a61d1764430ad5dda071
Jul 18 01:53:51.145781 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:51.145744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5" event={"ID":"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c","Type":"ContainerStarted","Data":"43db0f3b896b89acfe92427f7313321ce62248990384a61d1764430ad5dda071"}
Jul 18 01:53:54.160105 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:54.160071    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5" event={"ID":"721c48c1-82f0-4fbc-9742-3fa9a4ccc90c","Type":"ContainerStarted","Data":"86963e4c9107eda2a4b6a47bff95f34a67675e0f9e74947fad580ae737b76a7f"}
Jul 18 01:53:54.177531 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:54.177483    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58f5976ff9-zt5c5" podStartSLOduration=1.933404796 podStartE2EDuration="4.177470556s" totalImagesPullingTime="2.24406576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:53:54.175864686 +0000 UTC m=+329.978109159" watchObservedRunningTime="2026-07-18 01:53:54.177470556 +0000 UTC m=+329.979715043"
Jul 18 01:53:58.378200 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.378169    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"]
Jul 18 01:53:58.380471 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.380457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.385073 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.385040    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 01:53:58.385191 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.385156    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hqqw7\""
Jul 18 01:53:58.421860 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.421831    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"]
Jul 18 01:53:58.495504 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.495477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/605944b1-eb34-4528-80d9-a573fb24fc48-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.495643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.495524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.495643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.495539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.495643 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.495564    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.495811 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.495670    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.495811 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.495707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/605944b1-eb34-4528-80d9-a573fb24fc48-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.495811 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.495735    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnd8l\" (UniqueName: \"kubernetes.io/projected/605944b1-eb34-4528-80d9-a573fb24fc48-kube-api-access-hnd8l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.495811 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.495784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.495965 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.495814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/605944b1-eb34-4528-80d9-a573fb24fc48-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.596638 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.596615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.596753 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.596643    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.596753 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.596661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/605944b1-eb34-4528-80d9-a573fb24fc48-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.596753 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.596677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnd8l\" (UniqueName: \"kubernetes.io/projected/605944b1-eb34-4528-80d9-a573fb24fc48-kube-api-access-hnd8l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.596753 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.596702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.596753 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.596723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/605944b1-eb34-4528-80d9-a573fb24fc48-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.596988 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.596788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/605944b1-eb34-4528-80d9-a573fb24fc48-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.596988 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.596833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.596988 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.596853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.597127 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.597084    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.597216 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.597193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.597279 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.597230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.597367 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.597286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.597500 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.597472    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/605944b1-eb34-4528-80d9-a573fb24fc48-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.599241 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.599221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/605944b1-eb34-4528-80d9-a573fb24fc48-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.599300 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.599252    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/605944b1-eb34-4528-80d9-a573fb24fc48-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.608124 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.608103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/605944b1-eb34-4528-80d9-a573fb24fc48-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.608201 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.608167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnd8l\" (UniqueName: \"kubernetes.io/projected/605944b1-eb34-4528-80d9-a573fb24fc48-kube-api-access-hnd8l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4497w9\" (UID: \"605944b1-eb34-4528-80d9-a573fb24fc48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.690271 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.690213    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:53:58.859228 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:58.859196    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"]
Jul 18 01:53:58.863573 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:53:58.863545    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605944b1_eb34_4528_80d9_a573fb24fc48.slice/crio-38c2615f3ab76238de417fcd4542656ac8ed421f13ac5c1d751f47921f9f3aee WatchSource:0}: Error finding container 38c2615f3ab76238de417fcd4542656ac8ed421f13ac5c1d751f47921f9f3aee: Status 404 returned error can't find the container with id 38c2615f3ab76238de417fcd4542656ac8ed421f13ac5c1d751f47921f9f3aee
Jul 18 01:53:59.182391 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:53:59.182358    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9" event={"ID":"605944b1-eb34-4528-80d9-a573fb24fc48","Type":"ContainerStarted","Data":"38c2615f3ab76238de417fcd4542656ac8ed421f13ac5c1d751f47921f9f3aee"}
Jul 18 01:54:00.609213 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.609183    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"]
Jul 18 01:54:00.613848 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.613828    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.622263 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.622220    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 18 01:54:00.622385 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.622291    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 18 01:54:00.623536 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.623512    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9t7v9\""
Jul 18 01:54:00.623536 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.623542    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 18 01:54:00.623713 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.623547    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:54:00.623713 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.623634    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 18 01:54:00.635021 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.634996    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"]
Jul 18 01:54:00.715467 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.715434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3de54db0-45cc-4579-af0d-2e08ebf426df-cert\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.715620 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.715516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3de54db0-45cc-4579-af0d-2e08ebf426df-metrics-cert\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.715620 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.715539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3de54db0-45cc-4579-af0d-2e08ebf426df-manager-config\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.715620 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.715558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8rwg\" (UniqueName: \"kubernetes.io/projected/3de54db0-45cc-4579-af0d-2e08ebf426df-kube-api-access-f8rwg\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.816875 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.816846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3de54db0-45cc-4579-af0d-2e08ebf426df-metrics-cert\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.817044 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.816880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3de54db0-45cc-4579-af0d-2e08ebf426df-manager-config\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.817044 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.816902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8rwg\" (UniqueName: \"kubernetes.io/projected/3de54db0-45cc-4579-af0d-2e08ebf426df-kube-api-access-f8rwg\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.817044 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.816969    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3de54db0-45cc-4579-af0d-2e08ebf426df-cert\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.817799 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.817598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3de54db0-45cc-4579-af0d-2e08ebf426df-manager-config\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.819831 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.819795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3de54db0-45cc-4579-af0d-2e08ebf426df-cert\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.819831 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.819795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3de54db0-45cc-4579-af0d-2e08ebf426df-metrics-cert\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.826008 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.825986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8rwg\" (UniqueName: \"kubernetes.io/projected/3de54db0-45cc-4579-af0d-2e08ebf426df-kube-api-access-f8rwg\") pod \"lws-controller-manager-6c55bb847-2f66t\" (UID: \"3de54db0-45cc-4579-af0d-2e08ebf426df\") " pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:00.924159 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:00.924088    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:01.629474 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:01.629439    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 01:54:01.629759 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:01.629514    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 01:54:01.629759 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:01.629545    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 01:54:01.691199 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:01.691176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"]
Jul 18 01:54:01.694024 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:54:01.693985    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de54db0_45cc_4579_af0d_2e08ebf426df.slice/crio-a83893433509f999c3da58e964d13427f6edc3a8304039669fe367c6eda2312f WatchSource:0}: Error finding container a83893433509f999c3da58e964d13427f6edc3a8304039669fe367c6eda2312f: Status 404 returned error can't find the container with id a83893433509f999c3da58e964d13427f6edc3a8304039669fe367c6eda2312f
Jul 18 01:54:02.195889 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:02.195850    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t" event={"ID":"3de54db0-45cc-4579-af0d-2e08ebf426df","Type":"ContainerStarted","Data":"a83893433509f999c3da58e964d13427f6edc3a8304039669fe367c6eda2312f"}
Jul 18 01:54:02.197433 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:02.197401    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9" event={"ID":"605944b1-eb34-4528-80d9-a573fb24fc48","Type":"ContainerStarted","Data":"ec8bd6402d4a6ee65170defea7eeb156beb57a66b913c7cd438d329ecadeef3e"}
Jul 18 01:54:02.233638 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:02.233577    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9" podStartSLOduration=1.470030343 podStartE2EDuration="4.233562923s" totalImagesPullingTime="2.76353258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:54:02.231249389 +0000 UTC m=+338.033493845" watchObservedRunningTime="2026-07-18 01:54:02.233562923 +0000 UTC m=+338.035807380"
Jul 18 01:54:02.690574 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:02.690533    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:54:02.696294 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:02.696258    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:54:03.204190 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:03.204161    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:54:03.205529 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:03.205502    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4497w9"
Jul 18 01:54:05.213686 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:05.213649    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t" event={"ID":"3de54db0-45cc-4579-af0d-2e08ebf426df","Type":"ContainerStarted","Data":"fd977ce69744e239142a915137f9c6ab3a929aa371ea649ab36fee55f6a4e87c"}
Jul 18 01:54:05.236128 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:05.236078    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t" podStartSLOduration=2.699678387 podStartE2EDuration="5.236059354s" totalImagesPullingTime="2.536380967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:54:05.235430539 +0000 UTC m=+341.037675001" watchObservedRunningTime="2026-07-18 01:54:05.236059354 +0000 UTC m=+341.038303810"
Jul 18 01:54:06.218515 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:06.218488    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:54:17.224642 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:54:17.224572    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c55bb847-2f66t"
Jul 18 01:56:23.038637 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.038608    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"]
Jul 18 01:56:23.041095 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.041080    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.043534 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.043515    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-srmrg\""
Jul 18 01:56:23.053588 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.053566    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"]
Jul 18 01:56:23.174619 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.174587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.174619 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.174619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62b950dd-353d-4df8-9875-7d768f409083-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.174790 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.174646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.174790 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.174706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.174790 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.174744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.174790 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.174766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.174790 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.174788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62b950dd-353d-4df8-9875-7d768f409083-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.174966 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.174831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62b950dd-353d-4df8-9875-7d768f409083-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.174966 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.174853    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdnsp\" (UniqueName: \"kubernetes.io/projected/62b950dd-353d-4df8-9875-7d768f409083-kube-api-access-sdnsp\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.275820 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.275789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.275954 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.275825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62b950dd-353d-4df8-9875-7d768f409083-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.275954 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.275863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.275954 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.275887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.275954 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.275913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.275954 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.275936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.276202 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.275958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62b950dd-353d-4df8-9875-7d768f409083-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.276202 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.276011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62b950dd-353d-4df8-9875-7d768f409083-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.276202 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.276042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdnsp\" (UniqueName: \"kubernetes.io/projected/62b950dd-353d-4df8-9875-7d768f409083-kube-api-access-sdnsp\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.276471 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.276349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.276471 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.276455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.276574 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.276455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.276574 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.276454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.276840 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.276821    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62b950dd-353d-4df8-9875-7d768f409083-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.278969 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.278950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62b950dd-353d-4df8-9875-7d768f409083-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.279072 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.278994    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62b950dd-353d-4df8-9875-7d768f409083-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.288077 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.288055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62b950dd-353d-4df8-9875-7d768f409083-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.288405 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.288390    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdnsp\" (UniqueName: \"kubernetes.io/projected/62b950dd-353d-4df8-9875-7d768f409083-kube-api-access-sdnsp\") pod \"maas-default-gateway-openshift-default-56654dcf7-66j7n\" (UID: \"62b950dd-353d-4df8-9875-7d768f409083\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.350721 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.350672    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:23.483664 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.483606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"]
Jul 18 01:56:23.485733 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:56:23.485709    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b950dd_353d_4df8_9875_7d768f409083.slice/crio-ed93eed2fbc22abe0257899e51f95636d9163f4400e91030d6a686b2f4e59ca6 WatchSource:0}: Error finding container ed93eed2fbc22abe0257899e51f95636d9163f4400e91030d6a686b2f4e59ca6: Status 404 returned error can't find the container with id ed93eed2fbc22abe0257899e51f95636d9163f4400e91030d6a686b2f4e59ca6
Jul 18 01:56:23.487668 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.487638    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 01:56:23.487760 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.487704    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 01:56:23.487760 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.487733    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 01:56:23.789920 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.789887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n" event={"ID":"62b950dd-353d-4df8-9875-7d768f409083","Type":"ContainerStarted","Data":"10d6b2cef6ebf8baa69c7a4ce4828c2590f6bf7464519a4c02917c7065411bad"}
Jul 18 01:56:23.790081 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.789948    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n" event={"ID":"62b950dd-353d-4df8-9875-7d768f409083","Type":"ContainerStarted","Data":"ed93eed2fbc22abe0257899e51f95636d9163f4400e91030d6a686b2f4e59ca6"}
Jul 18 01:56:23.811484 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:23.811437    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n" podStartSLOduration=0.811424121 podStartE2EDuration="811.424121ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:56:23.809566107 +0000 UTC m=+479.611810564" watchObservedRunningTime="2026-07-18 01:56:23.811424121 +0000 UTC m=+479.613668577"
Jul 18 01:56:24.351271 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:24.351246    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:24.356163 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:24.356140    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:24.793609 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:24.793584    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:24.794511 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:24.794491    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:56:25.373771 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.373734    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-96ddbb554-cw6zs"]
Jul 18 01:56:25.376526 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.376503    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.380157 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.380138    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 18 01:56:25.382587 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.382559    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 18 01:56:25.382667 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.382651    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 18 01:56:25.382734 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.382565    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 18 01:56:25.382824 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.382797    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 18 01:56:25.382897 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.382812    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 18 01:56:25.383380 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.383361    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tffsz\""
Jul 18 01:56:25.386938 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.386918    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 18 01:56:25.389394 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.389378    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 18 01:56:25.399054 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.399033    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96ddbb554-cw6zs"]
Jul 18 01:56:25.494601 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.494580    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-console-config\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.494725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.494639    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4kwb\" (UniqueName: \"kubernetes.io/projected/81a65f11-27ac-46a2-9e07-0d739a07a9ff-kube-api-access-m4kwb\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.494725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.494668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-oauth-serving-cert\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.494725 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.494716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-trusted-ca-bundle\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.494874 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.494773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81a65f11-27ac-46a2-9e07-0d739a07a9ff-console-oauth-config\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.494874 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.494811    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81a65f11-27ac-46a2-9e07-0d739a07a9ff-console-serving-cert\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.494874 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.494839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-service-ca\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.595437 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.595415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4kwb\" (UniqueName: \"kubernetes.io/projected/81a65f11-27ac-46a2-9e07-0d739a07a9ff-kube-api-access-m4kwb\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.595562 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.595442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-oauth-serving-cert\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.595562 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.595473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-trusted-ca-bundle\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.595562 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.595498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81a65f11-27ac-46a2-9e07-0d739a07a9ff-console-oauth-config\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.595562 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.595524    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81a65f11-27ac-46a2-9e07-0d739a07a9ff-console-serving-cert\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.595562 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.595553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-service-ca\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.595808 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.595599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-console-config\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.596221 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.596201    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-oauth-serving-cert\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.596387 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.596366    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-console-config\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.596447 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.596385    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-trusted-ca-bundle\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.596483 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.596460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81a65f11-27ac-46a2-9e07-0d739a07a9ff-service-ca\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.597930 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.597913    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81a65f11-27ac-46a2-9e07-0d739a07a9ff-console-oauth-config\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.598052 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.598032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81a65f11-27ac-46a2-9e07-0d739a07a9ff-console-serving-cert\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.603502 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.603479    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4kwb\" (UniqueName: \"kubernetes.io/projected/81a65f11-27ac-46a2-9e07-0d739a07a9ff-kube-api-access-m4kwb\") pod \"console-96ddbb554-cw6zs\" (UID: \"81a65f11-27ac-46a2-9e07-0d739a07a9ff\") " pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.686493 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.686438    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:25.823449 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.823408    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96ddbb554-cw6zs"]
Jul 18 01:56:25.825465 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:56:25.825438    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a65f11_27ac_46a2_9e07_0d739a07a9ff.slice/crio-ee37a6e40a0b283017ea04c78cadf6ba10033d7857ff032fd7feea87d6e0f4bb WatchSource:0}: Error finding container ee37a6e40a0b283017ea04c78cadf6ba10033d7857ff032fd7feea87d6e0f4bb: Status 404 returned error can't find the container with id ee37a6e40a0b283017ea04c78cadf6ba10033d7857ff032fd7feea87d6e0f4bb
Jul 18 01:56:25.901062 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.901036    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-k944d"]
Jul 18 01:56:25.903813 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.903771    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k944d"
Jul 18 01:56:25.906527 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.906508    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zklft\""
Jul 18 01:56:25.906527 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.906520    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 01:56:25.906688 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.906508    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 01:56:25.913291 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.913270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k944d"]
Jul 18 01:56:25.999689 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:25.999620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pvm5\" (UniqueName: \"kubernetes.io/projected/b765df46-31dd-45be-93e9-92643c7a973d-kube-api-access-8pvm5\") pod \"authorino-75d556bd77-k944d\" (UID: \"b765df46-31dd-45be-93e9-92643c7a973d\") " pod="kuadrant-system/authorino-75d556bd77-k944d"
Jul 18 01:56:26.100893 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:26.100863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pvm5\" (UniqueName: \"kubernetes.io/projected/b765df46-31dd-45be-93e9-92643c7a973d-kube-api-access-8pvm5\") pod \"authorino-75d556bd77-k944d\" (UID: \"b765df46-31dd-45be-93e9-92643c7a973d\") " pod="kuadrant-system/authorino-75d556bd77-k944d"
Jul 18 01:56:26.109511 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:26.109486    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pvm5\" (UniqueName: \"kubernetes.io/projected/b765df46-31dd-45be-93e9-92643c7a973d-kube-api-access-8pvm5\") pod \"authorino-75d556bd77-k944d\" (UID: \"b765df46-31dd-45be-93e9-92643c7a973d\") " pod="kuadrant-system/authorino-75d556bd77-k944d"
Jul 18 01:56:26.213018 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:26.212973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k944d"
Jul 18 01:56:26.338402 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:26.338380    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k944d"]
Jul 18 01:56:26.340043 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:56:26.340022    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb765df46_31dd_45be_93e9_92643c7a973d.slice/crio-774828f0c1e2bbfc617da353734200e3d5b37378e5be8fd3405978a42b5e1e72 WatchSource:0}: Error finding container 774828f0c1e2bbfc617da353734200e3d5b37378e5be8fd3405978a42b5e1e72: Status 404 returned error can't find the container with id 774828f0c1e2bbfc617da353734200e3d5b37378e5be8fd3405978a42b5e1e72
Jul 18 01:56:26.807791 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:26.807761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k944d" event={"ID":"b765df46-31dd-45be-93e9-92643c7a973d","Type":"ContainerStarted","Data":"774828f0c1e2bbfc617da353734200e3d5b37378e5be8fd3405978a42b5e1e72"}
Jul 18 01:56:26.809279 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:26.809252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96ddbb554-cw6zs" event={"ID":"81a65f11-27ac-46a2-9e07-0d739a07a9ff","Type":"ContainerStarted","Data":"b2d67c2ec64c5b36cacb1f07d3ba9203e164e6a8f8540d87c1d04f83dccbd296"}
Jul 18 01:56:26.809442 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:26.809306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96ddbb554-cw6zs" event={"ID":"81a65f11-27ac-46a2-9e07-0d739a07a9ff","Type":"ContainerStarted","Data":"ee37a6e40a0b283017ea04c78cadf6ba10033d7857ff032fd7feea87d6e0f4bb"}
Jul 18 01:56:29.827091 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:29.827052    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k944d" event={"ID":"b765df46-31dd-45be-93e9-92643c7a973d","Type":"ContainerStarted","Data":"7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6"}
Jul 18 01:56:29.842258 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:29.842217    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-96ddbb554-cw6zs" podStartSLOduration=4.842204031 podStartE2EDuration="4.842204031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:56:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:56:26.84066777 +0000 UTC m=+482.642912424" watchObservedRunningTime="2026-07-18 01:56:29.842204031 +0000 UTC m=+485.644448488"
Jul 18 01:56:29.842854 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:29.842827    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-k944d" podStartSLOduration=1.963698871 podStartE2EDuration="4.842817871s" totalImagesPullingTime="2.879119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:56:29.841850318 +0000 UTC m=+485.644094785" watchObservedRunningTime="2026-07-18 01:56:29.842817871 +0000 UTC m=+485.645062327"
Jul 18 01:56:35.687089 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:35.687053    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:35.687662 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:35.687127    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:35.691857 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:35.691828    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:35.855219 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:35.855195    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-96ddbb554-cw6zs"
Jul 18 01:56:54.851708 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:54.851680    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k944d"]
Jul 18 01:56:54.852099 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:54.851839    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-k944d" podUID="b765df46-31dd-45be-93e9-92643c7a973d" containerName="authorino" containerID="cri-o://7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6" gracePeriod=30
Jul 18 01:56:55.090039 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.090017    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k944d"
Jul 18 01:56:55.130852 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.130800    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pvm5\" (UniqueName: \"kubernetes.io/projected/b765df46-31dd-45be-93e9-92643c7a973d-kube-api-access-8pvm5\") pod \"b765df46-31dd-45be-93e9-92643c7a973d\" (UID: \"b765df46-31dd-45be-93e9-92643c7a973d\") "
Jul 18 01:56:55.132884 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.132867    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b765df46-31dd-45be-93e9-92643c7a973d-kube-api-access-8pvm5" (OuterVolumeSpecName: "kube-api-access-8pvm5") pod "b765df46-31dd-45be-93e9-92643c7a973d" (UID: "b765df46-31dd-45be-93e9-92643c7a973d"). InnerVolumeSpecName "kube-api-access-8pvm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:56:55.231546 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.231521    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pvm5\" (UniqueName: \"kubernetes.io/projected/b765df46-31dd-45be-93e9-92643c7a973d-kube-api-access-8pvm5\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 01:56:55.936869 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.936841    2560 generic.go:356] "Generic (PLEG): container finished" podID="b765df46-31dd-45be-93e9-92643c7a973d" containerID="7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6" exitCode=0
Jul 18 01:56:55.937309 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.936880    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-k944d"
Jul 18 01:56:55.937309 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.936885    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k944d" event={"ID":"b765df46-31dd-45be-93e9-92643c7a973d","Type":"ContainerDied","Data":"7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6"}
Jul 18 01:56:55.937309 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.936911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-k944d" event={"ID":"b765df46-31dd-45be-93e9-92643c7a973d","Type":"ContainerDied","Data":"774828f0c1e2bbfc617da353734200e3d5b37378e5be8fd3405978a42b5e1e72"}
Jul 18 01:56:55.937309 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.936926    2560 scope.go:117] "RemoveContainer" containerID="7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6"
Jul 18 01:56:55.945494 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.945473    2560 scope.go:117] "RemoveContainer" containerID="7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6"
Jul 18 01:56:55.945776 ip-10-0-128-229 kubenswrapper[2560]: E0718 01:56:55.945759    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6\": container with ID starting with 7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6 not found: ID does not exist" containerID="7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6"
Jul 18 01:56:55.945842 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.945785    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6"} err="failed to get container status \"7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6\": rpc error: code = NotFound desc = could not find container \"7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6\": container with ID starting with 7d616f1927ae001f88ac81d1c37c47e7a5355a70e96431c0222a1951b79001a6 not found: ID does not exist"
Jul 18 01:56:55.960625 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.960606    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k944d"]
Jul 18 01:56:55.967632 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:55.967613    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-k944d"]
Jul 18 01:56:56.744932 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:56:56.744900    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b765df46-31dd-45be-93e9-92643c7a973d" path="/var/lib/kubelet/pods/b765df46-31dd-45be-93e9-92643c7a973d/volumes"
Jul 18 01:57:45.153125 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:45.153096    2560 generic.go:356] "Generic (PLEG): container finished" podID="62b950dd-353d-4df8-9875-7d768f409083" containerID="10d6b2cef6ebf8baa69c7a4ce4828c2590f6bf7464519a4c02917c7065411bad" exitCode=0
Jul 18 01:57:45.153556 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:45.153178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n" event={"ID":"62b950dd-353d-4df8-9875-7d768f409083","Type":"ContainerDied","Data":"10d6b2cef6ebf8baa69c7a4ce4828c2590f6bf7464519a4c02917c7065411bad"}
Jul 18 01:57:45.153686 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:45.153670    2560 scope.go:117] "RemoveContainer" containerID="10d6b2cef6ebf8baa69c7a4ce4828c2590f6bf7464519a4c02917c7065411bad"
Jul 18 01:57:45.154701 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:45.154673    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 01:57:45.154766 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:45.154740    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 01:57:45.154809 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:45.154771    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 01:57:46.159397 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:46.159361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n" event={"ID":"62b950dd-353d-4df8-9875-7d768f409083","Type":"ContainerStarted","Data":"34b8772203530175faebcaead9547e23df4ce95a45e74c1c188a3990bcc8ca90"}
Jul 18 01:57:46.351037 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:46.350999    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:57:46.351274 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:46.351251    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-66j7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body=
Jul 18 01:57:46.351375 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:46.351298    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n" podUID="62b950dd-353d-4df8-9875-7d768f409083" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused"
Jul 18 01:57:47.351896 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:47.351861    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-66j7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body=
Jul 18 01:57:47.352287 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:47.351918    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n" podUID="62b950dd-353d-4df8-9875-7d768f409083" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused"
Jul 18 01:57:48.350951 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:48.350914    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-66j7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body=
Jul 18 01:57:48.351116 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:48.350967    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n" podUID="62b950dd-353d-4df8-9875-7d768f409083" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused"
Jul 18 01:57:49.351041 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:49.351009    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-66j7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body=
Jul 18 01:57:49.351454 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:49.351058    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n" podUID="62b950dd-353d-4df8-9875-7d768f409083" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused"
Jul 18 01:57:50.355453 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:50.355421    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:57:50.355880 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:50.355684    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:57:50.356570 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:57:50.356552    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-66j7n"
Jul 18 01:58:09.972169 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:09.972125    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"]
Jul 18 01:58:09.972799 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:09.972778    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b765df46-31dd-45be-93e9-92643c7a973d" containerName="authorino"
Jul 18 01:58:09.972846 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:09.972803    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b765df46-31dd-45be-93e9-92643c7a973d" containerName="authorino"
Jul 18 01:58:09.972912 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:09.972898    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b765df46-31dd-45be-93e9-92643c7a973d" containerName="authorino"
Jul 18 01:58:09.976336 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:09.976296    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:09.980185 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:09.980152    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tfrql\""
Jul 18 01:58:09.980352 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:09.980237    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 18 01:58:09.980352 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:09.980165    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 18 01:58:09.980352 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:09.980305    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 18 01:58:09.984229 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:09.984130    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"]
Jul 18 01:58:10.039884 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.039857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.039997 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.039894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.039997 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.039950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzzt9\" (UniqueName: \"kubernetes.io/projected/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-kube-api-access-vzzt9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.039997 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.039988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.040100 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.040025    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.040100 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.040047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.140644 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.140619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.140766 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.140665    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.140766 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.140701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.140766 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.140745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzzt9\" (UniqueName: \"kubernetes.io/projected/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-kube-api-access-vzzt9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.140907 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.140782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.140907 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.140807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.141005 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.140973    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.141066 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.141043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.141204 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.141183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.143146 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.143127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.143474 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.143455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.148970 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.148936    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzzt9\" (UniqueName: \"kubernetes.io/projected/49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351-kube-api-access-vzzt9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88\" (UID: \"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.287268 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.287243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:10.423671 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:10.423648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"]
Jul 18 01:58:10.426348 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:58:10.426307    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d4d1b1_9d4b_4e3d_a8d2_d6eeae561351.slice/crio-1425f72725db035a53722cd32d12868d5026609558c4a4111697ad67117a46b6 WatchSource:0}: Error finding container 1425f72725db035a53722cd32d12868d5026609558c4a4111697ad67117a46b6: Status 404 returned error can't find the container with id 1425f72725db035a53722cd32d12868d5026609558c4a4111697ad67117a46b6
Jul 18 01:58:11.268496 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:11.268460    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88" event={"ID":"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351","Type":"ContainerStarted","Data":"1425f72725db035a53722cd32d12868d5026609558c4a4111697ad67117a46b6"}
Jul 18 01:58:12.274551 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:12.274494    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88" event={"ID":"49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351","Type":"ContainerStarted","Data":"6fb8c537b17e144581d00f1cc474c58c3a9a8b30b2c4e23f42e8888003d2b448"}
Jul 18 01:58:20.288350 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:20.288281    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:20.288803 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:20.288424    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:20.301461 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:20.301430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:20.321019 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:20.320962    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88" podStartSLOduration=10.32320576 podStartE2EDuration="11.320944003s" totalImagesPullingTime="997.738243ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:58:12.309128499 +0000 UTC m=+588.111372957" watchObservedRunningTime="2026-07-18 01:58:20.320944003 +0000 UTC m=+596.123188461"
Jul 18 01:58:20.321804 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:20.321782    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88"
Jul 18 01:58:22.562220 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.562175    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"]
Jul 18 01:58:22.565712 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.565690    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.568261 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.568227    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 18 01:58:22.575290 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.575227    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"]
Jul 18 01:58:22.645197 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.645166    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.645345 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.645210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wgpp\" (UniqueName: \"kubernetes.io/projected/94e5f98a-7073-4907-9343-e51c02d33d73-kube-api-access-4wgpp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.645345 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.645234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94e5f98a-7073-4907-9343-e51c02d33d73-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.645345 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.645262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.645345 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.645291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.645488 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.645412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.745708 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.745685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.745831 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.745715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.745831 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.745742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.745831 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.745788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.745831 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.745807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wgpp\" (UniqueName: \"kubernetes.io/projected/94e5f98a-7073-4907-9343-e51c02d33d73-kube-api-access-4wgpp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.745831 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.745824    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94e5f98a-7073-4907-9343-e51c02d33d73-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.746119 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.746099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.746186 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.746133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.746260 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.746245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.748235 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.748211    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94e5f98a-7073-4907-9343-e51c02d33d73-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.748387 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.748371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94e5f98a-7073-4907-9343-e51c02d33d73-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.762376 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.762349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wgpp\" (UniqueName: \"kubernetes.io/projected/94e5f98a-7073-4907-9343-e51c02d33d73-kube-api-access-4wgpp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ttv97\" (UID: \"94e5f98a-7073-4907-9343-e51c02d33d73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:22.877042 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:22.876973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:23.007558 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:23.007533    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"]
Jul 18 01:58:23.009572 ip-10-0-128-229 kubenswrapper[2560]: W0718 01:58:23.009542    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e5f98a_7073_4907_9343_e51c02d33d73.slice/crio-c905d073a3266d1a75a93cc00eedc131de7ca8942a348fe3390d24d01512fde4 WatchSource:0}: Error finding container c905d073a3266d1a75a93cc00eedc131de7ca8942a348fe3390d24d01512fde4: Status 404 returned error can't find the container with id c905d073a3266d1a75a93cc00eedc131de7ca8942a348fe3390d24d01512fde4
Jul 18 01:58:23.326123 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:23.326086    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97" event={"ID":"94e5f98a-7073-4907-9343-e51c02d33d73","Type":"ContainerStarted","Data":"efbe3f4059fdd4a4908179473d08fd75be97c6a0383422ac5b75ad30b34dc452"}
Jul 18 01:58:23.326275 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:23.326133    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97" event={"ID":"94e5f98a-7073-4907-9343-e51c02d33d73","Type":"ContainerStarted","Data":"c905d073a3266d1a75a93cc00eedc131de7ca8942a348fe3390d24d01512fde4"}
Jul 18 01:58:23.343763 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:23.343720    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97" podStartSLOduration=1.19680945 podStartE2EDuration="1.343706354s" totalImagesPullingTime="146.896904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:58:23.342053808 +0000 UTC m=+599.144298265" watchObservedRunningTime="2026-07-18 01:58:23.343706354 +0000 UTC m=+599.145950812"
Jul 18 01:58:24.583741 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:24.583716    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 01:58:24.584136 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:24.584077    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 01:58:32.877963 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:32.877928    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:32.878511 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:32.878023    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:32.891373 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:32.891300    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 01:58:33.381208 ip-10-0-128-229 kubenswrapper[2560]: I0718 01:58:33.381175    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ttv97"
Jul 18 02:00:00.144257 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:00.144221    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739000-85fvz"]
Jul 18 02:00:00.147193 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:00.147176    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739000-85fvz"
Jul 18 02:00:00.150121 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:00.150098    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vpdlz\""
Jul 18 02:00:00.156719 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:00.156607    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739000-85fvz"]
Jul 18 02:00:00.157385 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:00.157368    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739000-85fvz"
Jul 18 02:00:00.287711 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:00.287666    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739000-85fvz"]
Jul 18 02:00:00.290810 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:00:00.290779    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda440a4a3_e29e_48c1_a957_4ccdfaa3c5e5.slice/crio-c3591964d1d4a6af36b65b8f1d9557f92cb5295d150e5eb440e19b0ef24f2cda WatchSource:0}: Error finding container c3591964d1d4a6af36b65b8f1d9557f92cb5295d150e5eb440e19b0ef24f2cda: Status 404 returned error can't find the container with id c3591964d1d4a6af36b65b8f1d9557f92cb5295d150e5eb440e19b0ef24f2cda
Jul 18 02:00:00.292816 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:00.292796    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:00:00.750135 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:00.750099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739000-85fvz" event={"ID":"a440a4a3-e29e-48c1-a957-4ccdfaa3c5e5","Type":"ContainerStarted","Data":"c3591964d1d4a6af36b65b8f1d9557f92cb5295d150e5eb440e19b0ef24f2cda"}
Jul 18 02:00:04.296842 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.296809    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77b54c8556-6wmv6"]
Jul 18 02:00:04.300015 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.299996    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77b54c8556-6wmv6"
Jul 18 02:00:04.302580 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.302560    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zklft\""
Jul 18 02:00:04.303768 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.303747    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 18 02:00:04.303866 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.303769    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 02:00:04.303866 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.303752    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 02:00:04.308581 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.308558    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77b54c8556-6wmv6"]
Jul 18 02:00:04.422515 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.422481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx2sn\" (UniqueName: \"kubernetes.io/projected/c4541dcc-369f-45a5-abbc-b2135b609cc1-kube-api-access-sx2sn\") pod \"authorino-77b54c8556-6wmv6\" (UID: \"c4541dcc-369f-45a5-abbc-b2135b609cc1\") " pod="kuadrant-system/authorino-77b54c8556-6wmv6"
Jul 18 02:00:04.422664 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.422548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4541dcc-369f-45a5-abbc-b2135b609cc1-tls-cert\") pod \"authorino-77b54c8556-6wmv6\" (UID: \"c4541dcc-369f-45a5-abbc-b2135b609cc1\") " pod="kuadrant-system/authorino-77b54c8556-6wmv6"
Jul 18 02:00:04.523577 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.523551    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4541dcc-369f-45a5-abbc-b2135b609cc1-tls-cert\") pod \"authorino-77b54c8556-6wmv6\" (UID: \"c4541dcc-369f-45a5-abbc-b2135b609cc1\") " pod="kuadrant-system/authorino-77b54c8556-6wmv6"
Jul 18 02:00:04.523694 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.523599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx2sn\" (UniqueName: \"kubernetes.io/projected/c4541dcc-369f-45a5-abbc-b2135b609cc1-kube-api-access-sx2sn\") pod \"authorino-77b54c8556-6wmv6\" (UID: \"c4541dcc-369f-45a5-abbc-b2135b609cc1\") " pod="kuadrant-system/authorino-77b54c8556-6wmv6"
Jul 18 02:00:04.526032 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.526006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4541dcc-369f-45a5-abbc-b2135b609cc1-tls-cert\") pod \"authorino-77b54c8556-6wmv6\" (UID: \"c4541dcc-369f-45a5-abbc-b2135b609cc1\") " pod="kuadrant-system/authorino-77b54c8556-6wmv6"
Jul 18 02:00:04.531265 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.531245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx2sn\" (UniqueName: \"kubernetes.io/projected/c4541dcc-369f-45a5-abbc-b2135b609cc1-kube-api-access-sx2sn\") pod \"authorino-77b54c8556-6wmv6\" (UID: \"c4541dcc-369f-45a5-abbc-b2135b609cc1\") " pod="kuadrant-system/authorino-77b54c8556-6wmv6"
Jul 18 02:00:04.609233 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.609217    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77b54c8556-6wmv6"
Jul 18 02:00:04.749737 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.749717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77b54c8556-6wmv6"]
Jul 18 02:00:04.751821 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:00:04.751797    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4541dcc_369f_45a5_abbc_b2135b609cc1.slice/crio-e08617c43ebe61956caa8d0989ec28726f3478b0b3a8562cf823ed3218c5aecb WatchSource:0}: Error finding container e08617c43ebe61956caa8d0989ec28726f3478b0b3a8562cf823ed3218c5aecb: Status 404 returned error can't find the container with id e08617c43ebe61956caa8d0989ec28726f3478b0b3a8562cf823ed3218c5aecb
Jul 18 02:00:04.769411 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.769379    2560 generic.go:356] "Generic (PLEG): container finished" podID="a440a4a3-e29e-48c1-a957-4ccdfaa3c5e5" containerID="7fb15886b6f4272f0fea234d4e3d6e04cad242d05343779f9f4dcdf22482053c" exitCode=0
Jul 18 02:00:04.769513 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.769461    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739000-85fvz" event={"ID":"a440a4a3-e29e-48c1-a957-4ccdfaa3c5e5","Type":"ContainerDied","Data":"7fb15886b6f4272f0fea234d4e3d6e04cad242d05343779f9f4dcdf22482053c"}
Jul 18 02:00:04.770694 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:04.770673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77b54c8556-6wmv6" event={"ID":"c4541dcc-369f-45a5-abbc-b2135b609cc1","Type":"ContainerStarted","Data":"e08617c43ebe61956caa8d0989ec28726f3478b0b3a8562cf823ed3218c5aecb"}
Jul 18 02:00:05.777805 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:05.777761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77b54c8556-6wmv6" event={"ID":"c4541dcc-369f-45a5-abbc-b2135b609cc1","Type":"ContainerStarted","Data":"4cbac4997ff7f63635d41bb1e97113afdcb55f753bc746cf23cff262e7de8721"}
Jul 18 02:00:05.805140 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:05.805081    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77b54c8556-6wmv6" podStartSLOduration=1.264654463 podStartE2EDuration="1.805064135s" totalImagesPullingTime="540.409672ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:00:05.804072289 +0000 UTC m=+701.606316746" watchObservedRunningTime="2026-07-18 02:00:05.805064135 +0000 UTC m=+701.607308591"
Jul 18 02:00:05.939611 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:05.939583    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739000-85fvz"
Jul 18 02:00:06.783506 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:06.783476    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739000-85fvz"
Jul 18 02:00:06.783897 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:06.783511    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739000-85fvz" event={"ID":"a440a4a3-e29e-48c1-a957-4ccdfaa3c5e5","Type":"ContainerDied","Data":"c3591964d1d4a6af36b65b8f1d9557f92cb5295d150e5eb440e19b0ef24f2cda"}
Jul 18 02:00:06.783897 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:00:06.783563    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3591964d1d4a6af36b65b8f1d9557f92cb5295d150e5eb440e19b0ef24f2cda"
Jul 18 02:03:24.612797 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:03:24.612724    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:03:24.612797 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:03:24.612758    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:08:24.648421 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:08:24.648390    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:08:24.654688 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:08:24.654663    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:13:24.681438 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:13:24.681305    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:13:24.686162 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:13:24.686143    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:14:24.318271 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.318234    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"]
Jul 18 02:14:24.318823 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.318720    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a440a4a3-e29e-48c1-a957-4ccdfaa3c5e5" containerName="cleanup"
Jul 18 02:14:24.318823 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.318740    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a440a4a3-e29e-48c1-a957-4ccdfaa3c5e5" containerName="cleanup"
Jul 18 02:14:24.318902 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.318834    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a440a4a3-e29e-48c1-a957-4ccdfaa3c5e5" containerName="cleanup"
Jul 18 02:14:24.321794 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.321778    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.324287 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.324265    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5536ee23-openshift-default-dockercfg-dn4cs\""
Jul 18 02:14:24.344593 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.344564    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"]
Jul 18 02:14:24.364256 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.364231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-socket\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.364375 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.364266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqpbg\" (UniqueName: \"kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-kube-api-access-bqpbg\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.364375 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.364346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-token\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.364459 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.364379    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-podinfo\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.364459 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.364408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-envoy\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.364459 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.364448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-certs\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.364552 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.364464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09072601-0c7e-4c30-9580-f49807ebd4ec-istiod-ca-cert\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.364552 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.364508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-credential-socket\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.364552 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.364523    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-data\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.465784 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.465751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-certs\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.465784 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.465783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09072601-0c7e-4c30-9580-f49807ebd4ec-istiod-ca-cert\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466067 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.465807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-credential-socket\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466067 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.465825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-data\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466067 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.465886    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-socket\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466067 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.465916    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqpbg\" (UniqueName: \"kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-kube-api-access-bqpbg\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466067 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.465957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-token\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466067 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.465989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-podinfo\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466067 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.466018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-envoy\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466422 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.466207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-certs\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466422 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.466265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-credential-socket\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466422 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.466396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-data\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466522 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.466458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-socket\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.466681 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.466659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09072601-0c7e-4c30-9580-f49807ebd4ec-istiod-ca-cert\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.468583 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.468560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-envoy\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.468738 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.468718    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-podinfo\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.473920 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.473895    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-token\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.474164 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.474145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqpbg\" (UniqueName: \"kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-kube-api-access-bqpbg\") pod \"e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") " pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.634494 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.634442    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5536ee23-openshift-default-dockercfg-dn4cs\""
Jul 18 02:14:24.642593 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.642572    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:24.780020 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.779996    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"]
Jul 18 02:14:24.781996 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:14:24.781972    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09072601_0c7e_4c30_9580_f49807ebd4ec.slice/crio-c7cba20a029889132f0594388e538fec87e1465a7e6929ea91ea700e72052ca3 WatchSource:0}: Error finding container c7cba20a029889132f0594388e538fec87e1465a7e6929ea91ea700e72052ca3: Status 404 returned error can't find the container with id c7cba20a029889132f0594388e538fec87e1465a7e6929ea91ea700e72052ca3
Jul 18 02:14:24.783949 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.783918    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:14:24.784027 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.783981    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:14:24.784027 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:24.784009    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:14:25.738785 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:25.738748    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" event={"ID":"09072601-0c7e-4c30-9580-f49807ebd4ec","Type":"ContainerStarted","Data":"c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2"}
Jul 18 02:14:25.739222 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:25.738805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" event={"ID":"09072601-0c7e-4c30-9580-f49807ebd4ec","Type":"ContainerStarted","Data":"c7cba20a029889132f0594388e538fec87e1465a7e6929ea91ea700e72052ca3"}
Jul 18 02:14:25.762305 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:25.762255    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" podStartSLOduration=1.762241645 podStartE2EDuration="1.762241645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:14:25.760980417 +0000 UTC m=+1561.563224908" watchObservedRunningTime="2026-07-18 02:14:25.762241645 +0000 UTC m=+1561.564486102"
Jul 18 02:14:26.643352 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:26.643269    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:26.648695 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:26.648668    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:26.745233 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:26.745204    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:26.745625 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:26.745267    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:40.809120 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:40.809092    2560 generic.go:356] "Generic (PLEG): container finished" podID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerID="c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2" exitCode=0
Jul 18 02:14:40.809590 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:40.809159    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" event={"ID":"09072601-0c7e-4c30-9580-f49807ebd4ec","Type":"ContainerDied","Data":"c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2"}
Jul 18 02:14:40.809590 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:40.809506    2560 scope.go:117] "RemoveContainer" containerID="c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2"
Jul 18 02:14:40.810463 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:40.810432    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:14:40.810556 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:40.810510    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:14:40.810556 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:40.810542    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:14:41.744232 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:41.744197    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:41.818400 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:41.818358    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" event={"ID":"09072601-0c7e-4c30-9580-f49807ebd4ec","Type":"ContainerStarted","Data":"8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4"}
Jul 18 02:14:42.642784 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:42.642749    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:42.643718 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:42.643687    2560 patch_prober.go:28] interesting pod/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 18 02:14:42.643832 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:42.643745    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 18 02:14:43.643418 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:43.643379    2560 patch_prober.go:28] interesting pod/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 18 02:14:43.643877 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:43.643444    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 18 02:14:44.643539 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:44.643507    2560 patch_prober.go:28] interesting pod/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 18 02:14:44.643904 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:44.643555    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 18 02:14:45.647010 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:45.646980    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:45.647387 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:45.647312    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:14:45.648059 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:14:45.648038    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:15:07.998490 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:07.998456    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"]
Jul 18 02:15:07.998940 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:07.998694    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerName="istio-proxy" containerID="cri-o://8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4" gracePeriod=30
Jul 18 02:15:09.107177 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.107145    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"]
Jul 18 02:15:09.109525 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.109506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.112168 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.112150    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-8f8edd4c-gw-openshift-default-dockercfg-mh2d8\""
Jul 18 02:15:09.123663 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.123627    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"]
Jul 18 02:15:09.236868 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.236833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sndgk\" (UniqueName: \"kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-kube-api-access-sndgk\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.236868 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.236870    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-credential-socket\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.237062 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.237003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bceec5e4-e315-4420-a175-5300fffdf371-istio-podinfo\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.237110 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.237057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-istio-token\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.237202 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.237111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-envoy\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.237202 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.237165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-certs\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.237202 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.237186    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-data\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.237306 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.237212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bceec5e4-e315-4420-a175-5300fffdf371-istiod-ca-cert\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.237306 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.237260    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-socket\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338114 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bceec5e4-e315-4420-a175-5300fffdf371-istio-podinfo\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-istio-token\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-envoy\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-certs\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-data\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bceec5e4-e315-4420-a175-5300fffdf371-istiod-ca-cert\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-socket\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338571 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sndgk\" (UniqueName: \"kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-kube-api-access-sndgk\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338571 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-credential-socket\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338700 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-certs\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338700 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-data\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338805 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338709    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-socket\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.338805 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.338752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-credential-socket\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.339217 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.339192    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bceec5e4-e315-4420-a175-5300fffdf371-istiod-ca-cert\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.340792 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.340773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bceec5e4-e315-4420-a175-5300fffdf371-istio-podinfo\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.341093 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.341076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-envoy\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.350144 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.350125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sndgk\" (UniqueName: \"kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-kube-api-access-sndgk\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.350271 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.350230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-istio-token\") pod \"e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") " pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.419508 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.419460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:09.551168 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.551144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"]
Jul 18 02:15:09.553067 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:15:09.553038    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbceec5e4_e315_4420_a175_5300fffdf371.slice/crio-4203b02021dce2416ff29ab2d229a375846259e01a6afc7727c0502138582b7d WatchSource:0}: Error finding container 4203b02021dce2416ff29ab2d229a375846259e01a6afc7727c0502138582b7d: Status 404 returned error can't find the container with id 4203b02021dce2416ff29ab2d229a375846259e01a6afc7727c0502138582b7d
Jul 18 02:15:09.555081 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.555053    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:15:09.555135 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.555111    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:15:09.555167 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.555141    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:15:09.953814 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.953778    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" event={"ID":"bceec5e4-e315-4420-a175-5300fffdf371","Type":"ContainerStarted","Data":"041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578"}
Jul 18 02:15:09.953984 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.953840    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" event={"ID":"bceec5e4-e315-4420-a175-5300fffdf371","Type":"ContainerStarted","Data":"4203b02021dce2416ff29ab2d229a375846259e01a6afc7727c0502138582b7d"}
Jul 18 02:15:09.975518 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:09.975470    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" podStartSLOduration=0.975454852 podStartE2EDuration="975.454852ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:15:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:15:09.972992408 +0000 UTC m=+1605.775236865" watchObservedRunningTime="2026-07-18 02:15:09.975454852 +0000 UTC m=+1605.777699309"
Jul 18 02:15:10.420082 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:10.420048    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:10.424895 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:10.424870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:10.959091 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:10.959062    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:10.960111 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:10.960088    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:13.250644 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.250624    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:15:13.374114 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374047    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-token\") pod \"09072601-0c7e-4c30-9580-f49807ebd4ec\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") "
Jul 18 02:15:13.374247 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-podinfo\") pod \"09072601-0c7e-4c30-9580-f49807ebd4ec\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") "
Jul 18 02:15:13.374247 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374158    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqpbg\" (UniqueName: \"kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-kube-api-access-bqpbg\") pod \"09072601-0c7e-4c30-9580-f49807ebd4ec\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") "
Jul 18 02:15:13.374247 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374175    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-envoy\") pod \"09072601-0c7e-4c30-9580-f49807ebd4ec\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") "
Jul 18 02:15:13.374247 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374195    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-data\") pod \"09072601-0c7e-4c30-9580-f49807ebd4ec\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") "
Jul 18 02:15:13.374431 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374248    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-credential-socket\") pod \"09072601-0c7e-4c30-9580-f49807ebd4ec\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") "
Jul 18 02:15:13.374431 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374271    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09072601-0c7e-4c30-9580-f49807ebd4ec-istiod-ca-cert\") pod \"09072601-0c7e-4c30-9580-f49807ebd4ec\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") "
Jul 18 02:15:13.374431 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-certs\") pod \"09072601-0c7e-4c30-9580-f49807ebd4ec\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") "
Jul 18 02:15:13.374431 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374346    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-socket\") pod \"09072601-0c7e-4c30-9580-f49807ebd4ec\" (UID: \"09072601-0c7e-4c30-9580-f49807ebd4ec\") "
Jul 18 02:15:13.374629 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374595    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09072601-0c7e-4c30-9580-f49807ebd4ec" (UID: "09072601-0c7e-4c30-9580-f49807ebd4ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:15:13.374741 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374691    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:13.374864 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.374785    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09072601-0c7e-4c30-9580-f49807ebd4ec" (UID: "09072601-0c7e-4c30-9580-f49807ebd4ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:15:13.375158 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.375135    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09072601-0c7e-4c30-9580-f49807ebd4ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09072601-0c7e-4c30-9580-f49807ebd4ec" (UID: "09072601-0c7e-4c30-9580-f49807ebd4ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:15:13.375456 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.375149    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09072601-0c7e-4c30-9580-f49807ebd4ec" (UID: "09072601-0c7e-4c30-9580-f49807ebd4ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:15:13.375576 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.375517    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "09072601-0c7e-4c30-9580-f49807ebd4ec" (UID: "09072601-0c7e-4c30-9580-f49807ebd4ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:15:13.376759 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.376736    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09072601-0c7e-4c30-9580-f49807ebd4ec" (UID: "09072601-0c7e-4c30-9580-f49807ebd4ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:15:13.376759 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.376746    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "09072601-0c7e-4c30-9580-f49807ebd4ec" (UID: "09072601-0c7e-4c30-9580-f49807ebd4ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:15:13.376905 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.376860    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-kube-api-access-bqpbg" (OuterVolumeSpecName: "kube-api-access-bqpbg") pod "09072601-0c7e-4c30-9580-f49807ebd4ec" (UID: "09072601-0c7e-4c30-9580-f49807ebd4ec"). InnerVolumeSpecName "kube-api-access-bqpbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:15:13.377103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.377086    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09072601-0c7e-4c30-9580-f49807ebd4ec" (UID: "09072601-0c7e-4c30-9580-f49807ebd4ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:15:13.475812 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.475790    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:13.475812 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.475811    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:13.475941 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.475821    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqpbg\" (UniqueName: \"kubernetes.io/projected/09072601-0c7e-4c30-9580-f49807ebd4ec-kube-api-access-bqpbg\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:13.475941 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.475830    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:13.475941 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.475838    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:13.475941 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.475846    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09072601-0c7e-4c30-9580-f49807ebd4ec-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:13.475941 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.475853    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:13.475941 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.475861    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09072601-0c7e-4c30-9580-f49807ebd4ec-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:13.976476 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.976439    2560 generic.go:356] "Generic (PLEG): container finished" podID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerID="8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4" exitCode=0
Jul 18 02:15:13.976621 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.976494    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"
Jul 18 02:15:13.976621 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.976529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" event={"ID":"09072601-0c7e-4c30-9580-f49807ebd4ec","Type":"ContainerDied","Data":"8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4"}
Jul 18 02:15:13.976621 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.976591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9" event={"ID":"09072601-0c7e-4c30-9580-f49807ebd4ec","Type":"ContainerDied","Data":"c7cba20a029889132f0594388e538fec87e1465a7e6929ea91ea700e72052ca3"}
Jul 18 02:15:13.976621 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.976615    2560 scope.go:117] "RemoveContainer" containerID="8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4"
Jul 18 02:15:13.987123 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.987099    2560 scope.go:117] "RemoveContainer" containerID="c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2"
Jul 18 02:15:13.996768 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.996272    2560 scope.go:117] "RemoveContainer" containerID="8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4"
Jul 18 02:15:13.997214 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:15:13.996888    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4\": container with ID starting with 8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4 not found: ID does not exist" containerID="8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4"
Jul 18 02:15:13.997214 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.996932    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4"} err="failed to get container status \"8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4\": rpc error: code = NotFound desc = could not find container \"8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4\": container with ID starting with 8a3eb4843d0654294abebd0921b421d58a83e5abd1aead807ea4d1ec01f29bf4 not found: ID does not exist"
Jul 18 02:15:13.997214 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.996950    2560 scope.go:117] "RemoveContainer" containerID="c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2"
Jul 18 02:15:13.997214 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:15:13.997204    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2\": container with ID starting with c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2 not found: ID does not exist" containerID="c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2"
Jul 18 02:15:13.997425 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.997226    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2"} err="failed to get container status \"c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2\": rpc error: code = NotFound desc = could not find container \"c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2\": container with ID starting with c9c50e1d4b339b397ca641c26f534db4f44de0f3d8a9edabf6d3924a05bcdbc2 not found: ID does not exist"
Jul 18 02:15:13.998696 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:13.998673    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"]
Jul 18 02:15:14.004527 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:14.004504    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5536ee23-openshift-default-6b7cc8d56c-l5jx9"]
Jul 18 02:15:14.745399 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:14.745370    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" path="/var/lib/kubelet/pods/09072601-0c7e-4c30-9580-f49807ebd4ec/volumes"
Jul 18 02:15:25.960142 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:25.960072    2560 patch_prober.go:28] interesting pod/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 18 02:15:25.960506 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:25.960141    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 18 02:15:26.044585 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:26.044557    2560 generic.go:356] "Generic (PLEG): container finished" podID="bceec5e4-e315-4420-a175-5300fffdf371" containerID="041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578" exitCode=0
Jul 18 02:15:26.044717 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:26.044637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" event={"ID":"bceec5e4-e315-4420-a175-5300fffdf371","Type":"ContainerDied","Data":"041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578"}
Jul 18 02:15:26.045081 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:26.045066    2560 scope.go:117] "RemoveContainer" containerID="041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578"
Jul 18 02:15:26.046173 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:26.046147    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:15:26.046225 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:26.046217    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:15:26.046259 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:26.046251    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:15:27.052423 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:27.052388    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" event={"ID":"bceec5e4-e315-4420-a175-5300fffdf371","Type":"ContainerStarted","Data":"266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10"}
Jul 18 02:15:27.420344 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:27.420227    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:27.420558 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:27.420538    2560 patch_prober.go:28] interesting pod/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 18 02:15:27.420608 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:27.420584    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 18 02:15:28.420707 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:28.420672    2560 patch_prober.go:28] interesting pod/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 18 02:15:28.421112 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:28.420719    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 18 02:15:29.420719 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:29.420681    2560 patch_prober.go:28] interesting pod/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 18 02:15:29.421107 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:29.420741    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 18 02:15:30.420357 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:30.420299    2560 patch_prober.go:28] interesting pod/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 18 02:15:30.420562 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:30.420376    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 18 02:15:31.423488 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:31.423458    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:31.423895 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:31.423854    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:31.424440 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:31.424421    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:51.727776 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:51.727745    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"]
Jul 18 02:15:51.728360 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:51.727941    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy" containerID="cri-o://266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10" gracePeriod=30
Jul 18 02:15:52.532533 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.532503    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"]
Jul 18 02:15:52.532860 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.532847    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerName="istio-proxy"
Jul 18 02:15:52.532907 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.532866    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerName="istio-proxy"
Jul 18 02:15:52.532950 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.532939    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerName="istio-proxy"
Jul 18 02:15:52.535041 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.535025    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.537539 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.537517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-92aad9cd-openshift-default-dockercfg-mwpd8\""
Jul 18 02:15:52.550152 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.550114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"]
Jul 18 02:15:52.687498 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.687464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-credential-socket\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.687677 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.687520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-certs\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.687677 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.687539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-socket\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.687677 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.687614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-data\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.687677 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.687648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-istio-token\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.687677 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.687674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-envoy\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.687920 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.687699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1396ea83-560e-407f-9450-c60f34b79525-istiod-ca-cert\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.687920 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.687745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9g2z\" (UniqueName: \"kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-kube-api-access-r9g2z\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.687920 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.687799    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1396ea83-560e-407f-9450-c60f34b79525-istio-podinfo\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.788963 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.788888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-credential-socket\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.788963 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.788935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-certs\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.788963 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.788952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-socket\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.788973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-data\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.789002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-istio-token\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.789027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-envoy\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.789044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1396ea83-560e-407f-9450-c60f34b79525-istiod-ca-cert\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.789072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9g2z\" (UniqueName: \"kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-kube-api-access-r9g2z\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.789247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1396ea83-560e-407f-9450-c60f34b79525-istio-podinfo\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.789312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-certs\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.789415    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-socket\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789784 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.789520    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-credential-socket\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789784 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.789677    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-data\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.789850 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.789838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1396ea83-560e-407f-9450-c60f34b79525-istiod-ca-cert\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.791543 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.791526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-envoy\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.791812 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.791795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1396ea83-560e-407f-9450-c60f34b79525-istio-podinfo\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.803953 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.803931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-istio-token\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.808038 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.808009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9g2z\" (UniqueName: \"kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-kube-api-access-r9g2z\") pod \"e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") " pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.844833 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.844808    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:52.979573 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.979549    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"]
Jul 18 02:15:52.982110 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:15:52.982084    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1396ea83_560e_407f_9450_c60f34b79525.slice/crio-f16ac89b3dff69f2d1aabf5826aeca43a483602c818926d9ec1563de809c4698 WatchSource:0}: Error finding container f16ac89b3dff69f2d1aabf5826aeca43a483602c818926d9ec1563de809c4698: Status 404 returned error can't find the container with id f16ac89b3dff69f2d1aabf5826aeca43a483602c818926d9ec1563de809c4698
Jul 18 02:15:52.984226 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.984197    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:15:52.984278 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.984261    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:15:52.984312 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:52.984290    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:15:53.181379 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:53.181277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" event={"ID":"1396ea83-560e-407f-9450-c60f34b79525","Type":"ContainerStarted","Data":"b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075"}
Jul 18 02:15:53.181379 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:53.181364    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" event={"ID":"1396ea83-560e-407f-9450-c60f34b79525","Type":"ContainerStarted","Data":"f16ac89b3dff69f2d1aabf5826aeca43a483602c818926d9ec1563de809c4698"}
Jul 18 02:15:53.202222 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:53.202171    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" podStartSLOduration=1.202151614 podStartE2EDuration="1.202151614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:15:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:15:53.200484838 +0000 UTC m=+1649.002729293" watchObservedRunningTime="2026-07-18 02:15:53.202151614 +0000 UTC m=+1649.004396073"
Jul 18 02:15:53.845715 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:53.845675    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:54.850359 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:54.850312    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:55.191440 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:55.191359    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:55.192219 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:55.192200    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:15:56.973717 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:56.973691    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:57.127451 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127421    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-certs\") pod \"bceec5e4-e315-4420-a175-5300fffdf371\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") "
Jul 18 02:15:57.127573 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127477    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bceec5e4-e315-4420-a175-5300fffdf371-istio-podinfo\") pod \"bceec5e4-e315-4420-a175-5300fffdf371\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") "
Jul 18 02:15:57.127573 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127504    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-credential-socket\") pod \"bceec5e4-e315-4420-a175-5300fffdf371\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") "
Jul 18 02:15:57.127573 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127521    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-envoy\") pod \"bceec5e4-e315-4420-a175-5300fffdf371\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") "
Jul 18 02:15:57.127573 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127539    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bceec5e4-e315-4420-a175-5300fffdf371-istiod-ca-cert\") pod \"bceec5e4-e315-4420-a175-5300fffdf371\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") "
Jul 18 02:15:57.127573 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127562    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-socket\") pod \"bceec5e4-e315-4420-a175-5300fffdf371\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") "
Jul 18 02:15:57.127811 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127600    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-istio-token\") pod \"bceec5e4-e315-4420-a175-5300fffdf371\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") "
Jul 18 02:15:57.127811 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127698    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bceec5e4-e315-4420-a175-5300fffdf371" (UID: "bceec5e4-e315-4420-a175-5300fffdf371"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:15:57.127811 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127771    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sndgk\" (UniqueName: \"kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-kube-api-access-sndgk\") pod \"bceec5e4-e315-4420-a175-5300fffdf371\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") "
Jul 18 02:15:57.127811 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127780    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bceec5e4-e315-4420-a175-5300fffdf371" (UID: "bceec5e4-e315-4420-a175-5300fffdf371"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:15:57.127811 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.127808    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-data\") pod \"bceec5e4-e315-4420-a175-5300fffdf371\" (UID: \"bceec5e4-e315-4420-a175-5300fffdf371\") "
Jul 18 02:15:57.128060 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.128018    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bceec5e4-e315-4420-a175-5300fffdf371-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bceec5e4-e315-4420-a175-5300fffdf371" (UID: "bceec5e4-e315-4420-a175-5300fffdf371"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:15:57.128126 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.128071    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bceec5e4-e315-4420-a175-5300fffdf371" (UID: "bceec5e4-e315-4420-a175-5300fffdf371"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:15:57.128425 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.128284    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:57.128425 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.128308    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bceec5e4-e315-4420-a175-5300fffdf371-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:57.128425 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.128349    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:57.128425 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.128363    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:57.128776 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.128763    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-data" (OuterVolumeSpecName: "istio-data") pod "bceec5e4-e315-4420-a175-5300fffdf371" (UID: "bceec5e4-e315-4420-a175-5300fffdf371"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:15:57.130075 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.130049    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-kube-api-access-sndgk" (OuterVolumeSpecName: "kube-api-access-sndgk") pod "bceec5e4-e315-4420-a175-5300fffdf371" (UID: "bceec5e4-e315-4420-a175-5300fffdf371"). InnerVolumeSpecName "kube-api-access-sndgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:15:57.130191 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.130088    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bceec5e4-e315-4420-a175-5300fffdf371-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bceec5e4-e315-4420-a175-5300fffdf371" (UID: "bceec5e4-e315-4420-a175-5300fffdf371"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:15:57.130467 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.130449    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-istio-token" (OuterVolumeSpecName: "istio-token") pod "bceec5e4-e315-4420-a175-5300fffdf371" (UID: "bceec5e4-e315-4420-a175-5300fffdf371"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:15:57.130467 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.130450    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bceec5e4-e315-4420-a175-5300fffdf371" (UID: "bceec5e4-e315-4420-a175-5300fffdf371"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:15:57.203405 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.203382    2560 generic.go:356] "Generic (PLEG): container finished" podID="bceec5e4-e315-4420-a175-5300fffdf371" containerID="266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10" exitCode=0
Jul 18 02:15:57.203503 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.203426    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"
Jul 18 02:15:57.203503 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.203474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" event={"ID":"bceec5e4-e315-4420-a175-5300fffdf371","Type":"ContainerDied","Data":"266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10"}
Jul 18 02:15:57.203608 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.203538    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z" event={"ID":"bceec5e4-e315-4420-a175-5300fffdf371","Type":"ContainerDied","Data":"4203b02021dce2416ff29ab2d229a375846259e01a6afc7727c0502138582b7d"}
Jul 18 02:15:57.203608 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.203561    2560 scope.go:117] "RemoveContainer" containerID="266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10"
Jul 18 02:15:57.212402 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.212387    2560 scope.go:117] "RemoveContainer" containerID="041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578"
Jul 18 02:15:57.219966 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.219950    2560 scope.go:117] "RemoveContainer" containerID="266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10"
Jul 18 02:15:57.220226 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:15:57.220210    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10\": container with ID starting with 266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10 not found: ID does not exist" containerID="266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10"
Jul 18 02:15:57.220273 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.220233    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10"} err="failed to get container status \"266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10\": rpc error: code = NotFound desc = could not find container \"266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10\": container with ID starting with 266918b7ef9654dfc3622e2976e17bbdc674c70fa7e1707cb1021e11c70c8f10 not found: ID does not exist"
Jul 18 02:15:57.220273 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.220251    2560 scope.go:117] "RemoveContainer" containerID="041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578"
Jul 18 02:15:57.220495 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:15:57.220476    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578\": container with ID starting with 041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578 not found: ID does not exist" containerID="041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578"
Jul 18 02:15:57.220540 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.220503    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578"} err="failed to get container status \"041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578\": rpc error: code = NotFound desc = could not find container \"041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578\": container with ID starting with 041d26c789e63bebe9537937ccbb858929899f048afe1a62113df030ccc60578 not found: ID does not exist"
Jul 18 02:15:57.225176 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.225156    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"]
Jul 18 02:15:57.228782 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.228762    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-8f8edd4c-gw-openshift-default-747679c6d7-2m72z"]
Jul 18 02:15:57.229079 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.229063    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bceec5e4-e315-4420-a175-5300fffdf371-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:57.229130 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.229083    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:57.229130 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.229093    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:57.229130 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.229101    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sndgk\" (UniqueName: \"kubernetes.io/projected/bceec5e4-e315-4420-a175-5300fffdf371-kube-api-access-sndgk\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:57.229130 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:57.229110    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bceec5e4-e315-4420-a175-5300fffdf371-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:15:58.750949 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:15:58.750913    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bceec5e4-e315-4420-a175-5300fffdf371" path="/var/lib/kubelet/pods/bceec5e4-e315-4420-a175-5300fffdf371/volumes"
Jul 18 02:16:09.263538 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:09.263511    2560 generic.go:356] "Generic (PLEG): container finished" podID="1396ea83-560e-407f-9450-c60f34b79525" containerID="b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075" exitCode=0
Jul 18 02:16:09.263896 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:09.263594    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" event={"ID":"1396ea83-560e-407f-9450-c60f34b79525","Type":"ContainerDied","Data":"b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075"}
Jul 18 02:16:09.263938 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:09.263915    2560 scope.go:117] "RemoveContainer" containerID="b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075"
Jul 18 02:16:09.264876 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:09.264852    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:16:09.264934 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:09.264921    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:16:09.264968 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:09.264956    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:16:10.191489 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:10.191453    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:16:10.270473 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:10.270438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" event={"ID":"1396ea83-560e-407f-9450-c60f34b79525","Type":"ContainerStarted","Data":"1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218"}
Jul 18 02:16:10.845945 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:10.845912    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:16:10.846980 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:10.846950    2560 patch_prober.go:28] interesting pod/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 18 02:16:10.847116 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:10.847010    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 18 02:16:11.845411 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:11.845375    2560 patch_prober.go:28] interesting pod/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 18 02:16:11.845806 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:11.845433    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 18 02:16:12.845591 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:12.845544    2560 patch_prober.go:28] interesting pod/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 18 02:16:12.846034 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:12.845610    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 18 02:16:13.845342 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:13.845289    2560 patch_prober.go:28] interesting pod/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 18 02:16:13.845533 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:13.845381    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 18 02:16:14.849350 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:14.849304    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:16:14.849807 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:14.849595    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:16:14.850436 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:14.850412    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:16:36.722566 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:36.722535    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"]
Jul 18 02:16:36.722992 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:36.722733    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy" containerID="cri-o://1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218" gracePeriod=30
Jul 18 02:16:37.464624 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.464591    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"]
Jul 18 02:16:37.464959 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.464927    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy"
Jul 18 02:16:37.464959 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.464943    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy"
Jul 18 02:16:37.465044 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.464979    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerName="istio-proxy"
Jul 18 02:16:37.465044 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.464985    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerName="istio-proxy"
Jul 18 02:16:37.465044 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.465037    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy"
Jul 18 02:16:37.465134 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.465048    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="09072601-0c7e-4c30-9580-f49807ebd4ec" containerName="istio-proxy"
Jul 18 02:16:37.465134 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.465058    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy"
Jul 18 02:16:37.467834 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.467818    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.470358 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.470335    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ec7c9b7e-openshift-default-dockercfg-w7zd4\""
Jul 18 02:16:37.484478 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.484455    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"]
Jul 18 02:16:37.563244 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.563208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-certs\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.563244 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.563243    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-podinfo\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.563493 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.563266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-data\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.563493 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.563305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-credential-socket\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.563493 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.563365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-envoy\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.563493 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.563411    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fnk6\" (UniqueName: \"kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-kube-api-access-2fnk6\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.563493 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.563451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-token\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.563751 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.563544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istiod-ca-cert\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.563751 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.563590    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-socket\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.664981 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.664948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fnk6\" (UniqueName: \"kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-kube-api-access-2fnk6\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665159 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-token\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665159 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istiod-ca-cert\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665159 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-socket\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665159 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665096    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-certs\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665159 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-podinfo\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665439 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665225    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-data\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665439 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665299    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-credential-socket\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665439 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-envoy\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665628 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-data\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665746 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-certs\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665746 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-socket\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665832 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-credential-socket\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.665867 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.665830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istiod-ca-cert\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.667684 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.667668    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-envoy\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.668002 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.667978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-podinfo\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.673436 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.673416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-token\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.673724 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.673703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fnk6\" (UniqueName: \"kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-kube-api-access-2fnk6\") pod \"e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") " pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.784072 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.784048    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:37.926817 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.926793    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"]
Jul 18 02:16:37.928424 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:16:37.928396    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8ba59f_87ee_45f8_8395_2e64147dfde1.slice/crio-9791e3e502fea29502d9e3332550904f5008929003cbf62ae7cee1c3d7f8efeb WatchSource:0}: Error finding container 9791e3e502fea29502d9e3332550904f5008929003cbf62ae7cee1c3d7f8efeb: Status 404 returned error can't find the container with id 9791e3e502fea29502d9e3332550904f5008929003cbf62ae7cee1c3d7f8efeb
Jul 18 02:16:37.930807 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.930774    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:16:37.930945 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.930853    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:16:37.930945 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:37.930901    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:16:38.401991 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:38.401959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" event={"ID":"cc8ba59f-87ee-45f8-8395-2e64147dfde1","Type":"ContainerStarted","Data":"5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488"}
Jul 18 02:16:38.402171 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:38.402010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" event={"ID":"cc8ba59f-87ee-45f8-8395-2e64147dfde1","Type":"ContainerStarted","Data":"9791e3e502fea29502d9e3332550904f5008929003cbf62ae7cee1c3d7f8efeb"}
Jul 18 02:16:38.423572 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:38.423529    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" podStartSLOduration=1.423508696 podStartE2EDuration="1.423508696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:16:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:16:38.423386656 +0000 UTC m=+1694.225631115" watchObservedRunningTime="2026-07-18 02:16:38.423508696 +0000 UTC m=+1694.225753134"
Jul 18 02:16:38.784577 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:38.784543    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:38.789201 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:38.789178    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:39.407908 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:39.407880    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:39.408941 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:39.408915    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:41.963222 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:41.963202    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:16:42.102616 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.102591    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-socket\") pod \"1396ea83-560e-407f-9450-c60f34b79525\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") "
Jul 18 02:16:42.102769 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.102621    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-istio-token\") pod \"1396ea83-560e-407f-9450-c60f34b79525\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") "
Jul 18 02:16:42.102769 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.102641    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1396ea83-560e-407f-9450-c60f34b79525-istio-podinfo\") pod \"1396ea83-560e-407f-9450-c60f34b79525\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") "
Jul 18 02:16:42.102769 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.102656    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-data\") pod \"1396ea83-560e-407f-9450-c60f34b79525\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") "
Jul 18 02:16:42.102769 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.102697    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-certs\") pod \"1396ea83-560e-407f-9450-c60f34b79525\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") "
Jul 18 02:16:42.102769 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.102737    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1396ea83-560e-407f-9450-c60f34b79525-istiod-ca-cert\") pod \"1396ea83-560e-407f-9450-c60f34b79525\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") "
Jul 18 02:16:42.102769 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.102765    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-credential-socket\") pod \"1396ea83-560e-407f-9450-c60f34b79525\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") "
Jul 18 02:16:42.103089 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.102861    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1396ea83-560e-407f-9450-c60f34b79525" (UID: "1396ea83-560e-407f-9450-c60f34b79525"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:16:42.103089 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.102867    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-envoy\") pod \"1396ea83-560e-407f-9450-c60f34b79525\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") "
Jul 18 02:16:42.103089 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.102940    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9g2z\" (UniqueName: \"kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-kube-api-access-r9g2z\") pod \"1396ea83-560e-407f-9450-c60f34b79525\" (UID: \"1396ea83-560e-407f-9450-c60f34b79525\") "
Jul 18 02:16:42.103089 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.103058    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1396ea83-560e-407f-9450-c60f34b79525" (UID: "1396ea83-560e-407f-9450-c60f34b79525"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:16:42.103472 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.103140    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1396ea83-560e-407f-9450-c60f34b79525-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1396ea83-560e-407f-9450-c60f34b79525" (UID: "1396ea83-560e-407f-9450-c60f34b79525"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:16:42.103472 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.103252    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:16:42.103472 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.103301    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1396ea83-560e-407f-9450-c60f34b79525" (UID: "1396ea83-560e-407f-9450-c60f34b79525"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:16:42.103472 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.103312    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:16:42.103472 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.103358    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1396ea83-560e-407f-9450-c60f34b79525-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:16:42.103868 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.103844    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-data" (OuterVolumeSpecName: "istio-data") pod "1396ea83-560e-407f-9450-c60f34b79525" (UID: "1396ea83-560e-407f-9450-c60f34b79525"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:16:42.104859 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.104830    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1396ea83-560e-407f-9450-c60f34b79525-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1396ea83-560e-407f-9450-c60f34b79525" (UID: "1396ea83-560e-407f-9450-c60f34b79525"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:16:42.104965 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.104874    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1396ea83-560e-407f-9450-c60f34b79525" (UID: "1396ea83-560e-407f-9450-c60f34b79525"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:16:42.104965 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.104919    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-istio-token" (OuterVolumeSpecName: "istio-token") pod "1396ea83-560e-407f-9450-c60f34b79525" (UID: "1396ea83-560e-407f-9450-c60f34b79525"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:16:42.105212 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.105197    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-kube-api-access-r9g2z" (OuterVolumeSpecName: "kube-api-access-r9g2z") pod "1396ea83-560e-407f-9450-c60f34b79525" (UID: "1396ea83-560e-407f-9450-c60f34b79525"). InnerVolumeSpecName "kube-api-access-r9g2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:16:42.203928 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.203903    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:16:42.203928 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.203924    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1396ea83-560e-407f-9450-c60f34b79525-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:16:42.204058 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.203938    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:16:42.204058 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.203951    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:16:42.204058 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.203963    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1396ea83-560e-407f-9450-c60f34b79525-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:16:42.204058 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.203975    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9g2z\" (UniqueName: \"kubernetes.io/projected/1396ea83-560e-407f-9450-c60f34b79525-kube-api-access-r9g2z\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:16:42.427126 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.427061    2560 generic.go:356] "Generic (PLEG): container finished" podID="1396ea83-560e-407f-9450-c60f34b79525" containerID="1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218" exitCode=0
Jul 18 02:16:42.427126 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.427118    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"
Jul 18 02:16:42.427302 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.427151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" event={"ID":"1396ea83-560e-407f-9450-c60f34b79525","Type":"ContainerDied","Data":"1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218"}
Jul 18 02:16:42.427302 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.427240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk" event={"ID":"1396ea83-560e-407f-9450-c60f34b79525","Type":"ContainerDied","Data":"f16ac89b3dff69f2d1aabf5826aeca43a483602c818926d9ec1563de809c4698"}
Jul 18 02:16:42.427302 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.427273    2560 scope.go:117] "RemoveContainer" containerID="1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218"
Jul 18 02:16:42.435976 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.435960    2560 scope.go:117] "RemoveContainer" containerID="b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075"
Jul 18 02:16:42.443509 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.443494    2560 scope.go:117] "RemoveContainer" containerID="1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218"
Jul 18 02:16:42.443716 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:16:42.443701    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218\": container with ID starting with 1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218 not found: ID does not exist" containerID="1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218"
Jul 18 02:16:42.443752 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.443723    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218"} err="failed to get container status \"1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218\": rpc error: code = NotFound desc = could not find container \"1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218\": container with ID starting with 1a810ff31eca63cb87d571099d99a6be7c6c8d6020b561477bb39ba49f589218 not found: ID does not exist"
Jul 18 02:16:42.443752 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.443737    2560 scope.go:117] "RemoveContainer" containerID="b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075"
Jul 18 02:16:42.443918 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:16:42.443904    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075\": container with ID starting with b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075 not found: ID does not exist" containerID="b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075"
Jul 18 02:16:42.443950 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.443922    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075"} err="failed to get container status \"b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075\": rpc error: code = NotFound desc = could not find container \"b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075\": container with ID starting with b2dc45291249b1bee595a8c872a370785ce12e2b7b1b1dc8a4d722e28b9cd075 not found: ID does not exist"
Jul 18 02:16:42.447269 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.447250    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"]
Jul 18 02:16:42.450901 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.450881    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-92aad9cd-openshift-default-ffc59f577-tshdk"]
Jul 18 02:16:42.744722 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:42.744667    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1396ea83-560e-407f-9450-c60f34b79525" path="/var/lib/kubelet/pods/1396ea83-560e-407f-9450-c60f34b79525/volumes"
Jul 18 02:16:54.409370 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:54.409315    2560 patch_prober.go:28] interesting pod/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 18 02:16:54.409815 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:54.409398    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 18 02:16:54.485981 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:54.485952    2560 generic.go:356] "Generic (PLEG): container finished" podID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerID="5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488" exitCode=0
Jul 18 02:16:54.486103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:54.485990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" event={"ID":"cc8ba59f-87ee-45f8-8395-2e64147dfde1","Type":"ContainerDied","Data":"5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488"}
Jul 18 02:16:54.486363 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:54.486339    2560 scope.go:117] "RemoveContainer" containerID="5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488"
Jul 18 02:16:54.487258 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:54.487229    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:16:54.487360 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:54.487312    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:16:54.487430 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:54.487380    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:16:55.492671 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:55.492642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" event={"ID":"cc8ba59f-87ee-45f8-8395-2e64147dfde1","Type":"ContainerStarted","Data":"371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0"}
Jul 18 02:16:55.784818 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:55.784780    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:55.785056 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:55.785001    2560 patch_prober.go:28] interesting pod/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 18 02:16:55.785102 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:55.785051    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 18 02:16:56.784708 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:56.784670    2560 patch_prober.go:28] interesting pod/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 18 02:16:56.785147 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:56.784733    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 18 02:16:57.784598 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:57.784560    2560 patch_prober.go:28] interesting pod/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 18 02:16:57.784773 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:57.784614    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 18 02:16:58.784581 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:58.784544    2560 patch_prober.go:28] interesting pod/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 18 02:16:58.784757 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:58.784599    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 18 02:16:59.788716 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:59.788688    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:59.789108 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:59.788956    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:16:59.789534 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:16:59.789516    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:17:19.872078 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:19.872043    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"]
Jul 18 02:17:19.872505 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:19.872301    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy" containerID="cri-o://371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0" gracePeriod=30
Jul 18 02:17:25.129580 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.129543    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:17:25.246763 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.246736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-data\") pod \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") "
Jul 18 02:17:25.246871 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.246774    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-socket\") pod \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") "
Jul 18 02:17:25.246871 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.246793    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-podinfo\") pod \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") "
Jul 18 02:17:25.246871 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.246845    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-credential-socket\") pod \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") "
Jul 18 02:17:25.246871 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.246863    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-token\") pod \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") "
Jul 18 02:17:25.247064 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.246887    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fnk6\" (UniqueName: \"kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-kube-api-access-2fnk6\") pod \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") "
Jul 18 02:17:25.247064 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.246933    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-certs\") pod \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") "
Jul 18 02:17:25.247064 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.246967    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-envoy\") pod \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") "
Jul 18 02:17:25.247064 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.247003    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istiod-ca-cert\") pod \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\" (UID: \"cc8ba59f-87ee-45f8-8395-2e64147dfde1\") "
Jul 18 02:17:25.247064 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.247030    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc8ba59f-87ee-45f8-8395-2e64147dfde1" (UID: "cc8ba59f-87ee-45f8-8395-2e64147dfde1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:25.247301 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.247150    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc8ba59f-87ee-45f8-8395-2e64147dfde1" (UID: "cc8ba59f-87ee-45f8-8395-2e64147dfde1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:25.247301 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.247241    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc8ba59f-87ee-45f8-8395-2e64147dfde1" (UID: "cc8ba59f-87ee-45f8-8395-2e64147dfde1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:25.247301 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.247259    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:17:25.247301 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.247277    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:17:25.247548 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.247528    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc8ba59f-87ee-45f8-8395-2e64147dfde1" (UID: "cc8ba59f-87ee-45f8-8395-2e64147dfde1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:17:25.247744 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.247717    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc8ba59f-87ee-45f8-8395-2e64147dfde1" (UID: "cc8ba59f-87ee-45f8-8395-2e64147dfde1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:25.249245 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.249224    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc8ba59f-87ee-45f8-8395-2e64147dfde1" (UID: "cc8ba59f-87ee-45f8-8395-2e64147dfde1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:25.249245 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.249228    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-kube-api-access-2fnk6" (OuterVolumeSpecName: "kube-api-access-2fnk6") pod "cc8ba59f-87ee-45f8-8395-2e64147dfde1" (UID: "cc8ba59f-87ee-45f8-8395-2e64147dfde1"). InnerVolumeSpecName "kube-api-access-2fnk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:17:25.249447 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.249429    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc8ba59f-87ee-45f8-8395-2e64147dfde1" (UID: "cc8ba59f-87ee-45f8-8395-2e64147dfde1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:17:25.249532 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.249505    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc8ba59f-87ee-45f8-8395-2e64147dfde1" (UID: "cc8ba59f-87ee-45f8-8395-2e64147dfde1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:17:25.348595 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.348546    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:17:25.348595 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.348564    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:17:25.348595 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.348574    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:17:25.348595 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.348582    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fnk6\" (UniqueName: \"kubernetes.io/projected/cc8ba59f-87ee-45f8-8395-2e64147dfde1-kube-api-access-2fnk6\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:17:25.348595 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.348590    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:17:25.348595 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.348598    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:17:25.348808 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.348605    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8ba59f-87ee-45f8-8395-2e64147dfde1-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:17:25.646127 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.646064    2560 generic.go:356] "Generic (PLEG): container finished" podID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerID="371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0" exitCode=0
Jul 18 02:17:25.646127 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.646120    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"
Jul 18 02:17:25.646292 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.646147    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" event={"ID":"cc8ba59f-87ee-45f8-8395-2e64147dfde1","Type":"ContainerDied","Data":"371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0"}
Jul 18 02:17:25.646292 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.646202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg" event={"ID":"cc8ba59f-87ee-45f8-8395-2e64147dfde1","Type":"ContainerDied","Data":"9791e3e502fea29502d9e3332550904f5008929003cbf62ae7cee1c3d7f8efeb"}
Jul 18 02:17:25.646292 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.646226    2560 scope.go:117] "RemoveContainer" containerID="371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0"
Jul 18 02:17:25.655578 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.655563    2560 scope.go:117] "RemoveContainer" containerID="5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488"
Jul 18 02:17:25.663054 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.663037    2560 scope.go:117] "RemoveContainer" containerID="371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0"
Jul 18 02:17:25.663292 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:17:25.663274    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0\": container with ID starting with 371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0 not found: ID does not exist" containerID="371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0"
Jul 18 02:17:25.663375 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.663301    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0"} err="failed to get container status \"371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0\": rpc error: code = NotFound desc = could not find container \"371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0\": container with ID starting with 371516f95e458ccd2c1eaf0f2b8e3dec07913889f6bb72e77dcca15c2ceb6cd0 not found: ID does not exist"
Jul 18 02:17:25.663702 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.663690    2560 scope.go:117] "RemoveContainer" containerID="5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488"
Jul 18 02:17:25.663951 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:17:25.663936    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488\": container with ID starting with 5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488 not found: ID does not exist" containerID="5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488"
Jul 18 02:17:25.663989 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.663956    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488"} err="failed to get container status \"5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488\": rpc error: code = NotFound desc = could not find container \"5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488\": container with ID starting with 5687282c1834d0f05a7bbe24c0e8ff9a7a332f59d55cf7df8a456c134e4bb488 not found: ID does not exist"
Jul 18 02:17:25.667689 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.667668    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"]
Jul 18 02:17:25.671708 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:25.671691    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ec7c9b7e-openshift-default-cfc467fff-jsjmg"]
Jul 18 02:17:26.745287 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:17:26.745247    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" path="/var/lib/kubelet/pods/cc8ba59f-87ee-45f8-8395-2e64147dfde1/volumes"
Jul 18 02:18:24.708129 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:24.708099    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:18:24.713512 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:24.713490    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:18:58.434183 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434153    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"]
Jul 18 02:18:58.434667 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434560    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy"
Jul 18 02:18:58.434667 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434573    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy"
Jul 18 02:18:58.434667 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434582    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy"
Jul 18 02:18:58.434667 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434588    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy"
Jul 18 02:18:58.434667 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434600    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy"
Jul 18 02:18:58.434667 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434605    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bceec5e4-e315-4420-a175-5300fffdf371" containerName="istio-proxy"
Jul 18 02:18:58.434667 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434614    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy"
Jul 18 02:18:58.434667 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434619    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy"
Jul 18 02:18:58.434667 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434670    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy"
Jul 18 02:18:58.434959 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434677    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy"
Jul 18 02:18:58.434959 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434687    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy"
Jul 18 02:18:58.434959 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.434694    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1396ea83-560e-407f-9450-c60f34b79525" containerName="istio-proxy"
Jul 18 02:18:58.436810 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.436787    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.439987 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.439967    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-084f79d4-openshift-default-dockercfg-ppbjv\""
Jul 18 02:18:58.461102 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.461079    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"]
Jul 18 02:18:58.537354 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.537304    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-token\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.537607 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.537581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c411677c-8c31-4e39-9225-6ad90b4ddcab-istiod-ca-cert\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.537703 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.537631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9qhd\" (UniqueName: \"kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-kube-api-access-t9qhd\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.537754 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.537722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-data\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.537803 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.537770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-credential-socket\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.537854 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.537805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-socket\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.537904 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.537862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-envoy\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.537955 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.537935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-certs\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.538011 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.537976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-podinfo\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.638867 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.638826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-credential-socket\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.638867 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.638871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-socket\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.638895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-envoy\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.638933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-certs\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.638966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-podinfo\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.638998    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-token\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.639029    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c411677c-8c31-4e39-9225-6ad90b4ddcab-istiod-ca-cert\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.639080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9qhd\" (UniqueName: \"kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-kube-api-access-t9qhd\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639427 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.639132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-data\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639427 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.639250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-credential-socket\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639427 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.639288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-socket\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639746 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.639720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c411677c-8c31-4e39-9225-6ad90b4ddcab-istiod-ca-cert\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639861 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.639809    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-data\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.639861 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.639823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-certs\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.641671 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.641649    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-envoy\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.641865 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.641842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-podinfo\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.648067 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.648036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-token\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.648297 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.648278    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9qhd\" (UniqueName: \"kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-kube-api-access-t9qhd\") pod \"e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") " pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.749342 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.749236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:58.898041 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.898007    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"]
Jul 18 02:18:58.902813 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:18:58.902767    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc411677c_8c31_4e39_9225_6ad90b4ddcab.slice/crio-2af7d4ce112ca2fece0bab59e23353526688d58931331738b57d033bbdcb2231 WatchSource:0}: Error finding container 2af7d4ce112ca2fece0bab59e23353526688d58931331738b57d033bbdcb2231: Status 404 returned error can't find the container with id 2af7d4ce112ca2fece0bab59e23353526688d58931331738b57d033bbdcb2231
Jul 18 02:18:58.905809 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.905766    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:18:58.905918 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.905852    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:18:58.905918 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:58.905893    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:18:59.098270 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:59.098223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" event={"ID":"c411677c-8c31-4e39-9225-6ad90b4ddcab","Type":"ContainerStarted","Data":"cadcf0f274457546e116bc0fd23a1bc779de67e9e76277f24bf6e23cfd473fe9"}
Jul 18 02:18:59.098487 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:59.098290    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" event={"ID":"c411677c-8c31-4e39-9225-6ad90b4ddcab","Type":"ContainerStarted","Data":"2af7d4ce112ca2fece0bab59e23353526688d58931331738b57d033bbdcb2231"}
Jul 18 02:18:59.122614 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:59.122550    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" podStartSLOduration=1.122531034 podStartE2EDuration="1.122531034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:18:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:18:59.119769106 +0000 UTC m=+1834.922013566" watchObservedRunningTime="2026-07-18 02:18:59.122531034 +0000 UTC m=+1834.924775491"
Jul 18 02:18:59.749502 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:59.749461    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:18:59.755001 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:18:59.754967    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:19:00.103597 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:00.103566    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:19:00.104603 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:00.104579    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:19:12.158205 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:12.158131    2560 generic.go:356] "Generic (PLEG): container finished" podID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerID="cadcf0f274457546e116bc0fd23a1bc779de67e9e76277f24bf6e23cfd473fe9" exitCode=0
Jul 18 02:19:12.158609 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:12.158204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" event={"ID":"c411677c-8c31-4e39-9225-6ad90b4ddcab","Type":"ContainerDied","Data":"cadcf0f274457546e116bc0fd23a1bc779de67e9e76277f24bf6e23cfd473fe9"}
Jul 18 02:19:12.158609 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:12.158565    2560 scope.go:117] "RemoveContainer" containerID="cadcf0f274457546e116bc0fd23a1bc779de67e9e76277f24bf6e23cfd473fe9"
Jul 18 02:19:12.159666 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:12.159642    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:19:12.159732 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:12.159709    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:19:12.159769 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:12.159743    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:19:13.164563 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:13.164529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" event={"ID":"c411677c-8c31-4e39-9225-6ad90b4ddcab","Type":"ContainerStarted","Data":"ac2767a72fa90b59b7252569cbee7e2380f41caef0a26ab1d67dfe8ab3a9e4eb"}
Jul 18 02:19:13.750447 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:13.750414    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:19:13.751637 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:13.751617    2560 patch_prober.go:28] interesting pod/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 18 02:19:13.751697 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:13.751661    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 18 02:19:14.750148 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:14.750115    2560 patch_prober.go:28] interesting pod/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 18 02:19:14.750548 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:14.750165    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 18 02:19:15.104354 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:15.104305    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:19:15.750051 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:15.750019    2560 patch_prober.go:28] interesting pod/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 18 02:19:15.750192 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:15.750070    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 18 02:19:16.750585 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:16.750543    2560 patch_prober.go:28] interesting pod/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 18 02:19:16.751084 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:16.750607    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 18 02:19:17.754199 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:17.754165    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:19:17.755379 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:17.755357    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:19:35.094051 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:35.094018    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"]
Jul 18 02:19:35.094464 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:35.094217    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy" containerID="cri-o://ac2767a72fa90b59b7252569cbee7e2380f41caef0a26ab1d67dfe8ab3a9e4eb" gracePeriod=30
Jul 18 02:19:40.302393 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.302361    2560 generic.go:356] "Generic (PLEG): container finished" podID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerID="ac2767a72fa90b59b7252569cbee7e2380f41caef0a26ab1d67dfe8ab3a9e4eb" exitCode=0
Jul 18 02:19:40.302796 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.302432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" event={"ID":"c411677c-8c31-4e39-9225-6ad90b4ddcab","Type":"ContainerDied","Data":"ac2767a72fa90b59b7252569cbee7e2380f41caef0a26ab1d67dfe8ab3a9e4eb"}
Jul 18 02:19:40.302796 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.302510    2560 scope.go:117] "RemoveContainer" containerID="cadcf0f274457546e116bc0fd23a1bc779de67e9e76277f24bf6e23cfd473fe9"
Jul 18 02:19:40.350552 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.350529    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:19:40.501288 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501225    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-token\") pod \"c411677c-8c31-4e39-9225-6ad90b4ddcab\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") "
Jul 18 02:19:40.501288 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501266    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-data\") pod \"c411677c-8c31-4e39-9225-6ad90b4ddcab\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") "
Jul 18 02:19:40.501496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501347    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-credential-socket\") pod \"c411677c-8c31-4e39-9225-6ad90b4ddcab\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") "
Jul 18 02:19:40.501496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501396    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-envoy\") pod \"c411677c-8c31-4e39-9225-6ad90b4ddcab\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") "
Jul 18 02:19:40.501496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501429    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-socket\") pod \"c411677c-8c31-4e39-9225-6ad90b4ddcab\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") "
Jul 18 02:19:40.501496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501457    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-certs\") pod \"c411677c-8c31-4e39-9225-6ad90b4ddcab\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") "
Jul 18 02:19:40.501714 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501502    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-podinfo\") pod \"c411677c-8c31-4e39-9225-6ad90b4ddcab\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") "
Jul 18 02:19:40.501714 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501531    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9qhd\" (UniqueName: \"kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-kube-api-access-t9qhd\") pod \"c411677c-8c31-4e39-9225-6ad90b4ddcab\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") "
Jul 18 02:19:40.501714 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501568    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c411677c-8c31-4e39-9225-6ad90b4ddcab-istiod-ca-cert\") pod \"c411677c-8c31-4e39-9225-6ad90b4ddcab\" (UID: \"c411677c-8c31-4e39-9225-6ad90b4ddcab\") "
Jul 18 02:19:40.501858 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501736    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c411677c-8c31-4e39-9225-6ad90b4ddcab" (UID: "c411677c-8c31-4e39-9225-6ad90b4ddcab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:19:40.501858 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501766    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c411677c-8c31-4e39-9225-6ad90b4ddcab" (UID: "c411677c-8c31-4e39-9225-6ad90b4ddcab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:19:40.501858 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501781    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c411677c-8c31-4e39-9225-6ad90b4ddcab" (UID: "c411677c-8c31-4e39-9225-6ad90b4ddcab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:19:40.502006 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501888    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:19:40.502006 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501907    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:19:40.502006 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.501923    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:19:40.502264 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.502240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-data" (OuterVolumeSpecName: "istio-data") pod "c411677c-8c31-4e39-9225-6ad90b4ddcab" (UID: "c411677c-8c31-4e39-9225-6ad90b4ddcab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:19:40.502352 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.502289    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c411677c-8c31-4e39-9225-6ad90b4ddcab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c411677c-8c31-4e39-9225-6ad90b4ddcab" (UID: "c411677c-8c31-4e39-9225-6ad90b4ddcab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:19:40.503743 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.503714    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-token" (OuterVolumeSpecName: "istio-token") pod "c411677c-8c31-4e39-9225-6ad90b4ddcab" (UID: "c411677c-8c31-4e39-9225-6ad90b4ddcab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:19:40.504022 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.503996    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c411677c-8c31-4e39-9225-6ad90b4ddcab" (UID: "c411677c-8c31-4e39-9225-6ad90b4ddcab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:19:40.504367 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.504348    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-kube-api-access-t9qhd" (OuterVolumeSpecName: "kube-api-access-t9qhd") pod "c411677c-8c31-4e39-9225-6ad90b4ddcab" (UID: "c411677c-8c31-4e39-9225-6ad90b4ddcab"). InnerVolumeSpecName "kube-api-access-t9qhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:19:40.504367 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.504342    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c411677c-8c31-4e39-9225-6ad90b4ddcab" (UID: "c411677c-8c31-4e39-9225-6ad90b4ddcab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:19:40.602625 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.602601    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:19:40.602625 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.602623    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9qhd\" (UniqueName: \"kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-kube-api-access-t9qhd\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:19:40.602756 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.602633    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c411677c-8c31-4e39-9225-6ad90b4ddcab-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:19:40.602756 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.602643    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:19:40.602756 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.602651    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:19:40.602756 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:40.602658    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c411677c-8c31-4e39-9225-6ad90b4ddcab-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:19:41.309129 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:41.309102    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"
Jul 18 02:19:41.309525 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:41.309101    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq" event={"ID":"c411677c-8c31-4e39-9225-6ad90b4ddcab","Type":"ContainerDied","Data":"2af7d4ce112ca2fece0bab59e23353526688d58931331738b57d033bbdcb2231"}
Jul 18 02:19:41.309525 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:41.309229    2560 scope.go:117] "RemoveContainer" containerID="ac2767a72fa90b59b7252569cbee7e2380f41caef0a26ab1d67dfe8ab3a9e4eb"
Jul 18 02:19:41.333342 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:41.333300    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"]
Jul 18 02:19:41.342624 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:41.342601    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-084f79d4-openshift-default-54c45bd47f-7hhcq"]
Jul 18 02:19:42.744768 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:42.744727    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" path="/var/lib/kubelet/pods/c411677c-8c31-4e39-9225-6ad90b4ddcab/volumes"
Jul 18 02:19:54.431378 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.431288    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"]
Jul 18 02:19:54.431776 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.431694    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy"
Jul 18 02:19:54.431776 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.431712    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy"
Jul 18 02:19:54.431776 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.431728    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy"
Jul 18 02:19:54.431776 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.431735    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8ba59f-87ee-45f8-8395-2e64147dfde1" containerName="istio-proxy"
Jul 18 02:19:54.431907 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.431799    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy"
Jul 18 02:19:54.434997 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.434980    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.437860 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.437839    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0cc0a379-openshift-default-dockercfg-8xc2b\""
Jul 18 02:19:54.446444 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.446418    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"]
Jul 18 02:19:54.515112 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.515084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-data\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.515248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.515142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istiod-ca-cert\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.515248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.515198    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-certs\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.515248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.515222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-token\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.515403 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.515248    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-credential-socket\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.515403 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.515277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-socket\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.515403 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.515359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-podinfo\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.515494 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.515405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z62lk\" (UniqueName: \"kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-kube-api-access-z62lk\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.515494 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.515481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-envoy\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616157 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-data\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616157 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istiod-ca-cert\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616469 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-certs\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616469 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-token\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616469 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-credential-socket\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616469 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-socket\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616469 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-podinfo\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616469 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z62lk\" (UniqueName: \"kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-kube-api-access-z62lk\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616752 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-envoy\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616752 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616652    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-data\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616847 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-credential-socket\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616906 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-socket\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.616956 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.616911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-certs\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.617063 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.617043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istiod-ca-cert\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.619021 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.618999    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-envoy\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.619125 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.619055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-podinfo\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.625211 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.625177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-token\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.625359 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.625300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z62lk\" (UniqueName: \"kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-kube-api-access-z62lk\") pod \"e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") " pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.745505 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.745421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:54.888351 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.888305    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"]
Jul 18 02:19:54.890191 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:19:54.890158    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f61749_d1a0_42b7_b67b_d00a69b1fb2f.slice/crio-9ac7071f7c2d798a9a3fa2dc4f393ae65d23b59951f65113090f966d1c1c494d WatchSource:0}: Error finding container 9ac7071f7c2d798a9a3fa2dc4f393ae65d23b59951f65113090f966d1c1c494d: Status 404 returned error can't find the container with id 9ac7071f7c2d798a9a3fa2dc4f393ae65d23b59951f65113090f966d1c1c494d
Jul 18 02:19:54.892459 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.892429    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:19:54.892559 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.892533    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:19:54.892619 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:54.892582    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:19:55.379359 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:55.379296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" event={"ID":"73f61749-d1a0-42b7-b67b-d00a69b1fb2f","Type":"ContainerStarted","Data":"cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae"}
Jul 18 02:19:55.379558 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:55.379383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" event={"ID":"73f61749-d1a0-42b7-b67b-d00a69b1fb2f","Type":"ContainerStarted","Data":"9ac7071f7c2d798a9a3fa2dc4f393ae65d23b59951f65113090f966d1c1c494d"}
Jul 18 02:19:55.403136 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:55.403077    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" podStartSLOduration=1.403057992 podStartE2EDuration="1.403057992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:19:55.400718965 +0000 UTC m=+1891.202963447" watchObservedRunningTime="2026-07-18 02:19:55.403057992 +0000 UTC m=+1891.205302449"
Jul 18 02:19:55.746443 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:55.746354    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:55.751252 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:55.751224    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:56.385217 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:56.385185    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:19:56.386453 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:19:56.386431    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:20:10.560678 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.560644    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"]
Jul 18 02:20:10.561050 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.560981    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy"
Jul 18 02:20:10.561050 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.560993    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy"
Jul 18 02:20:10.561050 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.561042    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c411677c-8c31-4e39-9225-6ad90b4ddcab" containerName="istio-proxy"
Jul 18 02:20:10.564378 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.564360    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.568217 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.568193    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0cc0a379\"/\"kube-root-ca.crt\""
Jul 18 02:20:10.568217 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.568215    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0cc0a379\"/\"e2e-lifecycle-model-0cc0a379-kserve-self-signed-certs\""
Jul 18 02:20:10.568432 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.568194    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0cc0a379\"/\"openshift-service-ca.crt\""
Jul 18 02:20:10.568432 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.568304    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0cc0a379\"/\"default-dockercfg-hrxlp\""
Jul 18 02:20:10.574694 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.574672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"]
Jul 18 02:20:10.661563 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.661529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-tmp-dir\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.661718 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.661593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-dshm\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.661718 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.661627    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drm7t\" (UniqueName: \"kubernetes.io/projected/c958b6bc-8331-4497-9035-7d7603550928-kube-api-access-drm7t\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.661718 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.661673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c958b6bc-8331-4497-9035-7d7603550928-tls-certs\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.661718 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.661712    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-home\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.661878 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.661739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-model-cache\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.762426 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.762400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-tmp-dir\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.762553 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.762440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-dshm\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.762553 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.762465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drm7t\" (UniqueName: \"kubernetes.io/projected/c958b6bc-8331-4497-9035-7d7603550928-kube-api-access-drm7t\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.762553 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.762503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c958b6bc-8331-4497-9035-7d7603550928-tls-certs\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.762553 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.762542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-home\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.762723 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.762574    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-model-cache\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.762911 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.762870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-tmp-dir\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.763029 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.762927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-home\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.763029 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.762989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-model-cache\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.764972 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.764948    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-dshm\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.765219 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.765197    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c958b6bc-8331-4497-9035-7d7603550928-tls-certs\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.771698 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.771674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drm7t\" (UniqueName: \"kubernetes.io/projected/c958b6bc-8331-4497-9035-7d7603550928-kube-api-access-drm7t\") pod \"e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") " pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:10.874956 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:10.874900    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:11.011478 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:11.011452    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"]
Jul 18 02:20:11.013350 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:20:11.013307    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc958b6bc_8331_4497_9035_7d7603550928.slice/crio-cba752e9fb5245b2dcb54dd9799fcb1279bda77ed89ea6dcb80c32d609ac084b WatchSource:0}: Error finding container cba752e9fb5245b2dcb54dd9799fcb1279bda77ed89ea6dcb80c32d609ac084b: Status 404 returned error can't find the container with id cba752e9fb5245b2dcb54dd9799fcb1279bda77ed89ea6dcb80c32d609ac084b
Jul 18 02:20:11.456029 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:11.455990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l" event={"ID":"c958b6bc-8331-4497-9035-7d7603550928","Type":"ContainerStarted","Data":"763647262a094c6b0bee730c1d647b645ac115f74f74ea37f60bbef98b845ee9"}
Jul 18 02:20:11.456029 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:11.456032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l" event={"ID":"c958b6bc-8331-4497-9035-7d7603550928","Type":"ContainerStarted","Data":"cba752e9fb5245b2dcb54dd9799fcb1279bda77ed89ea6dcb80c32d609ac084b"}
Jul 18 02:20:11.475582 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:11.475538    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l" podStartSLOduration=1.475525308 podStartE2EDuration="1.475525308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:20:11.473397202 +0000 UTC m=+1907.275641654" watchObservedRunningTime="2026-07-18 02:20:11.475525308 +0000 UTC m=+1907.277769764"
Jul 18 02:20:11.845969 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:11.845508    2560 patch_prober.go:28] interesting pod/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": read tcp 10.134.0.2:58684->10.134.0.33:15021: read: connection reset by peer" start-of-body=
Jul 18 02:20:11.845969 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:11.845569    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": read tcp 10.134.0.2:58684->10.134.0.33:15021: read: connection reset by peer"
Jul 18 02:20:12.462686 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:12.462650    2560 generic.go:356] "Generic (PLEG): container finished" podID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerID="cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae" exitCode=0
Jul 18 02:20:12.462869 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:12.462727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" event={"ID":"73f61749-d1a0-42b7-b67b-d00a69b1fb2f","Type":"ContainerDied","Data":"cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae"}
Jul 18 02:20:12.463137 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:12.463120    2560 scope.go:117] "RemoveContainer" containerID="cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae"
Jul 18 02:20:12.464149 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:12.464120    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:20:12.464204 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:12.464191    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:20:12.464240 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:12.464225    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:20:13.469763 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:13.469723    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" event={"ID":"73f61749-d1a0-42b7-b67b-d00a69b1fb2f","Type":"ContainerStarted","Data":"fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9"}
Jul 18 02:20:13.746389 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:13.746295    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:20:13.746533 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:13.746518    2560 patch_prober.go:28] interesting pod/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 18 02:20:13.746587 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:13.746565    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 18 02:20:14.745960 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:14.745928    2560 patch_prober.go:28] interesting pod/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 18 02:20:14.746358 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:14.745979    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 18 02:20:15.746645 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:15.746612    2560 patch_prober.go:28] interesting pod/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 18 02:20:15.747022 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:15.746670    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 18 02:20:16.746633 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:16.746601    2560 patch_prober.go:28] interesting pod/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 18 02:20:16.746794 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:16.746650    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 18 02:20:17.749289 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:17.749262    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:20:17.749706 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:17.749512    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:20:17.750258 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:17.750242    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:20:20.875398 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:20.875363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:20.875885 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:20.875411    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:20.888024 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:20.887986    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:20:21.520474 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:20:21.520441    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:21:02.651904 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:02.651859    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"]
Jul 18 02:21:17.673381 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:17.673258    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l" podUID="c958b6bc-8331-4497-9035-7d7603550928" containerName="main" containerID="cri-o://763647262a094c6b0bee730c1d647b645ac115f74f74ea37f60bbef98b845ee9" gracePeriod=45
Jul 18 02:21:17.789926 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:17.789895    2560 generic.go:356] "Generic (PLEG): container finished" podID="c958b6bc-8331-4497-9035-7d7603550928" containerID="763647262a094c6b0bee730c1d647b645ac115f74f74ea37f60bbef98b845ee9" exitCode=0
Jul 18 02:21:17.790049 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:17.789944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l" event={"ID":"c958b6bc-8331-4497-9035-7d7603550928","Type":"ContainerDied","Data":"763647262a094c6b0bee730c1d647b645ac115f74f74ea37f60bbef98b845ee9"}
Jul 18 02:21:17.916337 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:17.916298    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:21:18.054668 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.054642    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-model-cache\") pod \"c958b6bc-8331-4497-9035-7d7603550928\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") "
Jul 18 02:21:18.054842 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.054696    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-dshm\") pod \"c958b6bc-8331-4497-9035-7d7603550928\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") "
Jul 18 02:21:18.054842 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.054731    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-home\") pod \"c958b6bc-8331-4497-9035-7d7603550928\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") "
Jul 18 02:21:18.054842 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.054765    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-tmp-dir\") pod \"c958b6bc-8331-4497-9035-7d7603550928\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") "
Jul 18 02:21:18.054842 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.054790    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drm7t\" (UniqueName: \"kubernetes.io/projected/c958b6bc-8331-4497-9035-7d7603550928-kube-api-access-drm7t\") pod \"c958b6bc-8331-4497-9035-7d7603550928\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") "
Jul 18 02:21:18.054842 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.054829    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c958b6bc-8331-4497-9035-7d7603550928-tls-certs\") pod \"c958b6bc-8331-4497-9035-7d7603550928\" (UID: \"c958b6bc-8331-4497-9035-7d7603550928\") "
Jul 18 02:21:18.055081 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.054881    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-model-cache" (OuterVolumeSpecName: "model-cache") pod "c958b6bc-8331-4497-9035-7d7603550928" (UID: "c958b6bc-8331-4497-9035-7d7603550928"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:18.055081 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.055018    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-home" (OuterVolumeSpecName: "home") pod "c958b6bc-8331-4497-9035-7d7603550928" (UID: "c958b6bc-8331-4497-9035-7d7603550928"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:18.055081 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.055035    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c958b6bc-8331-4497-9035-7d7603550928" (UID: "c958b6bc-8331-4497-9035-7d7603550928"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:18.055207 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.055178    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-model-cache\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:18.055207 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.055198    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-home\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:18.055207 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.055207    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-tmp-dir\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:18.056925 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.056906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-dshm" (OuterVolumeSpecName: "dshm") pod "c958b6bc-8331-4497-9035-7d7603550928" (UID: "c958b6bc-8331-4497-9035-7d7603550928"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:18.057048 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.057027    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c958b6bc-8331-4497-9035-7d7603550928-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c958b6bc-8331-4497-9035-7d7603550928" (UID: "c958b6bc-8331-4497-9035-7d7603550928"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:21:18.057092 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.057074    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c958b6bc-8331-4497-9035-7d7603550928-kube-api-access-drm7t" (OuterVolumeSpecName: "kube-api-access-drm7t") pod "c958b6bc-8331-4497-9035-7d7603550928" (UID: "c958b6bc-8331-4497-9035-7d7603550928"). InnerVolumeSpecName "kube-api-access-drm7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:21:18.156260 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.156225    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drm7t\" (UniqueName: \"kubernetes.io/projected/c958b6bc-8331-4497-9035-7d7603550928-kube-api-access-drm7t\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:18.156260 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.156258    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c958b6bc-8331-4497-9035-7d7603550928-tls-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:18.156260 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.156268    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c958b6bc-8331-4497-9035-7d7603550928-dshm\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:18.795735 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.795708    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"
Jul 18 02:21:18.795735 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.795725    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l" event={"ID":"c958b6bc-8331-4497-9035-7d7603550928","Type":"ContainerDied","Data":"cba752e9fb5245b2dcb54dd9799fcb1279bda77ed89ea6dcb80c32d609ac084b"}
Jul 18 02:21:18.796154 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.795771    2560 scope.go:117] "RemoveContainer" containerID="763647262a094c6b0bee730c1d647b645ac115f74f74ea37f60bbef98b845ee9"
Jul 18 02:21:18.812987 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.812964    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"]
Jul 18 02:21:18.817126 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:18.817104    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0cc0a379/e2e-lifecycle-model-0cc0a379-kserve-7d7c77cb6c-8gh6l"]
Jul 18 02:21:20.746302 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:20.746265    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c958b6bc-8331-4497-9035-7d7603550928" path="/var/lib/kubelet/pods/c958b6bc-8331-4497-9035-7d7603550928/volumes"
Jul 18 02:21:45.516614 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:45.516575    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"]
Jul 18 02:21:45.517144 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:45.516812    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy" containerID="cri-o://fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9" gracePeriod=30
Jul 18 02:21:47.752378 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:47.752336    2560 patch_prober.go:28] interesting pod/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 02:21:47.752732 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:47.752403    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 02:21:50.782988 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.782914    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:21:50.821357 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821309    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-token\") pod \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") "
Jul 18 02:21:50.821511 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821381    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z62lk\" (UniqueName: \"kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-kube-api-access-z62lk\") pod \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") "
Jul 18 02:21:50.821511 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821432    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-certs\") pod \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") "
Jul 18 02:21:50.821653 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821568    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istiod-ca-cert\") pod \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") "
Jul 18 02:21:50.821653 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821627    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-envoy\") pod \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") "
Jul 18 02:21:50.821762 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821677    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-data\") pod \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") "
Jul 18 02:21:50.821762 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821708    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-socket\") pod \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") "
Jul 18 02:21:50.821762 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821718    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73f61749-d1a0-42b7-b67b-d00a69b1fb2f" (UID: "73f61749-d1a0-42b7-b67b-d00a69b1fb2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:50.821920 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821768    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-podinfo\") pod \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") "
Jul 18 02:21:50.821920 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821800    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-credential-socket\") pod \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\" (UID: \"73f61749-d1a0-42b7-b67b-d00a69b1fb2f\") "
Jul 18 02:21:50.822028 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.821996    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73f61749-d1a0-42b7-b67b-d00a69b1fb2f" (UID: "73f61749-d1a0-42b7-b67b-d00a69b1fb2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:21:50.822456 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.822179    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73f61749-d1a0-42b7-b67b-d00a69b1fb2f" (UID: "73f61749-d1a0-42b7-b67b-d00a69b1fb2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:50.822456 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.822146    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:50.822456 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.822260    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:50.822456 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.822385    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73f61749-d1a0-42b7-b67b-d00a69b1fb2f" (UID: "73f61749-d1a0-42b7-b67b-d00a69b1fb2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:50.824733 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.823020    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "73f61749-d1a0-42b7-b67b-d00a69b1fb2f" (UID: "73f61749-d1a0-42b7-b67b-d00a69b1fb2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:50.824733 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.824358    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73f61749-d1a0-42b7-b67b-d00a69b1fb2f" (UID: "73f61749-d1a0-42b7-b67b-d00a69b1fb2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:50.824733 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.824374    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-kube-api-access-z62lk" (OuterVolumeSpecName: "kube-api-access-z62lk") pod "73f61749-d1a0-42b7-b67b-d00a69b1fb2f" (UID: "73f61749-d1a0-42b7-b67b-d00a69b1fb2f"). InnerVolumeSpecName "kube-api-access-z62lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:21:50.824733 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.824615    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73f61749-d1a0-42b7-b67b-d00a69b1fb2f" (UID: "73f61749-d1a0-42b7-b67b-d00a69b1fb2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:21:50.825196 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.825171    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "73f61749-d1a0-42b7-b67b-d00a69b1fb2f" (UID: "73f61749-d1a0-42b7-b67b-d00a69b1fb2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:21:50.922880 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.922838    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:50.922880 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.922866    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z62lk\" (UniqueName: \"kubernetes.io/projected/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-kube-api-access-z62lk\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:50.922880 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.922876    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:50.922880 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.922886    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:50.922880 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.922893    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:50.923283 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.922903    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:50.923283 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.922911    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73f61749-d1a0-42b7-b67b-d00a69b1fb2f-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:21:50.947234 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.947199    2560 generic.go:356] "Generic (PLEG): container finished" podID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerID="fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9" exitCode=0
Jul 18 02:21:50.947396 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.947279    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"
Jul 18 02:21:50.947396 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.947282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" event={"ID":"73f61749-d1a0-42b7-b67b-d00a69b1fb2f","Type":"ContainerDied","Data":"fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9"}
Jul 18 02:21:50.947480 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.947412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx" event={"ID":"73f61749-d1a0-42b7-b67b-d00a69b1fb2f","Type":"ContainerDied","Data":"9ac7071f7c2d798a9a3fa2dc4f393ae65d23b59951f65113090f966d1c1c494d"}
Jul 18 02:21:50.947480 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.947435    2560 scope.go:117] "RemoveContainer" containerID="fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9"
Jul 18 02:21:50.956266 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.956247    2560 scope.go:117] "RemoveContainer" containerID="cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae"
Jul 18 02:21:50.965748 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.965731    2560 scope.go:117] "RemoveContainer" containerID="fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9"
Jul 18 02:21:50.965988 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:21:50.965970    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9\": container with ID starting with fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9 not found: ID does not exist" containerID="fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9"
Jul 18 02:21:50.966040 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.965996    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9"} err="failed to get container status \"fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9\": rpc error: code = NotFound desc = could not find container \"fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9\": container with ID starting with fac7af8782188ba54c6f29034f8c262bb4c4227999a6a270a1028f60ed5b9be9 not found: ID does not exist"
Jul 18 02:21:50.966040 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.966017    2560 scope.go:117] "RemoveContainer" containerID="cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae"
Jul 18 02:21:50.966225 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:21:50.966210    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae\": container with ID starting with cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae not found: ID does not exist" containerID="cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae"
Jul 18 02:21:50.966262 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.966229    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae"} err="failed to get container status \"cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae\": rpc error: code = NotFound desc = could not find container \"cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae\": container with ID starting with cb9c3ef9e6acf193207477864ba878486c9b0db53cb23065dd074019cf28b7ae not found: ID does not exist"
Jul 18 02:21:50.974656 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.974634    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"]
Jul 18 02:21:50.980685 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:50.980661    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0cc0a379-openshift-default-5ddf548bc9-qnfsx"]
Jul 18 02:21:52.746460 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:21:52.746425    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" path="/var/lib/kubelet/pods/73f61749-d1a0-42b7-b67b-d00a69b1fb2f/volumes"
Jul 18 02:22:41.179194 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.179152    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"]
Jul 18 02:22:41.179783 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.179521    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy"
Jul 18 02:22:41.179783 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.179533    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy"
Jul 18 02:22:41.179783 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.179550    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c958b6bc-8331-4497-9035-7d7603550928" containerName="main"
Jul 18 02:22:41.179783 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.179555    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c958b6bc-8331-4497-9035-7d7603550928" containerName="main"
Jul 18 02:22:41.179783 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.179567    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy"
Jul 18 02:22:41.179783 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.179573    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy"
Jul 18 02:22:41.179783 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.179618    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c958b6bc-8331-4497-9035-7d7603550928" containerName="main"
Jul 18 02:22:41.179783 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.179627    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy"
Jul 18 02:22:41.179783 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.179632    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="73f61749-d1a0-42b7-b67b-d00a69b1fb2f" containerName="istio-proxy"
Jul 18 02:22:41.182584 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.182560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.185206 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.185186    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0c89a1-openshift-default-dockercfg-nd5hs\""
Jul 18 02:22:41.192901 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.192878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"]
Jul 18 02:22:41.238849 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.238821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-certs\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.238849 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.238852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86041b04-fe75-4632-9106-d87445b0385a-istio-podinfo\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.239006 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.238872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-socket\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.239006 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.238897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-data\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.239006 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.238953    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-envoy\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.239006 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.238976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86041b04-fe75-4632-9106-d87445b0385a-istiod-ca-cert\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.239006 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.239001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-istio-token\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.239161 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.239055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-credential-socket\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.239161 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.239078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbxss\" (UniqueName: \"kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-kube-api-access-fbxss\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.340168 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-istio-token\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.340344 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-credential-socket\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.340397 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbxss\" (UniqueName: \"kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-kube-api-access-fbxss\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.340449 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-certs\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.340449 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86041b04-fe75-4632-9106-d87445b0385a-istio-podinfo\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.340546 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340467    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-socket\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.340849 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-data\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.340966 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-envoy\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.340966 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-credential-socket\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.340966 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86041b04-fe75-4632-9106-d87445b0385a-istiod-ca-cert\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.341127 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-socket\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.341127 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.340768    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-certs\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.341127 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.341112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-data\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.341470 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.341451    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86041b04-fe75-4632-9106-d87445b0385a-istiod-ca-cert\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.343070 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.343047    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86041b04-fe75-4632-9106-d87445b0385a-istio-podinfo\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.343187 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.343171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-envoy\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.349810 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.349781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-istio-token\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.350028 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.350003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbxss\" (UniqueName: \"kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-kube-api-access-fbxss\") pod \"e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") " pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.493268 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.493219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:41.631977 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.631956    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"]
Jul 18 02:22:41.634048 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:22:41.634022    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86041b04_fe75_4632_9106_d87445b0385a.slice/crio-3e474851978f0ab5275159a119ee107334562832c14d2b4fbbf2515c47ce695a WatchSource:0}: Error finding container 3e474851978f0ab5275159a119ee107334562832c14d2b4fbbf2515c47ce695a: Status 404 returned error can't find the container with id 3e474851978f0ab5275159a119ee107334562832c14d2b4fbbf2515c47ce695a
Jul 18 02:22:41.636360 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.636300    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:22:41.636474 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.636388    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:22:41.636474 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:41.636427    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:22:42.177292 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:42.177254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" event={"ID":"86041b04-fe75-4632-9106-d87445b0385a","Type":"ContainerStarted","Data":"94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc"}
Jul 18 02:22:42.177482 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:42.177316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" event={"ID":"86041b04-fe75-4632-9106-d87445b0385a","Type":"ContainerStarted","Data":"3e474851978f0ab5275159a119ee107334562832c14d2b4fbbf2515c47ce695a"}
Jul 18 02:22:42.197992 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:42.197946    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" podStartSLOduration=1.197933728 podStartE2EDuration="1.197933728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:22:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:22:42.196914573 +0000 UTC m=+2057.999159027" watchObservedRunningTime="2026-07-18 02:22:42.197933728 +0000 UTC m=+2058.000178184"
Jul 18 02:22:42.494094 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:42.494020    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:42.498846 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:42.498823    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:43.181915 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:43.181883    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:43.182855 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:43.182834    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:49.445244 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.445172    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"]
Jul 18 02:22:49.448307 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.448291    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.452829 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.452808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f0bd15-openshift-default-dockercfg-w9x7p\""
Jul 18 02:22:49.474640 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.474622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"]
Jul 18 02:22:49.607638 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.607597    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-envoy\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.607818 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.607664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-credential-socket\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.607818 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.607709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-data\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.607818 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.607742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-socket\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.607818 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.607763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-token\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.607818 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.607785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-certs\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.608023 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.607869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63d58d24-a1f2-4139-86dc-e4fa309d9569-istiod-ca-cert\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.608023 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.607890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-podinfo\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.608023 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.607917    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7cx\" (UniqueName: \"kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-kube-api-access-2j7cx\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.708994 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.708910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-credential-socket\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.708994 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.708947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-data\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.708994 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.708971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-socket\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.709239 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.708998    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-token\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.709239 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.709026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-certs\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.709239 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.709086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63d58d24-a1f2-4139-86dc-e4fa309d9569-istiod-ca-cert\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.709239 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.709110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-podinfo\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.709239 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.709134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7cx\" (UniqueName: \"kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-kube-api-access-2j7cx\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.709239 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.709203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-envoy\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.709591 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.709383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-data\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.709591 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.709412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-credential-socket\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.709591 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.709513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-certs\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.710053 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.709710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-socket\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.710053 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.709810    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63d58d24-a1f2-4139-86dc-e4fa309d9569-istiod-ca-cert\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.711558 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.711541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-envoy\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.711796 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.711776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-podinfo\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.717285 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.717261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-token\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.717412 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.717395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7cx\" (UniqueName: \"kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-kube-api-access-2j7cx\") pod \"e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") " pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.758557 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.758531    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:49.893825 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.893794    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"]
Jul 18 02:22:49.896939 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:22:49.896914    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d58d24_a1f2_4139_86dc_e4fa309d9569.slice/crio-01201d23411bda5ae80e3f6ab324a8154e13f7fd33b79f5c888078fac379719e WatchSource:0}: Error finding container 01201d23411bda5ae80e3f6ab324a8154e13f7fd33b79f5c888078fac379719e: Status 404 returned error can't find the container with id 01201d23411bda5ae80e3f6ab324a8154e13f7fd33b79f5c888078fac379719e
Jul 18 02:22:49.899258 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.899224    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:22:49.899357 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.899307    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:22:49.899403 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:49.899368    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:22:50.214041 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:50.213944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" event={"ID":"63d58d24-a1f2-4139-86dc-e4fa309d9569","Type":"ContainerStarted","Data":"514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b"}
Jul 18 02:22:50.214041 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:50.214009    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" event={"ID":"63d58d24-a1f2-4139-86dc-e4fa309d9569","Type":"ContainerStarted","Data":"01201d23411bda5ae80e3f6ab324a8154e13f7fd33b79f5c888078fac379719e"}
Jul 18 02:22:50.233449 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:50.233403    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" podStartSLOduration=1.233388998 podStartE2EDuration="1.233388998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:22:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:22:50.232047861 +0000 UTC m=+2066.034292319" watchObservedRunningTime="2026-07-18 02:22:50.233388998 +0000 UTC m=+2066.035633453"
Jul 18 02:22:50.758788 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:50.758759    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:50.763407 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:50.763385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:51.218712 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:51.218629    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:51.219719 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:51.219701    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:22:58.183793 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:58.183713    2560 patch_prober.go:28] interesting pod/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 18 02:22:58.183793 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:58.183777    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 18 02:22:58.252942 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:58.252904    2560 generic.go:356] "Generic (PLEG): container finished" podID="86041b04-fe75-4632-9106-d87445b0385a" containerID="94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc" exitCode=0
Jul 18 02:22:58.253168 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:58.252963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" event={"ID":"86041b04-fe75-4632-9106-d87445b0385a","Type":"ContainerDied","Data":"94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc"}
Jul 18 02:22:58.253450 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:58.253432    2560 scope.go:117] "RemoveContainer" containerID="94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc"
Jul 18 02:22:58.254461 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:58.254433    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:22:58.254523 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:58.254505    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:22:58.254558 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:58.254536    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:22:59.259381 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:59.259345    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" event={"ID":"86041b04-fe75-4632-9106-d87445b0385a","Type":"ContainerStarted","Data":"535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926"}
Jul 18 02:22:59.494674 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:59.494636    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:22:59.494982 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:59.494674    2560 patch_prober.go:28] interesting pod/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 18 02:22:59.495137 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:22:59.495112    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 18 02:23:00.494423 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:00.494384    2560 patch_prober.go:28] interesting pod/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 18 02:23:00.494904 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:00.494446    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 18 02:23:01.500398 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:01.493982    2560 patch_prober.go:28] interesting pod/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 18 02:23:01.500398 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:01.494038    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 18 02:23:02.494826 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:02.494303    2560 patch_prober.go:28] interesting pod/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 18 02:23:02.494826 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:02.494403    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 18 02:23:03.497521 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:03.497489    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:23:03.497908 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:03.497887    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:23:03.498604 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:03.498580    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:23:04.290415 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:04.290383    2560 generic.go:356] "Generic (PLEG): container finished" podID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerID="514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b" exitCode=0
Jul 18 02:23:04.290549 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:04.290457    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" event={"ID":"63d58d24-a1f2-4139-86dc-e4fa309d9569","Type":"ContainerDied","Data":"514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b"}
Jul 18 02:23:04.290945 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:04.290930    2560 scope.go:117] "RemoveContainer" containerID="514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b"
Jul 18 02:23:04.291843 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:04.291820    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:23:04.291903 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:04.291885    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:23:04.291941 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:04.291914    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:23:05.300718 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:05.300668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" event={"ID":"63d58d24-a1f2-4139-86dc-e4fa309d9569","Type":"ContainerStarted","Data":"78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f"}
Jul 18 02:23:05.758958 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:05.758928    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:23:05.760021 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:05.759991    2560 patch_prober.go:28] interesting pod/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 18 02:23:05.760140 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:05.760044    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 18 02:23:06.219205 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.219108    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:23:06.365850 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.365820    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"]
Jul 18 02:23:06.368477 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.368460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.372272 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.372247    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0c89a1\"/\"openshift-service-ca.crt\""
Jul 18 02:23:06.372396 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.372304    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0c89a1\"/\"kube-root-ca.crt\""
Jul 18 02:23:06.372396 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.372308    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0c89a1\"/\"test-model-0c89a1-kserve-self-signed-certs\""
Jul 18 02:23:06.372396 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.372366    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0c89a1\"/\"default-dockercfg-gzdbk\""
Jul 18 02:23:06.381027 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.381010    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"]
Jul 18 02:23:06.471148 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.471075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a694fb6-542d-489d-9ae6-009824ec99d5-tls-certs\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.471148 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.471115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkgkc\" (UniqueName: \"kubernetes.io/projected/9a694fb6-542d-489d-9ae6-009824ec99d5-kube-api-access-qkgkc\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.471371 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.471352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-tmp-dir\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.471454 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.471383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-home\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.471454 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.471397    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-dshm\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.471454 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.471418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-model-cache\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.572828 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.572799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-tmp-dir\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.572828 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.572828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-home\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.572989 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.572846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-dshm\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.572989 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.572890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-model-cache\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.572989 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.572949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a694fb6-542d-489d-9ae6-009824ec99d5-tls-certs\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.573137 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.573009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkgkc\" (UniqueName: \"kubernetes.io/projected/9a694fb6-542d-489d-9ae6-009824ec99d5-kube-api-access-qkgkc\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.573262 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.573221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-tmp-dir\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.573413 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.573283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-model-cache\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.573413 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.573372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-home\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.575006 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.574987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-dshm\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.575351 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.575310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a694fb6-542d-489d-9ae6-009824ec99d5-tls-certs\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.582471 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.582452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkgkc\" (UniqueName: \"kubernetes.io/projected/9a694fb6-542d-489d-9ae6-009824ec99d5-kube-api-access-qkgkc\") pod \"test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") " pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.677633 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.677593    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:06.759599 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.759565    2560 patch_prober.go:28] interesting pod/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 18 02:23:06.759707 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.759633    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 18 02:23:06.855399 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:06.855375    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"]
Jul 18 02:23:06.857242 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:23:06.857213    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a694fb6_542d_489d_9ae6_009824ec99d5.slice/crio-01d8618f29dba30aae1ed6bcca0b386e7279eb817c09b0422f90f3644faaa369 WatchSource:0}: Error finding container 01d8618f29dba30aae1ed6bcca0b386e7279eb817c09b0422f90f3644faaa369: Status 404 returned error can't find the container with id 01d8618f29dba30aae1ed6bcca0b386e7279eb817c09b0422f90f3644faaa369
Jul 18 02:23:07.317462 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:07.317413    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr" event={"ID":"9a694fb6-542d-489d-9ae6-009824ec99d5","Type":"ContainerStarted","Data":"83d9b4efb4f4148aa08d2238c63ad57d112bd136106f8e159161a5e0e7094444"}
Jul 18 02:23:07.317462 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:07.317464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr" event={"ID":"9a694fb6-542d-489d-9ae6-009824ec99d5","Type":"ContainerStarted","Data":"01d8618f29dba30aae1ed6bcca0b386e7279eb817c09b0422f90f3644faaa369"}
Jul 18 02:23:07.337357 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:07.337296    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr" podStartSLOduration=1.337282787 podStartE2EDuration="1.337282787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:23:07.335260959 +0000 UTC m=+2083.137505415" watchObservedRunningTime="2026-07-18 02:23:07.337282787 +0000 UTC m=+2083.139527243"
Jul 18 02:23:07.759674 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:07.759643    2560 patch_prober.go:28] interesting pod/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 18 02:23:07.760013 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:07.759695    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 18 02:23:08.759503 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:08.759470    2560 patch_prober.go:28] interesting pod/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 18 02:23:08.759668 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:08.759519    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 18 02:23:09.762906 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:09.762876    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:23:09.763887 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:09.763869    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:23:16.678694 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:16.678664    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:16.679066 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:16.678709    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:16.690930 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:16.690902    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:17.378724 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:17.378695    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:23:24.735110 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:24.735081    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:23:24.741709 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:23:24.741687    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:24:05.504647 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:05.504612    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"]
Jul 18 02:24:20.525350 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.525252    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr" podUID="9a694fb6-542d-489d-9ae6-009824ec99d5" containerName="main" containerID="cri-o://83d9b4efb4f4148aa08d2238c63ad57d112bd136106f8e159161a5e0e7094444" gracePeriod=45
Jul 18 02:24:20.675174 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.675144    2560 generic.go:356] "Generic (PLEG): container finished" podID="9a694fb6-542d-489d-9ae6-009824ec99d5" containerID="83d9b4efb4f4148aa08d2238c63ad57d112bd136106f8e159161a5e0e7094444" exitCode=0
Jul 18 02:24:20.675361 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.675224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr" event={"ID":"9a694fb6-542d-489d-9ae6-009824ec99d5","Type":"ContainerDied","Data":"83d9b4efb4f4148aa08d2238c63ad57d112bd136106f8e159161a5e0e7094444"}
Jul 18 02:24:20.776800 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.776736    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:24:20.899684 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.899653    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-dshm\") pod \"9a694fb6-542d-489d-9ae6-009824ec99d5\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") "
Jul 18 02:24:20.899684 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.899686    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a694fb6-542d-489d-9ae6-009824ec99d5-tls-certs\") pod \"9a694fb6-542d-489d-9ae6-009824ec99d5\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") "
Jul 18 02:24:20.899951 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.899707    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-tmp-dir\") pod \"9a694fb6-542d-489d-9ae6-009824ec99d5\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") "
Jul 18 02:24:20.899951 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.899725    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-model-cache\") pod \"9a694fb6-542d-489d-9ae6-009824ec99d5\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") "
Jul 18 02:24:20.899951 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.899772    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkgkc\" (UniqueName: \"kubernetes.io/projected/9a694fb6-542d-489d-9ae6-009824ec99d5-kube-api-access-qkgkc\") pod \"9a694fb6-542d-489d-9ae6-009824ec99d5\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") "
Jul 18 02:24:20.899951 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.899824    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-home\") pod \"9a694fb6-542d-489d-9ae6-009824ec99d5\" (UID: \"9a694fb6-542d-489d-9ae6-009824ec99d5\") "
Jul 18 02:24:20.900169 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.900004    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-model-cache" (OuterVolumeSpecName: "model-cache") pod "9a694fb6-542d-489d-9ae6-009824ec99d5" (UID: "9a694fb6-542d-489d-9ae6-009824ec99d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:20.900169 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.900018    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9a694fb6-542d-489d-9ae6-009824ec99d5" (UID: "9a694fb6-542d-489d-9ae6-009824ec99d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:20.900169 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.900138    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-home" (OuterVolumeSpecName: "home") pod "9a694fb6-542d-489d-9ae6-009824ec99d5" (UID: "9a694fb6-542d-489d-9ae6-009824ec99d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:20.900169 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.900163    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-tmp-dir\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:20.900362 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.900181    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-model-cache\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:20.902079 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.902061    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-dshm" (OuterVolumeSpecName: "dshm") pod "9a694fb6-542d-489d-9ae6-009824ec99d5" (UID: "9a694fb6-542d-489d-9ae6-009824ec99d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:20.902153 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.902104    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a694fb6-542d-489d-9ae6-009824ec99d5-kube-api-access-qkgkc" (OuterVolumeSpecName: "kube-api-access-qkgkc") pod "9a694fb6-542d-489d-9ae6-009824ec99d5" (UID: "9a694fb6-542d-489d-9ae6-009824ec99d5"). InnerVolumeSpecName "kube-api-access-qkgkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:24:20.902214 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:20.902174    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a694fb6-542d-489d-9ae6-009824ec99d5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9a694fb6-542d-489d-9ae6-009824ec99d5" (UID: "9a694fb6-542d-489d-9ae6-009824ec99d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:24:21.001489 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:21.001451    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-dshm\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:21.001489 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:21.001480    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a694fb6-542d-489d-9ae6-009824ec99d5-tls-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:21.001489 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:21.001489    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkgkc\" (UniqueName: \"kubernetes.io/projected/9a694fb6-542d-489d-9ae6-009824ec99d5-kube-api-access-qkgkc\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:21.001489 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:21.001497    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a694fb6-542d-489d-9ae6-009824ec99d5-home\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:21.680824 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:21.680781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr" event={"ID":"9a694fb6-542d-489d-9ae6-009824ec99d5","Type":"ContainerDied","Data":"01d8618f29dba30aae1ed6bcca0b386e7279eb817c09b0422f90f3644faaa369"}
Jul 18 02:24:21.680824 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:21.680817    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"
Jul 18 02:24:21.681306 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:21.680839    2560 scope.go:117] "RemoveContainer" containerID="83d9b4efb4f4148aa08d2238c63ad57d112bd136106f8e159161a5e0e7094444"
Jul 18 02:24:21.702601 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:21.702567    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"]
Jul 18 02:24:21.704180 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:21.704155    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0c89a1/test-model-0c89a1-kserve-6cbdd8ff4f-5dgwr"]
Jul 18 02:24:22.745500 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:22.745465    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a694fb6-542d-489d-9ae6-009824ec99d5" path="/var/lib/kubelet/pods/9a694fb6-542d-489d-9ae6-009824ec99d5/volumes"
Jul 18 02:24:38.107711 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:38.107672    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"]
Jul 18 02:24:38.108242 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:38.107923    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy" containerID="cri-o://535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926" gracePeriod=30
Jul 18 02:24:43.361957 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.361927    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:24:43.490819 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.490755    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-istio-token\") pod \"86041b04-fe75-4632-9106-d87445b0385a\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") "
Jul 18 02:24:43.490819 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.490798    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbxss\" (UniqueName: \"kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-kube-api-access-fbxss\") pod \"86041b04-fe75-4632-9106-d87445b0385a\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") "
Jul 18 02:24:43.490987 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.490827    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-data\") pod \"86041b04-fe75-4632-9106-d87445b0385a\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") "
Jul 18 02:24:43.490987 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.490848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-certs\") pod \"86041b04-fe75-4632-9106-d87445b0385a\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") "
Jul 18 02:24:43.490987 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.490874    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86041b04-fe75-4632-9106-d87445b0385a-istio-podinfo\") pod \"86041b04-fe75-4632-9106-d87445b0385a\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") "
Jul 18 02:24:43.490987 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.490918    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-envoy\") pod \"86041b04-fe75-4632-9106-d87445b0385a\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") "
Jul 18 02:24:43.490987 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.490973    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86041b04-fe75-4632-9106-d87445b0385a-istiod-ca-cert\") pod \"86041b04-fe75-4632-9106-d87445b0385a\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") "
Jul 18 02:24:43.491214 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.491028    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-credential-socket\") pod \"86041b04-fe75-4632-9106-d87445b0385a\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") "
Jul 18 02:24:43.491214 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.491064    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-socket\") pod \"86041b04-fe75-4632-9106-d87445b0385a\" (UID: \"86041b04-fe75-4632-9106-d87445b0385a\") "
Jul 18 02:24:43.491214 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.491137    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "86041b04-fe75-4632-9106-d87445b0385a" (UID: "86041b04-fe75-4632-9106-d87445b0385a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:43.491403 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.491370    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:43.491461 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.491437    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86041b04-fe75-4632-9106-d87445b0385a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "86041b04-fe75-4632-9106-d87445b0385a" (UID: "86041b04-fe75-4632-9106-d87445b0385a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:24:43.491701 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.491676    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "86041b04-fe75-4632-9106-d87445b0385a" (UID: "86041b04-fe75-4632-9106-d87445b0385a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:43.491787 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.491728    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "86041b04-fe75-4632-9106-d87445b0385a" (UID: "86041b04-fe75-4632-9106-d87445b0385a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:43.491855 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.491830    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-data" (OuterVolumeSpecName: "istio-data") pod "86041b04-fe75-4632-9106-d87445b0385a" (UID: "86041b04-fe75-4632-9106-d87445b0385a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:43.493098 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.493074    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-istio-token" (OuterVolumeSpecName: "istio-token") pod "86041b04-fe75-4632-9106-d87445b0385a" (UID: "86041b04-fe75-4632-9106-d87445b0385a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:24:43.493527 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.493501    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "86041b04-fe75-4632-9106-d87445b0385a" (UID: "86041b04-fe75-4632-9106-d87445b0385a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:43.493688 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.493666    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86041b04-fe75-4632-9106-d87445b0385a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "86041b04-fe75-4632-9106-d87445b0385a" (UID: "86041b04-fe75-4632-9106-d87445b0385a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:24:43.493747 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.493678    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-kube-api-access-fbxss" (OuterVolumeSpecName: "kube-api-access-fbxss") pod "86041b04-fe75-4632-9106-d87445b0385a" (UID: "86041b04-fe75-4632-9106-d87445b0385a"). InnerVolumeSpecName "kube-api-access-fbxss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:24:43.592448 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.592419    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:43.592448 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.592444    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86041b04-fe75-4632-9106-d87445b0385a-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:43.592597 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.592458    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:43.592597 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.592471    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:43.592597 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.592483    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:43.592597 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.592496    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbxss\" (UniqueName: \"kubernetes.io/projected/86041b04-fe75-4632-9106-d87445b0385a-kube-api-access-fbxss\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:43.592597 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.592508    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86041b04-fe75-4632-9106-d87445b0385a-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:43.592597 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.592521    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86041b04-fe75-4632-9106-d87445b0385a-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:24:43.794200 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.794166    2560 generic.go:356] "Generic (PLEG): container finished" podID="86041b04-fe75-4632-9106-d87445b0385a" containerID="535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926" exitCode=0
Jul 18 02:24:43.794308 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.794228    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"
Jul 18 02:24:43.794308 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.794259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" event={"ID":"86041b04-fe75-4632-9106-d87445b0385a","Type":"ContainerDied","Data":"535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926"}
Jul 18 02:24:43.794414 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.794354    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv" event={"ID":"86041b04-fe75-4632-9106-d87445b0385a","Type":"ContainerDied","Data":"3e474851978f0ab5275159a119ee107334562832c14d2b4fbbf2515c47ce695a"}
Jul 18 02:24:43.794414 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.794391    2560 scope.go:117] "RemoveContainer" containerID="535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926"
Jul 18 02:24:43.804669 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.804647    2560 scope.go:117] "RemoveContainer" containerID="94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc"
Jul 18 02:24:43.813581 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.813553    2560 scope.go:117] "RemoveContainer" containerID="535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926"
Jul 18 02:24:43.814028 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:24:43.813990    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926\": container with ID starting with 535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926 not found: ID does not exist" containerID="535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926"
Jul 18 02:24:43.814146 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.814039    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926"} err="failed to get container status \"535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926\": rpc error: code = NotFound desc = could not find container \"535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926\": container with ID starting with 535fd01016a8f2501954e49e35583d04cd14e3fe8bbc5a3b89df04c106e3d926 not found: ID does not exist"
Jul 18 02:24:43.814146 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.814064    2560 scope.go:117] "RemoveContainer" containerID="94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc"
Jul 18 02:24:43.814534 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:24:43.814485    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc\": container with ID starting with 94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc not found: ID does not exist" containerID="94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc"
Jul 18 02:24:43.814534 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.814523    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc"} err="failed to get container status \"94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc\": rpc error: code = NotFound desc = could not find container \"94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc\": container with ID starting with 94965880f80fadb600e289e3f573a215f15f1ca34edb5403f53e452fa7331dfc not found: ID does not exist"
Jul 18 02:24:43.816482 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.816461    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"]
Jul 18 02:24:43.820647 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:43.820619    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0c89a1-openshift-default-7847784665-25tcv"]
Jul 18 02:24:44.745688 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:24:44.745658    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86041b04-fe75-4632-9106-d87445b0385a" path="/var/lib/kubelet/pods/86041b04-fe75-4632-9106-d87445b0385a/volumes"
Jul 18 02:25:00.177936 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:00.176697    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"]
Jul 18 02:25:00.177936 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:00.177082    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy" containerID="cri-o://78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f" gracePeriod=30
Jul 18 02:25:01.072453 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.072415    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"]
Jul 18 02:25:01.072778 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.072765    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a694fb6-542d-489d-9ae6-009824ec99d5" containerName="main"
Jul 18 02:25:01.072827 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.072779    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a694fb6-542d-489d-9ae6-009824ec99d5" containerName="main"
Jul 18 02:25:01.072827 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.072790    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy"
Jul 18 02:25:01.072827 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.072796    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy"
Jul 18 02:25:01.072827 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.072802    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy"
Jul 18 02:25:01.072827 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.072812    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy"
Jul 18 02:25:01.072981 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.072880    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy"
Jul 18 02:25:01.072981 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.072893    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="86041b04-fe75-4632-9106-d87445b0385a" containerName="istio-proxy"
Jul 18 02:25:01.072981 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.072901    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a694fb6-542d-489d-9ae6-009824ec99d5" containerName="main"
Jul 18 02:25:01.075730 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.075713    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.078589 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.078564    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-9a3654-openshift-default-dockercfg-wgrs5\""
Jul 18 02:25:01.088447 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.088423    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"]
Jul 18 02:25:01.235364 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.235311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-envoy\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.235739 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.235415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-socket\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.235739 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.235449    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-data\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.235739 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.235510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-credential-socket\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.235739 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.235538    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-token\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.235739 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.235558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-podinfo\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.235739 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.235636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-certs\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.235739 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.235672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istiod-ca-cert\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.235739 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.235699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb66v\" (UniqueName: \"kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-kube-api-access-wb66v\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336195 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-credential-socket\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336195 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-token\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336195 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-podinfo\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336485 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-certs\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336485 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istiod-ca-cert\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336485 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb66v\" (UniqueName: \"kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-kube-api-access-wb66v\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336485 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-envoy\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336485 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-socket\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336485 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-data\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336787 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-credential-socket\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336787 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-certs\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336889 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336832    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-socket\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.336889 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.336847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-data\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.337214 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.337143    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istiod-ca-cert\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.338767 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.338747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-envoy\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.338886 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.338870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-podinfo\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.349036 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.349010    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-token\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.350344 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.350310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb66v\" (UniqueName: \"kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-kube-api-access-wb66v\") pod \"e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") " pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.385292 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.385273    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:01.518723 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.518704    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"]
Jul 18 02:25:01.520684 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:25:01.520662    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea10a271_ddee_457f_9ce7_bd2784ea8d82.slice/crio-e1e53996ec540dbc9fd8305b57e58108507d5c2c643acc9546e27876bb185e5b WatchSource:0}: Error finding container e1e53996ec540dbc9fd8305b57e58108507d5c2c643acc9546e27876bb185e5b: Status 404 returned error can't find the container with id e1e53996ec540dbc9fd8305b57e58108507d5c2c643acc9546e27876bb185e5b
Jul 18 02:25:01.522831 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.522802    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:01.522931 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.522860    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:01.522931 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.522886    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:01.885009 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.884975    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" event={"ID":"ea10a271-ddee-457f-9ce7-bd2784ea8d82","Type":"ContainerStarted","Data":"15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9"}
Jul 18 02:25:01.885198 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.885042    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" event={"ID":"ea10a271-ddee-457f-9ce7-bd2784ea8d82","Type":"ContainerStarted","Data":"e1e53996ec540dbc9fd8305b57e58108507d5c2c643acc9546e27876bb185e5b"}
Jul 18 02:25:01.908868 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:01.908824    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" podStartSLOduration=0.908808906 podStartE2EDuration="908.808906ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:25:01.907022281 +0000 UTC m=+2197.709266738" watchObservedRunningTime="2026-07-18 02:25:01.908808906 +0000 UTC m=+2197.711053363"
Jul 18 02:25:02.386480 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:02.386447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:02.390931 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:02.390907    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:02.890234 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:02.890195    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:02.890999 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:02.890977    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:05.430925 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.430901    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:25:05.569804 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.569778    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j7cx\" (UniqueName: \"kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-kube-api-access-2j7cx\") pod \"63d58d24-a1f2-4139-86dc-e4fa309d9569\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") "
Jul 18 02:25:05.569938 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.569845    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-data\") pod \"63d58d24-a1f2-4139-86dc-e4fa309d9569\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") "
Jul 18 02:25:05.569938 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.569914    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-socket\") pod \"63d58d24-a1f2-4139-86dc-e4fa309d9569\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") "
Jul 18 02:25:05.570046 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.569940    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63d58d24-a1f2-4139-86dc-e4fa309d9569-istiod-ca-cert\") pod \"63d58d24-a1f2-4139-86dc-e4fa309d9569\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") "
Jul 18 02:25:05.570046 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.569980    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-envoy\") pod \"63d58d24-a1f2-4139-86dc-e4fa309d9569\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") "
Jul 18 02:25:05.570046 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570019    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-token\") pod \"63d58d24-a1f2-4139-86dc-e4fa309d9569\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") "
Jul 18 02:25:05.570198 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570057    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-credential-socket\") pod \"63d58d24-a1f2-4139-86dc-e4fa309d9569\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") "
Jul 18 02:25:05.570253 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570198    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63d58d24-a1f2-4139-86dc-e4fa309d9569" (UID: "63d58d24-a1f2-4139-86dc-e4fa309d9569"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:05.570335 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570289    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63d58d24-a1f2-4139-86dc-e4fa309d9569" (UID: "63d58d24-a1f2-4139-86dc-e4fa309d9569"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:05.570402 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570359    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d58d24-a1f2-4139-86dc-e4fa309d9569-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63d58d24-a1f2-4139-86dc-e4fa309d9569" (UID: "63d58d24-a1f2-4139-86dc-e4fa309d9569"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:25:05.570402 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-certs\") pod \"63d58d24-a1f2-4139-86dc-e4fa309d9569\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") "
Jul 18 02:25:05.570512 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570427    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-podinfo\") pod \"63d58d24-a1f2-4139-86dc-e4fa309d9569\" (UID: \"63d58d24-a1f2-4139-86dc-e4fa309d9569\") "
Jul 18 02:25:05.570567 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570541    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63d58d24-a1f2-4139-86dc-e4fa309d9569" (UID: "63d58d24-a1f2-4139-86dc-e4fa309d9569"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:05.570758 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570734    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-data" (OuterVolumeSpecName: "istio-data") pod "63d58d24-a1f2-4139-86dc-e4fa309d9569" (UID: "63d58d24-a1f2-4139-86dc-e4fa309d9569"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:05.570830 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570747    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:05.570830 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570776    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63d58d24-a1f2-4139-86dc-e4fa309d9569-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:05.570830 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570788    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:05.570830 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.570798    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:05.572337 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.572304    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-token" (OuterVolumeSpecName: "istio-token") pod "63d58d24-a1f2-4139-86dc-e4fa309d9569" (UID: "63d58d24-a1f2-4139-86dc-e4fa309d9569"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:25:05.572698 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.572670    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63d58d24-a1f2-4139-86dc-e4fa309d9569" (UID: "63d58d24-a1f2-4139-86dc-e4fa309d9569"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:25:05.572698 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.572695    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63d58d24-a1f2-4139-86dc-e4fa309d9569" (UID: "63d58d24-a1f2-4139-86dc-e4fa309d9569"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:05.572882 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.572706    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-kube-api-access-2j7cx" (OuterVolumeSpecName: "kube-api-access-2j7cx") pod "63d58d24-a1f2-4139-86dc-e4fa309d9569" (UID: "63d58d24-a1f2-4139-86dc-e4fa309d9569"). InnerVolumeSpecName "kube-api-access-2j7cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:25:05.671184 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.671159    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:05.671184 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.671181    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:05.671344 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.671190    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:05.671344 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.671198    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63d58d24-a1f2-4139-86dc-e4fa309d9569-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:05.671344 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.671206    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j7cx\" (UniqueName: \"kubernetes.io/projected/63d58d24-a1f2-4139-86dc-e4fa309d9569-kube-api-access-2j7cx\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:05.905997 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.905934    2560 generic.go:356] "Generic (PLEG): container finished" podID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerID="78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f" exitCode=0
Jul 18 02:25:05.905997 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.905980    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"
Jul 18 02:25:05.905997 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.905994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" event={"ID":"63d58d24-a1f2-4139-86dc-e4fa309d9569","Type":"ContainerDied","Data":"78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f"}
Jul 18 02:25:05.906176 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.906036    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92" event={"ID":"63d58d24-a1f2-4139-86dc-e4fa309d9569","Type":"ContainerDied","Data":"01201d23411bda5ae80e3f6ab324a8154e13f7fd33b79f5c888078fac379719e"}
Jul 18 02:25:05.906176 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.906057    2560 scope.go:117] "RemoveContainer" containerID="78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f"
Jul 18 02:25:05.915412 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.915396    2560 scope.go:117] "RemoveContainer" containerID="514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b"
Jul 18 02:25:05.923230 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.923214    2560 scope.go:117] "RemoveContainer" containerID="78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f"
Jul 18 02:25:05.923486 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:25:05.923467    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f\": container with ID starting with 78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f not found: ID does not exist" containerID="78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f"
Jul 18 02:25:05.923569 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.923497    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f"} err="failed to get container status \"78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f\": rpc error: code = NotFound desc = could not find container \"78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f\": container with ID starting with 78b2e14283246adc76bcfd1ae13bea13f992fee7a3602fbf3583bdfa7cc8327f not found: ID does not exist"
Jul 18 02:25:05.923569 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.923521    2560 scope.go:117] "RemoveContainer" containerID="514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b"
Jul 18 02:25:05.923774 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:25:05.923757    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b\": container with ID starting with 514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b not found: ID does not exist" containerID="514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b"
Jul 18 02:25:05.923817 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.923780    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b"} err="failed to get container status \"514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b\": rpc error: code = NotFound desc = could not find container \"514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b\": container with ID starting with 514b228687cd72369524b613b483ca5f28c94fb510230da0e0055272781a9b9b not found: ID does not exist"
Jul 18 02:25:05.932066 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.932042    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"]
Jul 18 02:25:05.938502 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:05.938482    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f0bd15-openshift-default-785d89dbb7-gst92"]
Jul 18 02:25:06.745788 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:06.745755    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" path="/var/lib/kubelet/pods/63d58d24-a1f2-4139-86dc-e4fa309d9569/volumes"
Jul 18 02:25:09.076132 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.076088    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"]
Jul 18 02:25:09.076539 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.076491    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy"
Jul 18 02:25:09.076539 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.076506    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy"
Jul 18 02:25:09.076610 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.076576    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy"
Jul 18 02:25:09.076610 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.076585    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy"
Jul 18 02:25:09.081248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.081226    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.084231 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.084210    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a724ed-openshift-default-dockercfg-7kdh5\""
Jul 18 02:25:09.092849 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.092826    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"]
Jul 18 02:25:09.197626 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.197602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-socket\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.197756 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.197639    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-certs\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.197756 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.197674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istiod-ca-cert\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.197756 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.197716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-data\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.197756 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.197748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-podinfo\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.197915 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.197771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz6xf\" (UniqueName: \"kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-kube-api-access-pz6xf\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.197915 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.197797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-credential-socket\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.197915 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.197820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-token\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.197915 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.197886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-envoy\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299282 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istiod-ca-cert\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299456 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-data\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299456 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-podinfo\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299456 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz6xf\" (UniqueName: \"kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-kube-api-access-pz6xf\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299456 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-credential-socket\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299642 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-token\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299642 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-envoy\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299642 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-socket\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299642 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-certs\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299833 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299718    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-data\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.299891 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-credential-socket\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.300016 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.299993    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-socket\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.300073 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.300041    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-certs\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.300111 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.300078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istiod-ca-cert\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.301975 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.301953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-podinfo\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.302070 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.302011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-envoy\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.308370 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.308344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-token\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.308586 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.308567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz6xf\" (UniqueName: \"kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-kube-api-access-pz6xf\") pod \"e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") " pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.392997 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.392941    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:09.538400 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.538374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"]
Jul 18 02:25:09.539421 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:25:09.539396    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee8c240_f5d9_4de4_b31c_b2de05bbb80f.slice/crio-7cbec946618f29e0fbefa596865c8ab6dee66bab65e1a0d30d7ac31d82410c31 WatchSource:0}: Error finding container 7cbec946618f29e0fbefa596865c8ab6dee66bab65e1a0d30d7ac31d82410c31: Status 404 returned error can't find the container with id 7cbec946618f29e0fbefa596865c8ab6dee66bab65e1a0d30d7ac31d82410c31
Jul 18 02:25:09.541534 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.541500    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:09.541635 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.541573    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:09.541635 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.541602    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:09.929961 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.929923    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" event={"ID":"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f","Type":"ContainerStarted","Data":"b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1"}
Jul 18 02:25:09.930165 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.929987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" event={"ID":"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f","Type":"ContainerStarted","Data":"7cbec946618f29e0fbefa596865c8ab6dee66bab65e1a0d30d7ac31d82410c31"}
Jul 18 02:25:09.951539 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:09.951495    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" podStartSLOduration=0.951479537 podStartE2EDuration="951.479537ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:25:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:25:09.949824253 +0000 UTC m=+2205.752068710" watchObservedRunningTime="2026-07-18 02:25:09.951479537 +0000 UTC m=+2205.753723993"
Jul 18 02:25:10.394044 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:10.394021    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:10.398914 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:10.398889    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:10.935314 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:10.935284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:10.936291 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:10.936271    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:18.932468 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:18.932427    2560 patch_prober.go:28] interesting pod/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 18 02:25:18.932933 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:18.932548    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 18 02:25:19.981541 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:19.981442    2560 generic.go:356] "Generic (PLEG): container finished" podID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerID="15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9" exitCode=0
Jul 18 02:25:19.981541 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:19.981519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" event={"ID":"ea10a271-ddee-457f-9ce7-bd2784ea8d82","Type":"ContainerDied","Data":"15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9"}
Jul 18 02:25:19.982105 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:19.982039    2560 scope.go:117] "RemoveContainer" containerID="15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9"
Jul 18 02:25:19.983231 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:19.983200    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:19.983448 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:19.983285    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:19.983448 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:19.983346    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:21.004401 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:21.004355    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" event={"ID":"ea10a271-ddee-457f-9ce7-bd2784ea8d82","Type":"ContainerStarted","Data":"d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1"}
Jul 18 02:25:21.385805 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:21.385712    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:21.385957 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:21.385935    2560 patch_prober.go:28] interesting pod/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 18 02:25:21.386013 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:21.385992    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 18 02:25:22.386196 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:22.386151    2560 patch_prober.go:28] interesting pod/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 18 02:25:22.386715 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:22.386213    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 18 02:25:23.386005 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:23.385972    2560 patch_prober.go:28] interesting pod/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 18 02:25:23.386192 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:23.386131    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 18 02:25:24.386337 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:24.386293    2560 patch_prober.go:28] interesting pod/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 18 02:25:24.386813 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:24.386383    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 18 02:25:25.389470 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:25.389443    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:25.389881 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:25.389807    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:25.390400 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:25.390385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:26.976486 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:26.976447    2560 patch_prober.go:28] interesting pod/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 18 02:25:26.976852 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:26.976512    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 18 02:25:28.045175 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:28.045111    2560 generic.go:356] "Generic (PLEG): container finished" podID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerID="b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1" exitCode=0
Jul 18 02:25:28.045537 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:28.045186    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" event={"ID":"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f","Type":"ContainerDied","Data":"b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1"}
Jul 18 02:25:28.045644 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:28.045628    2560 scope.go:117] "RemoveContainer" containerID="b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1"
Jul 18 02:25:28.046822 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:28.046789    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:28.046918 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:28.046869    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:28.046918 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:28.046905    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:25:29.051168 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:29.051132    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" event={"ID":"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f","Type":"ContainerStarted","Data":"cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51"}
Jul 18 02:25:29.393525 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:29.393442    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:29.394194 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:29.393792    2560 patch_prober.go:28] interesting pod/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 18 02:25:29.394194 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:29.393930    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 18 02:25:30.393482 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:30.393445    2560 patch_prober.go:28] interesting pod/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 18 02:25:30.394058 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:30.394026    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 18 02:25:31.393768 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:31.393726    2560 patch_prober.go:28] interesting pod/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 18 02:25:31.394436 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:31.394396    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 18 02:25:32.394239 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:32.393623    2560 patch_prober.go:28] interesting pod/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 18 02:25:32.394239 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:32.393679    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 18 02:25:33.397339 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:33.397287    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:33.397768 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:33.397750    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:33.398499 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:33.398482    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:25:50.846274 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:50.846198    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"]
Jul 18 02:25:50.846847 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:50.846488    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy" containerID="cri-o://d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1" gracePeriod=30
Jul 18 02:25:55.392098 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:55.392052    2560 patch_prober.go:28] interesting pod/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 02:25:55.392570 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:55.392134    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 02:25:56.091248 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.091222    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:56.185899 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.185825    2560 generic.go:356] "Generic (PLEG): container finished" podID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerID="d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1" exitCode=0
Jul 18 02:25:56.185899 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.185866    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"
Jul 18 02:25:56.186082 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.185899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" event={"ID":"ea10a271-ddee-457f-9ce7-bd2784ea8d82","Type":"ContainerDied","Data":"d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1"}
Jul 18 02:25:56.186082 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.185950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s" event={"ID":"ea10a271-ddee-457f-9ce7-bd2784ea8d82","Type":"ContainerDied","Data":"e1e53996ec540dbc9fd8305b57e58108507d5c2c643acc9546e27876bb185e5b"}
Jul 18 02:25:56.186082 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.185975    2560 scope.go:117] "RemoveContainer" containerID="d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1"
Jul 18 02:25:56.194453 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.194437    2560 scope.go:117] "RemoveContainer" containerID="15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9"
Jul 18 02:25:56.203865 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.203846    2560 scope.go:117] "RemoveContainer" containerID="d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1"
Jul 18 02:25:56.204176 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:25:56.204144    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1\": container with ID starting with d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1 not found: ID does not exist" containerID="d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1"
Jul 18 02:25:56.204240 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.204185    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1"} err="failed to get container status \"d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1\": rpc error: code = NotFound desc = could not find container \"d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1\": container with ID starting with d914bfa4ba6a7ed1a01339b1a4390a8e514b972ac85fc8f15ad4797079688ad1 not found: ID does not exist"
Jul 18 02:25:56.204240 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.204205    2560 scope.go:117] "RemoveContainer" containerID="15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9"
Jul 18 02:25:56.204471 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:25:56.204446    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9\": container with ID starting with 15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9 not found: ID does not exist" containerID="15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9"
Jul 18 02:25:56.204522 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.204483    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9"} err="failed to get container status \"15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9\": rpc error: code = NotFound desc = could not find container \"15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9\": container with ID starting with 15eeec45792306c5055117b11637af282d29d52c7b5b1adc84f1671adea7bcb9 not found: ID does not exist"
Jul 18 02:25:56.218210 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218191    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-socket\") pod \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") "
Jul 18 02:25:56.218334 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218219    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-certs\") pod \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") "
Jul 18 02:25:56.218334 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218264    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-token\") pod \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") "
Jul 18 02:25:56.218334 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218286    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb66v\" (UniqueName: \"kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-kube-api-access-wb66v\") pod \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") "
Jul 18 02:25:56.218502 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218363    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istiod-ca-cert\") pod \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") "
Jul 18 02:25:56.218502 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218387    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-podinfo\") pod \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") "
Jul 18 02:25:56.218502 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218436    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-envoy\") pod \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") "
Jul 18 02:25:56.218502 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218480    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-data\") pod \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") "
Jul 18 02:25:56.218502 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218485    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea10a271-ddee-457f-9ce7-bd2784ea8d82" (UID: "ea10a271-ddee-457f-9ce7-bd2784ea8d82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:56.218741 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218507    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea10a271-ddee-457f-9ce7-bd2784ea8d82" (UID: "ea10a271-ddee-457f-9ce7-bd2784ea8d82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:56.218741 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218517    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-credential-socket\") pod \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\" (UID: \"ea10a271-ddee-457f-9ce7-bd2784ea8d82\") "
Jul 18 02:25:56.218840 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218792    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea10a271-ddee-457f-9ce7-bd2784ea8d82" (UID: "ea10a271-ddee-457f-9ce7-bd2784ea8d82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:25:56.218969 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218949    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:56.219033 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218974    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:56.219033 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.218989    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:56.219598 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.219559    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea10a271-ddee-457f-9ce7-bd2784ea8d82" (UID: "ea10a271-ddee-457f-9ce7-bd2784ea8d82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:56.219871 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.219851    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea10a271-ddee-457f-9ce7-bd2784ea8d82" (UID: "ea10a271-ddee-457f-9ce7-bd2784ea8d82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:56.220729 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.220700    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea10a271-ddee-457f-9ce7-bd2784ea8d82" (UID: "ea10a271-ddee-457f-9ce7-bd2784ea8d82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:25:56.220729 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.220705    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea10a271-ddee-457f-9ce7-bd2784ea8d82" (UID: "ea10a271-ddee-457f-9ce7-bd2784ea8d82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:56.221084 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.221058    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea10a271-ddee-457f-9ce7-bd2784ea8d82" (UID: "ea10a271-ddee-457f-9ce7-bd2784ea8d82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:25:56.221084 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.221069    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-kube-api-access-wb66v" (OuterVolumeSpecName: "kube-api-access-wb66v") pod "ea10a271-ddee-457f-9ce7-bd2784ea8d82" (UID: "ea10a271-ddee-457f-9ce7-bd2784ea8d82"). InnerVolumeSpecName "kube-api-access-wb66v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:25:56.319458 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.319438    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:56.319527 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.319459    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb66v\" (UniqueName: \"kubernetes.io/projected/ea10a271-ddee-457f-9ce7-bd2784ea8d82-kube-api-access-wb66v\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:56.319527 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.319474    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:56.319527 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.319485    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:56.319527 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.319492    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:56.319527 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.319501    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea10a271-ddee-457f-9ce7-bd2784ea8d82-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:25:56.511035 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.511009    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"]
Jul 18 02:25:56.515018 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.514995    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-9a3654-openshift-default-66d99cbcc9-rn52s"]
Jul 18 02:25:56.746204 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:25:56.746140    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" path="/var/lib/kubelet/pods/ea10a271-ddee-457f-9ce7-bd2784ea8d82/volumes"
Jul 18 02:26:18.052766 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:18.052722    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"]
Jul 18 02:26:18.053250 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:18.053017    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy" containerID="cri-o://cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51" gracePeriod=30
Jul 18 02:26:18.399861 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:18.399778    2560 patch_prober.go:28] interesting pod/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 02:26:18.399861 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:18.399828    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 02:26:19.007872 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.007839    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"]
Jul 18 02:26:19.008195 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.008180    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy"
Jul 18 02:26:19.008245 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.008200    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d58d24-a1f2-4139-86dc-e4fa309d9569" containerName="istio-proxy"
Jul 18 02:26:19.008245 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.008227    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy"
Jul 18 02:26:19.008245 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.008233    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy"
Jul 18 02:26:19.008370 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.008297    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy"
Jul 18 02:26:19.008370 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.008306    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy"
Jul 18 02:26:19.010334 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.010303    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.013196 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.013176    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-deec4e-openshift-default-dockercfg-xc7lf\""
Jul 18 02:26:19.023436 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.023414    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"]
Jul 18 02:26:19.098853 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.098823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-data\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.099373 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.098876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istiod-ca-cert\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.099373 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.098913    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtc6n\" (UniqueName: \"kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-kube-api-access-mtc6n\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.099373 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.098955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-token\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.099373 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.099019    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-credential-socket\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.099373 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.099059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-podinfo\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.099373 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.099086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-socket\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.099373 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.099110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-envoy\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.099373 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.099137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-certs\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200306 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-credential-socket\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200488 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200339    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-podinfo\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200488 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-socket\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200488 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-envoy\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200488 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200412    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-certs\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200488 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-data\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200742 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istiod-ca-cert\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200742 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtc6n\" (UniqueName: \"kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-kube-api-access-mtc6n\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200742 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-token\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200742 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-credential-socket\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.200951 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-certs\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.201004 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.200940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-data\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.201043 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.201017    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-socket\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.201254 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.201220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istiod-ca-cert\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.202947 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.202919    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-envoy\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.203108 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.203088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-podinfo\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.209476 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.209451    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-token\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.209610 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.209572    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtc6n\" (UniqueName: \"kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-kube-api-access-mtc6n\") pod \"e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") " pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.320817 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.320752    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:19.455256 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.455223    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"]
Jul 18 02:26:19.457412 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:26:19.457382    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb4d643_2ecd_472b_8de4_51e8f720ffb6.slice/crio-06f94da9dab7eb93d237b99b9991c3d44c9f08b86fc132933feb7315e498a7ca WatchSource:0}: Error finding container 06f94da9dab7eb93d237b99b9991c3d44c9f08b86fc132933feb7315e498a7ca: Status 404 returned error can't find the container with id 06f94da9dab7eb93d237b99b9991c3d44c9f08b86fc132933feb7315e498a7ca
Jul 18 02:26:19.459582 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.459552    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:19.459669 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.459613    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:19.459669 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:19.459642    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:20.312536 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:20.312487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" event={"ID":"6bb4d643-2ecd-472b-8de4-51e8f720ffb6","Type":"ContainerStarted","Data":"49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621"}
Jul 18 02:26:20.312911 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:20.312573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" event={"ID":"6bb4d643-2ecd-472b-8de4-51e8f720ffb6","Type":"ContainerStarted","Data":"06f94da9dab7eb93d237b99b9991c3d44c9f08b86fc132933feb7315e498a7ca"}
Jul 18 02:26:20.321020 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:20.321000    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:20.325880 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:20.325860    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:20.335546 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:20.335504    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" podStartSLOduration=2.33549253 podStartE2EDuration="2.33549253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:26:20.333308918 +0000 UTC m=+2276.135553388" watchObservedRunningTime="2026-07-18 02:26:20.33549253 +0000 UTC m=+2276.137736987"
Jul 18 02:26:21.318038 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:21.318000    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:21.319048 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:21.319025    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:23.293179 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.293154    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:26:23.328465 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.328400    2560 generic.go:356] "Generic (PLEG): container finished" podID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerID="cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51" exitCode=0
Jul 18 02:26:23.328465 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.328441    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"
Jul 18 02:26:23.328614 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.328487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" event={"ID":"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f","Type":"ContainerDied","Data":"cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51"}
Jul 18 02:26:23.328614 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.328536    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf" event={"ID":"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f","Type":"ContainerDied","Data":"7cbec946618f29e0fbefa596865c8ab6dee66bab65e1a0d30d7ac31d82410c31"}
Jul 18 02:26:23.328614 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.328565    2560 scope.go:117] "RemoveContainer" containerID="cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51"
Jul 18 02:26:23.336910 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.336891    2560 scope.go:117] "RemoveContainer" containerID="b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1"
Jul 18 02:26:23.341701 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.341680    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-podinfo\") pod \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") "
Jul 18 02:26:23.342439 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.342410    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istiod-ca-cert\") pod \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") "
Jul 18 02:26:23.342602 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.342587    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-credential-socket\") pod \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") "
Jul 18 02:26:23.342772 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.342748    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" (UID: "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:26:23.342881 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.342863    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-envoy\") pod \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") "
Jul 18 02:26:23.343038 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.343024    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-socket\") pod \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") "
Jul 18 02:26:23.343644 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.343390    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-certs\") pod \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") "
Jul 18 02:26:23.343862 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.342903    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" (UID: "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:26:23.343862 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.343293    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" (UID: "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:26:23.343862 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.343612    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" (UID: "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:26:23.345232 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.345195    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-data" (OuterVolumeSpecName: "istio-data") pod "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" (UID: "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:26:23.345382 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.345366    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-data\") pod \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") "
Jul 18 02:26:23.345528 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.345514    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz6xf\" (UniqueName: \"kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-kube-api-access-pz6xf\") pod \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") "
Jul 18 02:26:23.345976 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.345959    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-token\") pod \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\" (UID: \"3ee8c240-f5d9-4de4-b31c-b2de05bbb80f\") "
Jul 18 02:26:23.346692 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.346673    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:26:23.346820 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.346807    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:26:23.346919 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.346907    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:26:23.347005 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.346994    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:26:23.347089 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.347078    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:26:23.348981 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.348950    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" (UID: "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:26:23.349198 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.349167    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-kube-api-access-pz6xf" (OuterVolumeSpecName: "kube-api-access-pz6xf") pod "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" (UID: "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f"). InnerVolumeSpecName "kube-api-access-pz6xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:26:23.350084 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.350053    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-token" (OuterVolumeSpecName: "istio-token") pod "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" (UID: "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:26:23.350542 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.350444    2560 scope.go:117] "RemoveContainer" containerID="cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51"
Jul 18 02:26:23.350774 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.350742    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" (UID: "3ee8c240-f5d9-4de4-b31c-b2de05bbb80f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:26:23.351019 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:26:23.350990    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51\": container with ID starting with cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51 not found: ID does not exist" containerID="cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51"
Jul 18 02:26:23.351111 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.351041    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51"} err="failed to get container status \"cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51\": rpc error: code = NotFound desc = could not find container \"cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51\": container with ID starting with cdf9813730c464dbbd9cb3540c86a6cfaccfde91dc102b3b70bf26e85725df51 not found: ID does not exist"
Jul 18 02:26:23.351111 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.351066    2560 scope.go:117] "RemoveContainer" containerID="b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1"
Jul 18 02:26:23.351401 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:26:23.351378    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1\": container with ID starting with b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1 not found: ID does not exist" containerID="b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1"
Jul 18 02:26:23.351496 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.351410    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1"} err="failed to get container status \"b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1\": rpc error: code = NotFound desc = could not find container \"b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1\": container with ID starting with b9b40411daf72f85faa823ff8a20822a30bbcb979f573e018227aee6cc6513f1 not found: ID does not exist"
Jul 18 02:26:23.448295 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.448268    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:26:23.448295 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.448297    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz6xf\" (UniqueName: \"kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-kube-api-access-pz6xf\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:26:23.448295 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.448316    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:26:23.448575 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.448346    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:26:23.656349 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.656309    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"]
Jul 18 02:26:23.661011 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:23.660985    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a724ed-openshift-default-77f8b665c9-k7rnf"]
Jul 18 02:26:24.746407 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:24.746375    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" path="/var/lib/kubelet/pods/3ee8c240-f5d9-4de4-b31c-b2de05bbb80f/volumes"
Jul 18 02:26:27.457446 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.457412    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"]
Jul 18 02:26:27.457940 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.457920    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy"
Jul 18 02:26:27.458015 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.457944    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy"
Jul 18 02:26:27.458015 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.457967    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy"
Jul 18 02:26:27.458015 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.457977    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy"
Jul 18 02:26:27.458015 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.457993    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy"
Jul 18 02:26:27.458015 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.458002    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea10a271-ddee-457f-9ce7-bd2784ea8d82" containerName="istio-proxy"
Jul 18 02:26:27.458255 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.458084    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy"
Jul 18 02:26:27.461237 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.461214    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.464389 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.464365    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-2a8451-openshift-default-dockercfg-9drvq\""
Jul 18 02:26:27.473990 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.473967    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"]
Jul 18 02:26:27.581059 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.581026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-credential-socket\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.581059 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.581061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-podinfo\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.581360 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.581094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-certs\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.581360 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.581200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-data\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.581360 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.581276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-token\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.581360 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.581311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-envoy\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.581583 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.581376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1673443-c93e-4599-8c52-8dc79420e6e8-istiod-ca-cert\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.581583 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.581442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-socket\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.581583 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.581470    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gntw8\" (UniqueName: \"kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-kube-api-access-gntw8\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.682555 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.682525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-token\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.682555 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.682557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-envoy\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.682777 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.682577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1673443-c93e-4599-8c52-8dc79420e6e8-istiod-ca-cert\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.682777 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.682700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-socket\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.682777 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.682726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gntw8\" (UniqueName: \"kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-kube-api-access-gntw8\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.682777 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.682764    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-credential-socket\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.682973 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.682888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-podinfo\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.682973 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.682952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-certs\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.683083 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.683011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-data\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.683138 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.683122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-credential-socket\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.683138 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.683126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-socket\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.683302 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.683250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1673443-c93e-4599-8c52-8dc79420e6e8-istiod-ca-cert\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.683393 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.683308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-data\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.683393 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.683310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-certs\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.685127 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.685104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-envoy\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.685436 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.685414    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-podinfo\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.690193 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.690167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-token\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.690451 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.690434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gntw8\" (UniqueName: \"kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-kube-api-access-gntw8\") pod \"e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") " pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.771613 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.771594    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:27.906875 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.906848    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"]
Jul 18 02:26:27.908057 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:26:27.908028    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1673443_c93e_4599_8c52_8dc79420e6e8.slice/crio-d6684221d37bd2404649cc77a23a713cd38462757f17ecf5f344ae42b0693c17 WatchSource:0}: Error finding container d6684221d37bd2404649cc77a23a713cd38462757f17ecf5f344ae42b0693c17: Status 404 returned error can't find the container with id d6684221d37bd2404649cc77a23a713cd38462757f17ecf5f344ae42b0693c17
Jul 18 02:26:27.910129 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.910101    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:27.910191 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.910160    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:27.910191 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:27.910187    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:28.363312 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:28.363276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" event={"ID":"e1673443-c93e-4599-8c52-8dc79420e6e8","Type":"ContainerStarted","Data":"beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369"}
Jul 18 02:26:28.363568 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:28.363363    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" event={"ID":"e1673443-c93e-4599-8c52-8dc79420e6e8","Type":"ContainerStarted","Data":"d6684221d37bd2404649cc77a23a713cd38462757f17ecf5f344ae42b0693c17"}
Jul 18 02:26:28.384313 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:28.384266    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" podStartSLOduration=1.38425205 podStartE2EDuration="1.38425205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:26:28.382870586 +0000 UTC m=+2284.185115037" watchObservedRunningTime="2026-07-18 02:26:28.38425205 +0000 UTC m=+2284.186496562"
Jul 18 02:26:28.772297 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:28.772270    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:28.777202 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:28.777177    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:29.368925 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:29.368884    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:29.370190 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:29.370145    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:37.359498 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:37.359461    2560 patch_prober.go:28] interesting pod/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 18 02:26:37.359966 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:37.359521    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 18 02:26:38.414207 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:38.414159    2560 generic.go:356] "Generic (PLEG): container finished" podID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerID="49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621" exitCode=0
Jul 18 02:26:38.414753 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:38.414234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" event={"ID":"6bb4d643-2ecd-472b-8de4-51e8f720ffb6","Type":"ContainerDied","Data":"49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621"}
Jul 18 02:26:38.414753 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:38.414749    2560 scope.go:117] "RemoveContainer" containerID="49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621"
Jul 18 02:26:38.416314 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:38.416273    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:38.416443 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:38.416384    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:38.416507 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:38.416441    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:39.423721 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:39.423676    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" event={"ID":"6bb4d643-2ecd-472b-8de4-51e8f720ffb6","Type":"ContainerStarted","Data":"4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151"}
Jul 18 02:26:40.321479 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:40.321443    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:40.321690 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:40.321572    2560 patch_prober.go:28] interesting pod/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 18 02:26:40.321690 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:40.321638    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 18 02:26:41.321807 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:41.321768    2560 patch_prober.go:28] interesting pod/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 18 02:26:41.322425 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:41.322387    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 18 02:26:42.322069 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:42.322030    2560 patch_prober.go:28] interesting pod/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 18 02:26:42.322437 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:42.322106    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 18 02:26:43.322305 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:43.322264    2560 patch_prober.go:28] interesting pod/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 18 02:26:43.322715 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:43.322367    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 18 02:26:44.324590 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.324558    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:44.325096 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.324860    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:44.325586 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.325564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:26:44.374231 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.374203    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"]
Jul 18 02:26:44.374674 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.374657    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ee8c240-f5d9-4de4-b31c-b2de05bbb80f" containerName="istio-proxy"
Jul 18 02:26:44.377399 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.377375    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.380153 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.380134    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-deec4e\"/\"kube-root-ca.crt\""
Jul 18 02:26:44.380450 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.380430    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-deec4e\"/\"openshift-service-ca.crt\""
Jul 18 02:26:44.380617 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.380593    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-deec4e\"/\"auth-test-model-deec4e-kserve-self-signed-certs\""
Jul 18 02:26:44.380726 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.380243    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-deec4e\"/\"default-dockercfg-h7lg6\""
Jul 18 02:26:44.387963 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.387857    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"]
Jul 18 02:26:44.461523 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.461492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-dshm\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.461681 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.461524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-home\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.461681 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.461643    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-model-cache\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.461840 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.461823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kv22\" (UniqueName: \"kubernetes.io/projected/2474a3ee-87ef-48b1-b34f-89168010b140-kube-api-access-2kv22\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.461888 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.461854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-tmp-dir\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.462044 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.462026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2474a3ee-87ef-48b1-b34f-89168010b140-tls-certs\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.563036 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.563003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kv22\" (UniqueName: \"kubernetes.io/projected/2474a3ee-87ef-48b1-b34f-89168010b140-kube-api-access-2kv22\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.563434 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.563395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-tmp-dir\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.563617 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.563594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2474a3ee-87ef-48b1-b34f-89168010b140-tls-certs\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.563747 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.563726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-dshm\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.563819 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.563758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-home\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.563819 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.563799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-tmp-dir\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.563928 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.563899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-model-cache\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.564518 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.564497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-model-cache\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.564834 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.564592    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-home\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.566539 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.566499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2474a3ee-87ef-48b1-b34f-89168010b140-tls-certs\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.566733 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.566714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-dshm\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.571375 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.571351    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kv22\" (UniqueName: \"kubernetes.io/projected/2474a3ee-87ef-48b1-b34f-89168010b140-kube-api-access-2kv22\") pod \"auth-test-model-deec4e-kserve-db59cc655-gm5xv\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") " pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.691610 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.691535    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:44.830416 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:44.830384    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"]
Jul 18 02:26:44.834424 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:26:44.834388    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2474a3ee_87ef_48b1_b34f_89168010b140.slice/crio-15a447bf7e02e695249314089d6bddbb5cbbda26bb961dcdd9de7a3568b4e3c3 WatchSource:0}: Error finding container 15a447bf7e02e695249314089d6bddbb5cbbda26bb961dcdd9de7a3568b4e3c3: Status 404 returned error can't find the container with id 15a447bf7e02e695249314089d6bddbb5cbbda26bb961dcdd9de7a3568b4e3c3
Jul 18 02:26:45.067861 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.067375    2560 patch_prober.go:28] interesting pod/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:59676->10.134.0.41:15021: read: connection reset by peer" start-of-body=
Jul 18 02:26:45.067861 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.067434    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:59676->10.134.0.41:15021: read: connection reset by peer"
Jul 18 02:26:45.458771 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.458696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv" event={"ID":"2474a3ee-87ef-48b1-b34f-89168010b140","Type":"ContainerStarted","Data":"1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561"}
Jul 18 02:26:45.458771 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.458741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv" event={"ID":"2474a3ee-87ef-48b1-b34f-89168010b140","Type":"ContainerStarted","Data":"15a447bf7e02e695249314089d6bddbb5cbbda26bb961dcdd9de7a3568b4e3c3"}
Jul 18 02:26:45.460138 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.460115    2560 generic.go:356] "Generic (PLEG): container finished" podID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerID="beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369" exitCode=0
Jul 18 02:26:45.460257 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.460158    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" event={"ID":"e1673443-c93e-4599-8c52-8dc79420e6e8","Type":"ContainerDied","Data":"beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369"}
Jul 18 02:26:45.460648 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.460632    2560 scope.go:117] "RemoveContainer" containerID="beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369"
Jul 18 02:26:45.461598 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.461569    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:45.461699 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.461654    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:45.461745 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.461699    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 18 02:26:45.483629 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:45.483590    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv" podStartSLOduration=1.483577019 podStartE2EDuration="1.483577019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:26:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:26:45.482147752 +0000 UTC m=+2301.284392209" watchObservedRunningTime="2026-07-18 02:26:45.483577019 +0000 UTC m=+2301.285821476"
Jul 18 02:26:46.466552 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:46.466515    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" event={"ID":"e1673443-c93e-4599-8c52-8dc79420e6e8","Type":"ContainerStarted","Data":"000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621"}
Jul 18 02:26:46.771874 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:46.771847    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:46.772036 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:46.772013    2560 patch_prober.go:28] interesting pod/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 18 02:26:46.772087 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:46.772059    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 18 02:26:47.771948 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:47.771918    2560 patch_prober.go:28] interesting pod/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 18 02:26:47.772306 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:47.771969    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 18 02:26:48.772045 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:48.772012    2560 patch_prober.go:28] interesting pod/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 18 02:26:48.772451 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:48.772065    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 18 02:26:49.772244 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:49.772211    2560 patch_prober.go:28] interesting pod/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 18 02:26:49.772714 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:49.772269    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 18 02:26:50.775968 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:50.775942    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:50.776376 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:50.776200    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:50.776813 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:50.776795    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:26:54.692260 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:54.692214    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:54.692260 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:54.692268    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:54.704611 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:54.704588    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:26:55.519921 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:26:55.519887    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:28:24.764593 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:28:24.764568    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:28:24.771044 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:28:24.771024    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:29:02.727304 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:02.727219    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"]
Jul 18 02:29:12.461524 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.461490    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"]
Jul 18 02:29:12.463850 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.463833    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.466545 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.466524    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-deec4e\"/\"sub-test-model-deec4e-kserve-self-signed-certs\""
Jul 18 02:29:12.476095 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.476072    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"]
Jul 18 02:29:12.572957 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.572920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb306db7-7b97-4790-9075-c904ec910b3f-tls-certs\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.573141 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.572980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-dshm\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.573141 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.573057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-tmp-dir\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.573141 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.573111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-model-cache\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.573251 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.573155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-home\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.573251 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.573180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2bgq\" (UniqueName: \"kubernetes.io/projected/fb306db7-7b97-4790-9075-c904ec910b3f-kube-api-access-z2bgq\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.674709 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.674668    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-dshm\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.674709 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.674713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-tmp-dir\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.674931 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.674836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-model-cache\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.674931 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.674893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-home\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.674931 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.674917    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2bgq\" (UniqueName: \"kubernetes.io/projected/fb306db7-7b97-4790-9075-c904ec910b3f-kube-api-access-z2bgq\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.675067 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.675006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb306db7-7b97-4790-9075-c904ec910b3f-tls-certs\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.675176 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.675136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-tmp-dir\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.675176 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.675166    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-model-cache\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.675429 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.675272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-home\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.677146 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.677126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-dshm\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.677581 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.677554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb306db7-7b97-4790-9075-c904ec910b3f-tls-certs\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.683607 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.683585    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2bgq\" (UniqueName: \"kubernetes.io/projected/fb306db7-7b97-4790-9075-c904ec910b3f-kube-api-access-z2bgq\") pod \"sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") " pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.772520 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.772485    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:12.911441 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:12.911416    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"]
Jul 18 02:29:12.913129 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:29:12.913103    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb306db7_7b97_4790_9075_c904ec910b3f.slice/crio-0099a6a05e71ed766f4ddd32c192a4ca7d7f0587d71dc741fa3a49c231bb036e WatchSource:0}: Error finding container 0099a6a05e71ed766f4ddd32c192a4ca7d7f0587d71dc741fa3a49c231bb036e: Status 404 returned error can't find the container with id 0099a6a05e71ed766f4ddd32c192a4ca7d7f0587d71dc741fa3a49c231bb036e
Jul 18 02:29:13.172598 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:13.172509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9" event={"ID":"fb306db7-7b97-4790-9075-c904ec910b3f","Type":"ContainerStarted","Data":"bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b"}
Jul 18 02:29:13.172598 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:13.172550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9" event={"ID":"fb306db7-7b97-4790-9075-c904ec910b3f","Type":"ContainerStarted","Data":"0099a6a05e71ed766f4ddd32c192a4ca7d7f0587d71dc741fa3a49c231bb036e"}
Jul 18 02:29:13.190281 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:13.190235    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9" podStartSLOduration=1.190218983 podStartE2EDuration="1.190218983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:29:13.189236622 +0000 UTC m=+2448.991481078" watchObservedRunningTime="2026-07-18 02:29:13.190218983 +0000 UTC m=+2448.992463441"
Jul 18 02:29:17.749091 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:17.749043    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv" podUID="2474a3ee-87ef-48b1-b34f-89168010b140" containerName="main" containerID="cri-o://1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561" gracePeriod=45
Jul 18 02:29:18.003857 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.003830    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:29:18.027103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027076    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-home\") pod \"2474a3ee-87ef-48b1-b34f-89168010b140\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") "
Jul 18 02:29:18.027103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027107    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-model-cache\") pod \"2474a3ee-87ef-48b1-b34f-89168010b140\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") "
Jul 18 02:29:18.027354 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027157    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kv22\" (UniqueName: \"kubernetes.io/projected/2474a3ee-87ef-48b1-b34f-89168010b140-kube-api-access-2kv22\") pod \"2474a3ee-87ef-48b1-b34f-89168010b140\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") "
Jul 18 02:29:18.027354 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027178    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2474a3ee-87ef-48b1-b34f-89168010b140-tls-certs\") pod \"2474a3ee-87ef-48b1-b34f-89168010b140\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") "
Jul 18 02:29:18.027354 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027221    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-dshm\") pod \"2474a3ee-87ef-48b1-b34f-89168010b140\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") "
Jul 18 02:29:18.027354 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027275    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-tmp-dir\") pod \"2474a3ee-87ef-48b1-b34f-89168010b140\" (UID: \"2474a3ee-87ef-48b1-b34f-89168010b140\") "
Jul 18 02:29:18.027570 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027415    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-home" (OuterVolumeSpecName: "home") pod "2474a3ee-87ef-48b1-b34f-89168010b140" (UID: "2474a3ee-87ef-48b1-b34f-89168010b140"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:18.027570 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027424    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-model-cache" (OuterVolumeSpecName: "model-cache") pod "2474a3ee-87ef-48b1-b34f-89168010b140" (UID: "2474a3ee-87ef-48b1-b34f-89168010b140"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:18.027697 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027634    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-home\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:29:18.027697 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027645    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2474a3ee-87ef-48b1-b34f-89168010b140" (UID: "2474a3ee-87ef-48b1-b34f-89168010b140"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:18.027697 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.027652    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-model-cache\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:29:18.029669 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.029636    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2474a3ee-87ef-48b1-b34f-89168010b140-kube-api-access-2kv22" (OuterVolumeSpecName: "kube-api-access-2kv22") pod "2474a3ee-87ef-48b1-b34f-89168010b140" (UID: "2474a3ee-87ef-48b1-b34f-89168010b140"). InnerVolumeSpecName "kube-api-access-2kv22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:29:18.029669 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.029639    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2474a3ee-87ef-48b1-b34f-89168010b140-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2474a3ee-87ef-48b1-b34f-89168010b140" (UID: "2474a3ee-87ef-48b1-b34f-89168010b140"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:29:18.029832 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.029810    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-dshm" (OuterVolumeSpecName: "dshm") pod "2474a3ee-87ef-48b1-b34f-89168010b140" (UID: "2474a3ee-87ef-48b1-b34f-89168010b140"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:29:18.128761 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.128728    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kv22\" (UniqueName: \"kubernetes.io/projected/2474a3ee-87ef-48b1-b34f-89168010b140-kube-api-access-2kv22\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:29:18.128761 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.128756    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2474a3ee-87ef-48b1-b34f-89168010b140-tls-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:29:18.128761 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.128765    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-dshm\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:29:18.128761 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.128773    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2474a3ee-87ef-48b1-b34f-89168010b140-tmp-dir\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:29:18.197386 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.197350    2560 generic.go:356] "Generic (PLEG): container finished" podID="2474a3ee-87ef-48b1-b34f-89168010b140" containerID="1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561" exitCode=0
Jul 18 02:29:18.197386 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.197375    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"
Jul 18 02:29:18.197627 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.197417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv" event={"ID":"2474a3ee-87ef-48b1-b34f-89168010b140","Type":"ContainerDied","Data":"1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561"}
Jul 18 02:29:18.197627 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.197459    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv" event={"ID":"2474a3ee-87ef-48b1-b34f-89168010b140","Type":"ContainerDied","Data":"15a447bf7e02e695249314089d6bddbb5cbbda26bb961dcdd9de7a3568b4e3c3"}
Jul 18 02:29:18.197627 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.197484    2560 scope.go:117] "RemoveContainer" containerID="1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561"
Jul 18 02:29:18.206886 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.206863    2560 scope.go:117] "RemoveContainer" containerID="1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561"
Jul 18 02:29:18.207135 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:29:18.207116    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561\": container with ID starting with 1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561 not found: ID does not exist" containerID="1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561"
Jul 18 02:29:18.207173 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.207143    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561"} err="failed to get container status \"1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561\": rpc error: code = NotFound desc = could not find container \"1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561\": container with ID starting with 1fec2511836caef2e2a1e0e6e5f0a68cc8ce3f89c443397ed0160fd37f097561 not found: ID does not exist"
Jul 18 02:29:18.217814 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.217779    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"]
Jul 18 02:29:18.219962 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.219940    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/auth-test-model-deec4e-kserve-db59cc655-gm5xv"]
Jul 18 02:29:18.745295 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:18.745261    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2474a3ee-87ef-48b1-b34f-89168010b140" path="/var/lib/kubelet/pods/2474a3ee-87ef-48b1-b34f-89168010b140/volumes"
Jul 18 02:29:22.772903 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:22.772863    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:22.773391 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:22.772922    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:22.785526 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:22.785499    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:29:23.231960 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:29:23.231873    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:30:27.959812 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:27.959733    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"]
Jul 18 02:30:42.979779 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:42.979716    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9" podUID="fb306db7-7b97-4790-9075-c904ec910b3f" containerName="main" containerID="cri-o://bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b" gracePeriod=45
Jul 18 02:30:43.232032 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.231966    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:30:43.327191 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327152    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-tmp-dir\") pod \"fb306db7-7b97-4790-9075-c904ec910b3f\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") "
Jul 18 02:30:43.327415 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327259    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-home\") pod \"fb306db7-7b97-4790-9075-c904ec910b3f\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") "
Jul 18 02:30:43.327495 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327406    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-dshm\") pod \"fb306db7-7b97-4790-9075-c904ec910b3f\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") "
Jul 18 02:30:43.327495 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327442    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-model-cache\") pod \"fb306db7-7b97-4790-9075-c904ec910b3f\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") "
Jul 18 02:30:43.327613 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327502    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb306db7-7b97-4790-9075-c904ec910b3f-tls-certs\") pod \"fb306db7-7b97-4790-9075-c904ec910b3f\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") "
Jul 18 02:30:43.327613 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327495    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb306db7-7b97-4790-9075-c904ec910b3f" (UID: "fb306db7-7b97-4790-9075-c904ec910b3f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:30:43.327613 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327556    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2bgq\" (UniqueName: \"kubernetes.io/projected/fb306db7-7b97-4790-9075-c904ec910b3f-kube-api-access-z2bgq\") pod \"fb306db7-7b97-4790-9075-c904ec910b3f\" (UID: \"fb306db7-7b97-4790-9075-c904ec910b3f\") "
Jul 18 02:30:43.327767 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327553    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-home" (OuterVolumeSpecName: "home") pod "fb306db7-7b97-4790-9075-c904ec910b3f" (UID: "fb306db7-7b97-4790-9075-c904ec910b3f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:30:43.327767 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327727    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb306db7-7b97-4790-9075-c904ec910b3f" (UID: "fb306db7-7b97-4790-9075-c904ec910b3f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:30:43.327876 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327859    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-model-cache\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:30:43.327918 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327877    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-tmp-dir\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:30:43.327918 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.327886    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-home\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:30:43.329627 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.329602    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-dshm" (OuterVolumeSpecName: "dshm") pod "fb306db7-7b97-4790-9075-c904ec910b3f" (UID: "fb306db7-7b97-4790-9075-c904ec910b3f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:30:43.329770 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.329755    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb306db7-7b97-4790-9075-c904ec910b3f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb306db7-7b97-4790-9075-c904ec910b3f" (UID: "fb306db7-7b97-4790-9075-c904ec910b3f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:30:43.329821 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.329789    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb306db7-7b97-4790-9075-c904ec910b3f-kube-api-access-z2bgq" (OuterVolumeSpecName: "kube-api-access-z2bgq") pod "fb306db7-7b97-4790-9075-c904ec910b3f" (UID: "fb306db7-7b97-4790-9075-c904ec910b3f"). InnerVolumeSpecName "kube-api-access-z2bgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:30:43.428640 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.428605    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb306db7-7b97-4790-9075-c904ec910b3f-dshm\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:30:43.428640 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.428632    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb306db7-7b97-4790-9075-c904ec910b3f-tls-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:30:43.428640 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.428642    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2bgq\" (UniqueName: \"kubernetes.io/projected/fb306db7-7b97-4790-9075-c904ec910b3f-kube-api-access-z2bgq\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:30:43.597526 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.597494    2560 generic.go:356] "Generic (PLEG): container finished" podID="fb306db7-7b97-4790-9075-c904ec910b3f" containerID="bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b" exitCode=0
Jul 18 02:30:43.597702 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.597536    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"
Jul 18 02:30:43.597702 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.597585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9" event={"ID":"fb306db7-7b97-4790-9075-c904ec910b3f","Type":"ContainerDied","Data":"bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b"}
Jul 18 02:30:43.597702 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.597624    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9" event={"ID":"fb306db7-7b97-4790-9075-c904ec910b3f","Type":"ContainerDied","Data":"0099a6a05e71ed766f4ddd32c192a4ca7d7f0587d71dc741fa3a49c231bb036e"}
Jul 18 02:30:43.597702 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.597642    2560 scope.go:117] "RemoveContainer" containerID="bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b"
Jul 18 02:30:43.607094 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.607078    2560 scope.go:117] "RemoveContainer" containerID="bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b"
Jul 18 02:30:43.607338 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:30:43.607300    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b\": container with ID starting with bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b not found: ID does not exist" containerID="bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b"
Jul 18 02:30:43.607401 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.607346    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b"} err="failed to get container status \"bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b\": rpc error: code = NotFound desc = could not find container \"bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b\": container with ID starting with bd6b8562e71b573d2ff6ba49e6d19e88e736751243ded38b55d2e741a9b7db5b not found: ID does not exist"
Jul 18 02:30:43.619255 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.619227    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"]
Jul 18 02:30:43.622510 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.622489    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9"]
Jul 18 02:30:43.874760 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.874678    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"]
Jul 18 02:30:43.875059 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.875046    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb306db7-7b97-4790-9075-c904ec910b3f" containerName="main"
Jul 18 02:30:43.875109 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.875059    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb306db7-7b97-4790-9075-c904ec910b3f" containerName="main"
Jul 18 02:30:43.875109 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.875069    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2474a3ee-87ef-48b1-b34f-89168010b140" containerName="main"
Jul 18 02:30:43.875109 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.875074    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2474a3ee-87ef-48b1-b34f-89168010b140" containerName="main"
Jul 18 02:30:43.875199 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.875133    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb306db7-7b97-4790-9075-c904ec910b3f" containerName="main"
Jul 18 02:30:43.875199 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.875145    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2474a3ee-87ef-48b1-b34f-89168010b140" containerName="main"
Jul 18 02:30:43.877846 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.877830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:43.880384 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.880362    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-deec4e\"/\"default-dockercfg-h7lg6\""
Jul 18 02:30:43.880527 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.880414    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-deec4e\"/\"openshift-service-ca.crt\""
Jul 18 02:30:43.880527 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.880458    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-deec4e\"/\"kube-root-ca.crt\""
Jul 18 02:30:43.881594 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.881571    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-deec4e\"/\"rate-test-model-deec4e-kserve-self-signed-certs\""
Jul 18 02:30:43.890231 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.890202    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"]
Jul 18 02:30:43.932589 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.932556    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-dshm\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:43.932776 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.932601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs96f\" (UniqueName: \"kubernetes.io/projected/b63dc739-ebbb-4713-b874-23b02e69948e-kube-api-access-vs96f\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:43.932776 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.932726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-tmp-dir\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:43.932776 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.932765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63dc739-ebbb-4713-b874-23b02e69948e-tls-certs\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:43.932944 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.932870    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-home\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:43.932944 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:43.932892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-model-cache\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.033898 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.033862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-dshm\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.033898 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.033902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs96f\" (UniqueName: \"kubernetes.io/projected/b63dc739-ebbb-4713-b874-23b02e69948e-kube-api-access-vs96f\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.034538 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.033963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-tmp-dir\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.034538 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.033980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63dc739-ebbb-4713-b874-23b02e69948e-tls-certs\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.034538 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.034034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-home\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.034538 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.034062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-model-cache\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.034538 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.034428    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-tmp-dir\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.034538 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.034437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-model-cache\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.034538 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.034496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-home\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.036195 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.036168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-dshm\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.036619 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.036598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63dc739-ebbb-4713-b874-23b02e69948e-tls-certs\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.044253 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.044227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs96f\" (UniqueName: \"kubernetes.io/projected/b63dc739-ebbb-4713-b874-23b02e69948e-kube-api-access-vs96f\") pod \"rate-test-model-deec4e-kserve-79dcbb99f-4b2b9\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") " pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.193646 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.193553    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:44.332226 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.332030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"]
Jul 18 02:30:44.334504 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:30:44.334472    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb63dc739_ebbb_4713_b874_23b02e69948e.slice/crio-3ba220a5166786274087d095b6b78b7855d7437e4126586323d686dbda79868d WatchSource:0}: Error finding container 3ba220a5166786274087d095b6b78b7855d7437e4126586323d686dbda79868d: Status 404 returned error can't find the container with id 3ba220a5166786274087d095b6b78b7855d7437e4126586323d686dbda79868d
Jul 18 02:30:44.604829 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.604797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9" event={"ID":"b63dc739-ebbb-4713-b874-23b02e69948e","Type":"ContainerStarted","Data":"0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be"}
Jul 18 02:30:44.605037 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.604840    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9" event={"ID":"b63dc739-ebbb-4713-b874-23b02e69948e","Type":"ContainerStarted","Data":"3ba220a5166786274087d095b6b78b7855d7437e4126586323d686dbda79868d"}
Jul 18 02:30:44.628755 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.628703    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9" podStartSLOduration=1.628688868 podStartE2EDuration="1.628688868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:30:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:30:44.625938031 +0000 UTC m=+2540.428182500" watchObservedRunningTime="2026-07-18 02:30:44.628688868 +0000 UTC m=+2540.430933325"
Jul 18 02:30:44.748807 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:44.748770    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb306db7-7b97-4790-9075-c904ec910b3f" path="/var/lib/kubelet/pods/fb306db7-7b97-4790-9075-c904ec910b3f/volumes"
Jul 18 02:30:48.221085 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:48.221040    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-deec4e/sub-test-model-deec4e-kserve-7fb4f4b4c-2ndq9" podUID="fb306db7-7b97-4790-9075-c904ec910b3f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": context deadline exceeded"
Jul 18 02:30:54.193871 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:54.193836    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:54.194276 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:54.193881    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:54.206568 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:54.206542    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:30:54.663554 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:30:54.663518    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:31:59.166387 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:31:59.166313    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"]
Jul 18 02:32:14.187038 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.186998    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9" podUID="b63dc739-ebbb-4713-b874-23b02e69948e" containerName="main" containerID="cri-o://0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be" gracePeriod=45
Jul 18 02:32:14.440149 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.440095    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:32:14.526907 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.526876    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-model-cache\") pod \"b63dc739-ebbb-4713-b874-23b02e69948e\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") "
Jul 18 02:32:14.527090 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.526921    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-tmp-dir\") pod \"b63dc739-ebbb-4713-b874-23b02e69948e\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") "
Jul 18 02:32:14.527090 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.526943    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-dshm\") pod \"b63dc739-ebbb-4713-b874-23b02e69948e\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") "
Jul 18 02:32:14.527090 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.527004    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63dc739-ebbb-4713-b874-23b02e69948e-tls-certs\") pod \"b63dc739-ebbb-4713-b874-23b02e69948e\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") "
Jul 18 02:32:14.527090 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.527044    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-home\") pod \"b63dc739-ebbb-4713-b874-23b02e69948e\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") "
Jul 18 02:32:14.527312 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.527099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs96f\" (UniqueName: \"kubernetes.io/projected/b63dc739-ebbb-4713-b874-23b02e69948e-kube-api-access-vs96f\") pod \"b63dc739-ebbb-4713-b874-23b02e69948e\" (UID: \"b63dc739-ebbb-4713-b874-23b02e69948e\") "
Jul 18 02:32:14.527312 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.527153    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-model-cache" (OuterVolumeSpecName: "model-cache") pod "b63dc739-ebbb-4713-b874-23b02e69948e" (UID: "b63dc739-ebbb-4713-b874-23b02e69948e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:32:14.527312 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.527169    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b63dc739-ebbb-4713-b874-23b02e69948e" (UID: "b63dc739-ebbb-4713-b874-23b02e69948e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:32:14.527492 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.527381    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-home" (OuterVolumeSpecName: "home") pod "b63dc739-ebbb-4713-b874-23b02e69948e" (UID: "b63dc739-ebbb-4713-b874-23b02e69948e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:32:14.527492 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.527483    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-model-cache\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:14.527574 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.527503    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-tmp-dir\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:14.527574 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.527517    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-home\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:14.529302 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.529279    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-dshm" (OuterVolumeSpecName: "dshm") pod "b63dc739-ebbb-4713-b874-23b02e69948e" (UID: "b63dc739-ebbb-4713-b874-23b02e69948e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:32:14.529429 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.529362    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b63dc739-ebbb-4713-b874-23b02e69948e-kube-api-access-vs96f" (OuterVolumeSpecName: "kube-api-access-vs96f") pod "b63dc739-ebbb-4713-b874-23b02e69948e" (UID: "b63dc739-ebbb-4713-b874-23b02e69948e"). InnerVolumeSpecName "kube-api-access-vs96f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:32:14.529429 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.529421    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b63dc739-ebbb-4713-b874-23b02e69948e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b63dc739-ebbb-4713-b874-23b02e69948e" (UID: "b63dc739-ebbb-4713-b874-23b02e69948e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:32:14.628968 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.628933    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs96f\" (UniqueName: \"kubernetes.io/projected/b63dc739-ebbb-4713-b874-23b02e69948e-kube-api-access-vs96f\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:14.628968 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.628962    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63dc739-ebbb-4713-b874-23b02e69948e-dshm\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:14.628968 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:14.628972    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63dc739-ebbb-4713-b874-23b02e69948e-tls-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:15.026203 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:15.026167    2560 generic.go:356] "Generic (PLEG): container finished" podID="b63dc739-ebbb-4713-b874-23b02e69948e" containerID="0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be" exitCode=0
Jul 18 02:32:15.026394 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:15.026215    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"
Jul 18 02:32:15.026394 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:15.026213    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9" event={"ID":"b63dc739-ebbb-4713-b874-23b02e69948e","Type":"ContainerDied","Data":"0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be"}
Jul 18 02:32:15.026394 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:15.026355    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9" event={"ID":"b63dc739-ebbb-4713-b874-23b02e69948e","Type":"ContainerDied","Data":"3ba220a5166786274087d095b6b78b7855d7437e4126586323d686dbda79868d"}
Jul 18 02:32:15.026394 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:15.026383    2560 scope.go:117] "RemoveContainer" containerID="0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be"
Jul 18 02:32:15.035120 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:15.035098    2560 scope.go:117] "RemoveContainer" containerID="0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be"
Jul 18 02:32:15.035414 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:32:15.035390    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be\": container with ID starting with 0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be not found: ID does not exist" containerID="0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be"
Jul 18 02:32:15.035477 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:15.035428    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be"} err="failed to get container status \"0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be\": rpc error: code = NotFound desc = could not find container \"0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be\": container with ID starting with 0b07a4869d71de8bd4da23cdf3b9b1fb8b756a1eb2fb8ae767d2c14e76fde9be not found: ID does not exist"
Jul 18 02:32:15.047849 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:15.047809    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"]
Jul 18 02:32:15.047997 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:15.047967    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-deec4e/rate-test-model-deec4e-kserve-79dcbb99f-4b2b9"]
Jul 18 02:32:16.745609 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:16.745563    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b63dc739-ebbb-4713-b874-23b02e69948e" path="/var/lib/kubelet/pods/b63dc739-ebbb-4713-b874-23b02e69948e/volumes"
Jul 18 02:32:41.566973 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:41.566939    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"]
Jul 18 02:32:41.567448 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:41.567233    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy" containerID="cri-o://4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151" gracePeriod=30
Jul 18 02:32:44.327605 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:44.327564    2560 patch_prober.go:28] interesting pod/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 02:32:44.327969 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:44.327639    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 02:32:46.816931 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.816903    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:32:46.913142 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913055    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-certs\") pod \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") "
Jul 18 02:32:46.913142 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913091    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-token\") pod \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") "
Jul 18 02:32:46.913142 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913125    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-data\") pod \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") "
Jul 18 02:32:46.913450 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913169    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istiod-ca-cert\") pod \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") "
Jul 18 02:32:46.913450 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913225    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-envoy\") pod \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") "
Jul 18 02:32:46.913450 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913245    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-credential-socket\") pod \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") "
Jul 18 02:32:46.913450 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913272    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-socket\") pod \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") "
Jul 18 02:32:46.913450 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913302    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtc6n\" (UniqueName: \"kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-kube-api-access-mtc6n\") pod \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") "
Jul 18 02:32:46.913450 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913425    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-podinfo\") pod \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\" (UID: \"6bb4d643-2ecd-472b-8de4-51e8f720ffb6\") "
Jul 18 02:32:46.913782 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6bb4d643-2ecd-472b-8de4-51e8f720ffb6" (UID: "6bb4d643-2ecd-472b-8de4-51e8f720ffb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:32:46.913782 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913586    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6bb4d643-2ecd-472b-8de4-51e8f720ffb6" (UID: "6bb4d643-2ecd-472b-8de4-51e8f720ffb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:32:46.913782 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913599    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6bb4d643-2ecd-472b-8de4-51e8f720ffb6" (UID: "6bb4d643-2ecd-472b-8de4-51e8f720ffb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:32:46.913944 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913837    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:46.913944 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913852    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:46.913944 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.913866    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:46.914362 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.914306    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "6bb4d643-2ecd-472b-8de4-51e8f720ffb6" (UID: "6bb4d643-2ecd-472b-8de4-51e8f720ffb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:32:46.914453 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.914394    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6bb4d643-2ecd-472b-8de4-51e8f720ffb6" (UID: "6bb4d643-2ecd-472b-8de4-51e8f720ffb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:32:46.915585 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.915558    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6bb4d643-2ecd-472b-8de4-51e8f720ffb6" (UID: "6bb4d643-2ecd-472b-8de4-51e8f720ffb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:32:46.915709 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.915627    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "6bb4d643-2ecd-472b-8de4-51e8f720ffb6" (UID: "6bb4d643-2ecd-472b-8de4-51e8f720ffb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:32:46.915709 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.915674    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-kube-api-access-mtc6n" (OuterVolumeSpecName: "kube-api-access-mtc6n") pod "6bb4d643-2ecd-472b-8de4-51e8f720ffb6" (UID: "6bb4d643-2ecd-472b-8de4-51e8f720ffb6"). InnerVolumeSpecName "kube-api-access-mtc6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:32:46.915709 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:46.915685    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6bb4d643-2ecd-472b-8de4-51e8f720ffb6" (UID: "6bb4d643-2ecd-472b-8de4-51e8f720ffb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:32:47.014994 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.014965    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:47.014994 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.014990    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:47.014994 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.015000    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:47.015217 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.015007    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:47.015217 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.015015    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtc6n\" (UniqueName: \"kubernetes.io/projected/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-kube-api-access-mtc6n\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:47.015217 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.015024    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb4d643-2ecd-472b-8de4-51e8f720ffb6-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:32:47.178474 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.178371    2560 generic.go:356] "Generic (PLEG): container finished" podID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerID="4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151" exitCode=0
Jul 18 02:32:47.178474 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.178424    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"
Jul 18 02:32:47.178474 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.178436    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" event={"ID":"6bb4d643-2ecd-472b-8de4-51e8f720ffb6","Type":"ContainerDied","Data":"4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151"}
Jul 18 02:32:47.178740 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.178491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs" event={"ID":"6bb4d643-2ecd-472b-8de4-51e8f720ffb6","Type":"ContainerDied","Data":"06f94da9dab7eb93d237b99b9991c3d44c9f08b86fc132933feb7315e498a7ca"}
Jul 18 02:32:47.178740 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.178517    2560 scope.go:117] "RemoveContainer" containerID="4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151"
Jul 18 02:32:47.187785 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.187756    2560 scope.go:117] "RemoveContainer" containerID="49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621"
Jul 18 02:32:47.195845 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.195827    2560 scope.go:117] "RemoveContainer" containerID="4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151"
Jul 18 02:32:47.196083 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:32:47.196064    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151\": container with ID starting with 4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151 not found: ID does not exist" containerID="4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151"
Jul 18 02:32:47.196124 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.196093    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151"} err="failed to get container status \"4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151\": rpc error: code = NotFound desc = could not find container \"4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151\": container with ID starting with 4b779395fdb929a5f7188182f5c0e796cf92689e91a78d44099744b6515fd151 not found: ID does not exist"
Jul 18 02:32:47.196124 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.196117    2560 scope.go:117] "RemoveContainer" containerID="49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621"
Jul 18 02:32:47.196393 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:32:47.196377    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621\": container with ID starting with 49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621 not found: ID does not exist" containerID="49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621"
Jul 18 02:32:47.196434 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.196400    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621"} err="failed to get container status \"49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621\": rpc error: code = NotFound desc = could not find container \"49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621\": container with ID starting with 49c7414d238e47e03d575387b8caf516b84d1b7b12a585b70febadd44a952621 not found: ID does not exist"
Jul 18 02:32:47.201428 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.201405    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"]
Jul 18 02:32:47.205443 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:47.205420    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-deec4e-openshift-default-7f8bd6774c-bcgrs"]
Jul 18 02:32:48.745683 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:32:48.745654    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" path="/var/lib/kubelet/pods/6bb4d643-2ecd-472b-8de4-51e8f720ffb6/volumes"
Jul 18 02:33:03.889886 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:03.889853    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"]
Jul 18 02:33:03.890362 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:03.890094    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy" containerID="cri-o://000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621" gracePeriod=30
Jul 18 02:33:04.598305 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:04.598241    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77b54c8556-6wmv6_c4541dcc-369f-45a5-abbc-b2135b609cc1/authorino/0.log"
Jul 18 02:33:05.778357 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:05.778297    2560 patch_prober.go:28] interesting pod/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 02:33:05.778724 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:05.778400    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 02:33:09.146807 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.146783    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:33:09.220971 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.220887    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-socket\") pod \"e1673443-c93e-4599-8c52-8dc79420e6e8\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") "
Jul 18 02:33:09.220971 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.220968    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1673443-c93e-4599-8c52-8dc79420e6e8-istiod-ca-cert\") pod \"e1673443-c93e-4599-8c52-8dc79420e6e8\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") "
Jul 18 02:33:09.221208 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.220989    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-envoy\") pod \"e1673443-c93e-4599-8c52-8dc79420e6e8\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") "
Jul 18 02:33:09.221208 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221007    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gntw8\" (UniqueName: \"kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-kube-api-access-gntw8\") pod \"e1673443-c93e-4599-8c52-8dc79420e6e8\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") "
Jul 18 02:33:09.221208 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221031    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-data\") pod \"e1673443-c93e-4599-8c52-8dc79420e6e8\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") "
Jul 18 02:33:09.221208 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221058    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-certs\") pod \"e1673443-c93e-4599-8c52-8dc79420e6e8\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") "
Jul 18 02:33:09.221208 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221090    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-token\") pod \"e1673443-c93e-4599-8c52-8dc79420e6e8\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") "
Jul 18 02:33:09.221208 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221118    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-podinfo\") pod \"e1673443-c93e-4599-8c52-8dc79420e6e8\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") "
Jul 18 02:33:09.221208 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221161    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1673443-c93e-4599-8c52-8dc79420e6e8" (UID: "e1673443-c93e-4599-8c52-8dc79420e6e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:09.221208 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221160    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-credential-socket\") pod \"e1673443-c93e-4599-8c52-8dc79420e6e8\" (UID: \"e1673443-c93e-4599-8c52-8dc79420e6e8\") "
Jul 18 02:33:09.221653 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221403    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1673443-c93e-4599-8c52-8dc79420e6e8" (UID: "e1673443-c93e-4599-8c52-8dc79420e6e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:09.221653 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221530    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1673443-c93e-4599-8c52-8dc79420e6e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1673443-c93e-4599-8c52-8dc79420e6e8" (UID: "e1673443-c93e-4599-8c52-8dc79420e6e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:33:09.221653 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221543    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:33:09.221653 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221563    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:33:09.222034 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221921    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1673443-c93e-4599-8c52-8dc79420e6e8" (UID: "e1673443-c93e-4599-8c52-8dc79420e6e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:09.222034 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.221844    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1673443-c93e-4599-8c52-8dc79420e6e8" (UID: "e1673443-c93e-4599-8c52-8dc79420e6e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:09.223421 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.223387    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1673443-c93e-4599-8c52-8dc79420e6e8" (UID: "e1673443-c93e-4599-8c52-8dc79420e6e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:09.223518 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.223438    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-kube-api-access-gntw8" (OuterVolumeSpecName: "kube-api-access-gntw8") pod "e1673443-c93e-4599-8c52-8dc79420e6e8" (UID: "e1673443-c93e-4599-8c52-8dc79420e6e8"). InnerVolumeSpecName "kube-api-access-gntw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:33:09.223930 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.223907    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1673443-c93e-4599-8c52-8dc79420e6e8" (UID: "e1673443-c93e-4599-8c52-8dc79420e6e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:33:09.223930 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.223918    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1673443-c93e-4599-8c52-8dc79420e6e8" (UID: "e1673443-c93e-4599-8c52-8dc79420e6e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:33:09.281687 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.281649    2560 generic.go:356] "Generic (PLEG): container finished" podID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerID="000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621" exitCode=0
Jul 18 02:33:09.281844 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.281701    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"
Jul 18 02:33:09.281844 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.281701    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" event={"ID":"e1673443-c93e-4599-8c52-8dc79420e6e8","Type":"ContainerDied","Data":"000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621"}
Jul 18 02:33:09.282005 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.281854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn" event={"ID":"e1673443-c93e-4599-8c52-8dc79420e6e8","Type":"ContainerDied","Data":"d6684221d37bd2404649cc77a23a713cd38462757f17ecf5f344ae42b0693c17"}
Jul 18 02:33:09.282005 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.281898    2560 scope.go:117] "RemoveContainer" containerID="000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621"
Jul 18 02:33:09.291186 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.291169    2560 scope.go:117] "RemoveContainer" containerID="beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369"
Jul 18 02:33:09.298931 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.298913    2560 scope.go:117] "RemoveContainer" containerID="000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621"
Jul 18 02:33:09.299223 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:33:09.299204    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621\": container with ID starting with 000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621 not found: ID does not exist" containerID="000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621"
Jul 18 02:33:09.299283 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.299233    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621"} err="failed to get container status \"000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621\": rpc error: code = NotFound desc = could not find container \"000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621\": container with ID starting with 000c5d97f18cc04484be518c18f074b0d8db7737345dc867e0fd06e06d1ce621 not found: ID does not exist"
Jul 18 02:33:09.299283 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.299249    2560 scope.go:117] "RemoveContainer" containerID="beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369"
Jul 18 02:33:09.299522 ip-10-0-128-229 kubenswrapper[2560]: E0718 02:33:09.299505    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369\": container with ID starting with beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369 not found: ID does not exist" containerID="beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369"
Jul 18 02:33:09.299565 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.299529    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369"} err="failed to get container status \"beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369\": rpc error: code = NotFound desc = could not find container \"beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369\": container with ID starting with beb95868c401d62fb74a08b6a77ea6d7c4b5b9830ab2470b978b76e876093369 not found: ID does not exist"
Jul 18 02:33:09.304660 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.304639    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"]
Jul 18 02:33:09.308046 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.308026    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-2a8451-openshift-default-79f9c59475-m7tdn"]
Jul 18 02:33:09.322330 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.322300    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:33:09.322400 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.322335    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1673443-c93e-4599-8c52-8dc79420e6e8-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:33:09.322400 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.322347    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:33:09.322400 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.322356    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gntw8\" (UniqueName: \"kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-kube-api-access-gntw8\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:33:09.322400 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.322364    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:33:09.322400 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.322374    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:33:09.322400 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:09.322381    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1673443-c93e-4599-8c52-8dc79420e6e8-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 18 02:33:10.745278 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:10.745245    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" path="/var/lib/kubelet/pods/e1673443-c93e-4599-8c52-8dc79420e6e8/volumes"
Jul 18 02:33:11.030002 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:11.029975    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7456dd48-lbfs7_6f8ebde1-915e-420b-8864-8716b46aedb3/copy-manifests/0.log"
Jul 18 02:33:11.036501 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:11.036480    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7456dd48-lbfs7_6f8ebde1-915e-420b-8864-8716b46aedb3/manager/0.log"
Jul 18 02:33:11.493036 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:11.492954    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29739000-85fvz_a440a4a3-e29e-48c1-a957-4ccdfaa3c5e5/cleanup/0.log"
Jul 18 02:33:13.129959 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:13.129929    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77b54c8556-6wmv6_c4541dcc-369f-45a5-abbc-b2135b609cc1/authorino/0.log"
Jul 18 02:33:14.310677 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:14.310645    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4497w9_605944b1-eb34-4528-80d9-a573fb24fc48/istio-proxy/0.log"
Jul 18 02:33:14.655401 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:14.655293    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f5976ff9-zt5c5_721c48c1-82f0-4fbc-9742-3fa9a4ccc90c/kube-auth-proxy/0.log"
Jul 18 02:33:14.772430 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:14.772397    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-66j7n_62b950dd-353d-4df8-9875-7d768f409083/istio-proxy/1.log"
Jul 18 02:33:15.464370 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:15.464280    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-l4q88_49d4d1b1-9d4b-4e3d-a8d2-d6eeae561351/main/0.log"
Jul 18 02:33:15.689458 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:15.689427    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ttv97_94e5f98a-7073-4907-9343-e51c02d33d73/main/0.log"
Jul 18 02:33:23.847033 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:23.847001    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5wzcl_6b8627d7-e095-4a0e-a025-3a6f488d3bdc/global-pull-secret-syncer/0.log"
Jul 18 02:33:24.040037 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:24.040006    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zg85n_5617181b-0119-4bd1-b5cb-25f0ab09ce41/konnectivity-agent/0.log"
Jul 18 02:33:24.059493 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:24.059466    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-229.ec2.internal_a916a73ea0727afb0c62c6111b95f497/haproxy/0.log"
Jul 18 02:33:24.790864 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:24.790834    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:33:24.799383 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:24.799355    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cb6rk_58fe661b-1a1e-4afc-8721-4b124aad547c/ovn-acl-logging/0.log"
Jul 18 02:33:29.645620 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:29.645575    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77b54c8556-6wmv6_c4541dcc-369f-45a5-abbc-b2135b609cc1/authorino/0.log"
Jul 18 02:33:32.038448 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.038421    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-m94p4_7b3e5c0e-90fb-4af8-b8f1-ab049f506481/monitoring-plugin/0.log"
Jul 18 02:33:32.075793 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.075768    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jhp2m_d639b91e-1c97-4efa-ad5b-1eee8d5a55a0/node-exporter/0.log"
Jul 18 02:33:32.098584 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.098517    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jhp2m_d639b91e-1c97-4efa-ad5b-1eee8d5a55a0/kube-rbac-proxy/0.log"
Jul 18 02:33:32.121553 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.121529    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jhp2m_d639b91e-1c97-4efa-ad5b-1eee8d5a55a0/init-textfile/0.log"
Jul 18 02:33:32.391115 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.391037    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_338ddee9-fe8d-4477-9a1d-4f5f40685c66/prometheus/0.log"
Jul 18 02:33:32.411290 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.411267    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_338ddee9-fe8d-4477-9a1d-4f5f40685c66/config-reloader/0.log"
Jul 18 02:33:32.431373 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.431348    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_338ddee9-fe8d-4477-9a1d-4f5f40685c66/thanos-sidecar/0.log"
Jul 18 02:33:32.457792 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.457767    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_338ddee9-fe8d-4477-9a1d-4f5f40685c66/kube-rbac-proxy-web/0.log"
Jul 18 02:33:32.486306 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.486274    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_338ddee9-fe8d-4477-9a1d-4f5f40685c66/kube-rbac-proxy/0.log"
Jul 18 02:33:32.506116 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.506088    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_338ddee9-fe8d-4477-9a1d-4f5f40685c66/kube-rbac-proxy-thanos/0.log"
Jul 18 02:33:32.527539 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.527512    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_338ddee9-fe8d-4477-9a1d-4f5f40685c66/init-config-reloader/0.log"
Jul 18 02:33:32.724404 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.724300    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679f7dcd9c-jhtc4_adff932f-0cfc-407f-911c-fd191fbac351/thanos-query/0.log"
Jul 18 02:33:32.746252 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.746218    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679f7dcd9c-jhtc4_adff932f-0cfc-407f-911c-fd191fbac351/kube-rbac-proxy-web/0.log"
Jul 18 02:33:32.771504 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.771472    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679f7dcd9c-jhtc4_adff932f-0cfc-407f-911c-fd191fbac351/kube-rbac-proxy/0.log"
Jul 18 02:33:32.798494 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.798462    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679f7dcd9c-jhtc4_adff932f-0cfc-407f-911c-fd191fbac351/prom-label-proxy/0.log"
Jul 18 02:33:32.818033 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.818006    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679f7dcd9c-jhtc4_adff932f-0cfc-407f-911c-fd191fbac351/kube-rbac-proxy-rules/0.log"
Jul 18 02:33:32.840048 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:32.840020    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679f7dcd9c-jhtc4_adff932f-0cfc-407f-911c-fd191fbac351/kube-rbac-proxy-metrics/0.log"
Jul 18 02:33:33.946332 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946297    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"]
Jul 18 02:33:33.946696 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946645    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy"
Jul 18 02:33:33.946696 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946655    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy"
Jul 18 02:33:33.946696 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946669    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy"
Jul 18 02:33:33.946696 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946674    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy"
Jul 18 02:33:33.946696 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946682    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy"
Jul 18 02:33:33.946696 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946688    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy"
Jul 18 02:33:33.946696 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946698    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b63dc739-ebbb-4713-b874-23b02e69948e" containerName="main"
Jul 18 02:33:33.946937 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946703    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b63dc739-ebbb-4713-b874-23b02e69948e" containerName="main"
Jul 18 02:33:33.946937 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946760    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy"
Jul 18 02:33:33.946937 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946767    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb4d643-2ecd-472b-8de4-51e8f720ffb6" containerName="istio-proxy"
Jul 18 02:33:33.946937 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946777    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy"
Jul 18 02:33:33.946937 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946782    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b63dc739-ebbb-4713-b874-23b02e69948e" containerName="main"
Jul 18 02:33:33.946937 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.946788    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1673443-c93e-4599-8c52-8dc79420e6e8" containerName="istio-proxy"
Jul 18 02:33:33.949792 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.949775    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:33.952404 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.952377    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9d7x6\"/\"openshift-service-ca.crt\""
Jul 18 02:33:33.952544 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.952423    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9d7x6\"/\"kube-root-ca.crt\""
Jul 18 02:33:33.952544 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.952449    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9d7x6\"/\"default-dockercfg-6b44b\""
Jul 18 02:33:33.957619 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:33.957598    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"]
Jul 18 02:33:34.040549 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.040517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v9pc\" (UniqueName: \"kubernetes.io/projected/db35a9cd-3107-4641-b26f-9c188abe586d-kube-api-access-2v9pc\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.040714 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.040633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-proc\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.040714 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.040687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-sys\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.040714 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.040706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-podres\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.040818 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.040723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-lib-modules\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.141233 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.141201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v9pc\" (UniqueName: \"kubernetes.io/projected/db35a9cd-3107-4641-b26f-9c188abe586d-kube-api-access-2v9pc\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.141423 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.141276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-proc\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.141423 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.141341    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-sys\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.141423 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.141366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-podres\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.141423 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.141389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-lib-modules\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.141423 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.141409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-proc\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.141602 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.141474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-sys\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.141602 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.141527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-podres\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.141602 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.141536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db35a9cd-3107-4641-b26f-9c188abe586d-lib-modules\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.149658 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.149630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v9pc\" (UniqueName: \"kubernetes.io/projected/db35a9cd-3107-4641-b26f-9c188abe586d-kube-api-access-2v9pc\") pod \"perf-node-gather-daemonset-97l4l\" (UID: \"db35a9cd-3107-4641-b26f-9c188abe586d\") " pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.260595 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.260518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:34.392083 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.392054    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"]
Jul 18 02:33:34.394160 ip-10-0-128-229 kubenswrapper[2560]: W0718 02:33:34.394133    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb35a9cd_3107_4641_b26f_9c188abe586d.slice/crio-dc40920f2b2e93550ae422e22d6396fd620b03133b14921a53cacd4a3bf7d3eb WatchSource:0}: Error finding container dc40920f2b2e93550ae422e22d6396fd620b03133b14921a53cacd4a3bf7d3eb: Status 404 returned error can't find the container with id dc40920f2b2e93550ae422e22d6396fd620b03133b14921a53cacd4a3bf7d3eb
Jul 18 02:33:34.401446 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:34.401411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l" event={"ID":"db35a9cd-3107-4641-b26f-9c188abe586d","Type":"ContainerStarted","Data":"dc40920f2b2e93550ae422e22d6396fd620b03133b14921a53cacd4a3bf7d3eb"}
Jul 18 02:33:35.096831 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:35.096807    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-96ddbb554-cw6zs_81a65f11-27ac-46a2-9e07-0d739a07a9ff/console/0.log"
Jul 18 02:33:35.407054 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:35.406956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l" event={"ID":"db35a9cd-3107-4641-b26f-9c188abe586d","Type":"ContainerStarted","Data":"2b69879115fc7f69b0a5207ecc90c6d029d23e770d7982ce84a1b679471078d3"}
Jul 18 02:33:35.407233 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:35.407089    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:35.425335 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:35.425280    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l" podStartSLOduration=2.4252651370000002 podStartE2EDuration="2.425265137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:33:35.42261137 +0000 UTC m=+2711.224855836" watchObservedRunningTime="2026-07-18 02:33:35.425265137 +0000 UTC m=+2711.227509594"
Jul 18 02:33:36.848014 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:36.847983    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gwhfr_93e29a00-1353-4740-84df-438e861f1dad/dns/0.log"
Jul 18 02:33:36.867509 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:36.867487    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gwhfr_93e29a00-1353-4740-84df-438e861f1dad/kube-rbac-proxy/0.log"
Jul 18 02:33:36.913976 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:36.913950    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44g5s_aa2641fc-b98a-40a4-a4c2-c8b3011b7377/dns-node-resolver/0.log"
Jul 18 02:33:37.597305 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:37.597272    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6484c9655d-5dbdt_c4579162-c023-4512-b7f1-ba5108ce0a2b/registry/0.log"
Jul 18 02:33:37.644103 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:37.644080    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mhngd_cacba113-1053-4df9-b5fe-954e50d6bb34/node-ca/0.log"
Jul 18 02:33:38.613383 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:38.613312    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4497w9_605944b1-eb34-4528-80d9-a573fb24fc48/istio-proxy/0.log"
Jul 18 02:33:38.788013 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:38.787981    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f5976ff9-zt5c5_721c48c1-82f0-4fbc-9742-3fa9a4ccc90c/kube-auth-proxy/0.log"
Jul 18 02:33:38.814441 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:38.814414    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-66j7n_62b950dd-353d-4df8-9875-7d768f409083/istio-proxy/0.log"
Jul 18 02:33:38.843594 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:38.843566    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-66j7n_62b950dd-353d-4df8-9875-7d768f409083/istio-proxy/1.log"
Jul 18 02:33:39.664472 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:39.664444    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t5zbz_d2ff6ba7-1174-46a5-bcb9-5d5e1c2f680b/serve-healthcheck-canary/0.log"
Jul 18 02:33:40.294794 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:40.294764    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zg2gb_c72d7ce5-cc9a-443d-a35d-96e37d9893dd/kube-rbac-proxy/0.log"
Jul 18 02:33:40.315237 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:40.315213    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zg2gb_c72d7ce5-cc9a-443d-a35d-96e37d9893dd/exporter/0.log"
Jul 18 02:33:40.335798 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:40.335775    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zg2gb_c72d7ce5-cc9a-443d-a35d-96e37d9893dd/extractor/0.log"
Jul 18 02:33:41.422360 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:41.422303    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9d7x6/perf-node-gather-daemonset-97l4l"
Jul 18 02:33:43.166744 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:43.166716    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7456dd48-lbfs7_6f8ebde1-915e-420b-8864-8716b46aedb3/manager/0.log"
Jul 18 02:33:43.191683 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:43.191656    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7456dd48-lbfs7_6f8ebde1-915e-420b-8864-8716b46aedb3/copy-manifests/0.log"
Jul 18 02:33:44.570979 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:44.570949    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c55bb847-2f66t_3de54db0-45cc-4579-af0d-2e08ebf426df/manager/0.log"
Jul 18 02:33:44.744842 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:44.744812    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4497w9_605944b1-eb34-4528-80d9-a573fb24fc48/istio-proxy/0.log"
Jul 18 02:33:44.873788 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:44.873694    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f5976ff9-zt5c5_721c48c1-82f0-4fbc-9742-3fa9a4ccc90c/kube-auth-proxy/0.log"
Jul 18 02:33:44.892260 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:44.892232    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-66j7n_62b950dd-353d-4df8-9875-7d768f409083/istio-proxy/0.log"
Jul 18 02:33:44.922123 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:44.922096    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-66j7n_62b950dd-353d-4df8-9875-7d768f409083/istio-proxy/1.log"
Jul 18 02:33:46.199229 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:46.199199    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4497w9_605944b1-eb34-4528-80d9-a573fb24fc48/istio-proxy/0.log"
Jul 18 02:33:46.347802 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:46.347758    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f5976ff9-zt5c5_721c48c1-82f0-4fbc-9742-3fa9a4ccc90c/kube-auth-proxy/0.log"
Jul 18 02:33:46.370025 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:46.369940    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-66j7n_62b950dd-353d-4df8-9875-7d768f409083/istio-proxy/0.log"
Jul 18 02:33:46.403485 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:46.403454    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-66j7n_62b950dd-353d-4df8-9875-7d768f409083/istio-proxy/1.log"
Jul 18 02:33:49.477337 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:49.477292    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ksrbd_a5dbfe05-4b26-445b-83cc-63e57944ea97/migrator/0.log"
Jul 18 02:33:49.497726 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:49.497702    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ksrbd_a5dbfe05-4b26-445b-83cc-63e57944ea97/graceful-termination/0.log"
Jul 18 02:33:50.819106 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:50.819072    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9ql7m_4e96af37-6c7d-4bde-9a5b-ccd31c2c18bc/kube-multus/0.log"
Jul 18 02:33:50.991827 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:50.991804    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cvs5l_d178fdd8-e4a8-4251-bd75-2de893a6994c/kube-multus-additional-cni-plugins/0.log"
Jul 18 02:33:51.012270 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:51.012238    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cvs5l_d178fdd8-e4a8-4251-bd75-2de893a6994c/egress-router-binary-copy/0.log"
Jul 18 02:33:51.032132 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:51.032108    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cvs5l_d178fdd8-e4a8-4251-bd75-2de893a6994c/cni-plugins/0.log"
Jul 18 02:33:51.051598 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:51.051577    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cvs5l_d178fdd8-e4a8-4251-bd75-2de893a6994c/bond-cni-plugin/0.log"
Jul 18 02:33:51.070796 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:51.070715    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cvs5l_d178fdd8-e4a8-4251-bd75-2de893a6994c/routeoverride-cni/0.log"
Jul 18 02:33:51.090425 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:51.090399    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cvs5l_d178fdd8-e4a8-4251-bd75-2de893a6994c/whereabouts-cni-bincopy/0.log"
Jul 18 02:33:51.109872 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:51.109842    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cvs5l_d178fdd8-e4a8-4251-bd75-2de893a6994c/whereabouts-cni/0.log"
Jul 18 02:33:51.323249 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:51.323147    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8csvn_418cbc40-4789-4ca8-b465-6abeeacf0c11/network-metrics-daemon/0.log"
Jul 18 02:33:51.348215 ip-10-0-128-229 kubenswrapper[2560]: I0718 02:33:51.348190    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8csvn_418cbc40-4789-4ca8-b465-6abeeacf0c11/kube-rbac-proxy/0.log"