Jul 22 02:58:05.980794 ip-10-0-139-214 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 02:58:07.991630 ip-10-0-139-214 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 02:58:07.991630 ip-10-0-139-214 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 02:58:07.991630 ip-10-0-139-214 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 02:58:07.991630 ip-10-0-139-214 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 02:58:07.991630 ip-10-0-139-214 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 02:58:07.994735 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:07.994639    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002449    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002480    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002486    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002493    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002497    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002502    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002510    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002515    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002520    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002532    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002537    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002541    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002546    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002560    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002566    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002570    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002576    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002582    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002587    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:58:08.002599 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002593    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002598    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002666    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002814    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002827    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002832    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002837    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002840    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002843    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002846    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002850    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002853    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002856    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002859    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002862    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002865    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002868    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002871    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002875    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002878    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:58:08.003226 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002881    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002884    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002887    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002890    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002893    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002896    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002899    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002902    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002905    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002909    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002912    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002915    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002918    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002921    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002924    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002931    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002935    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002938    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002941    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002944    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:58:08.003749 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002947    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002950    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002953    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002956    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002958    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002961    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002965    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002967    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002970    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002975    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002980    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002984    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002988    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002991    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002994    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.002997    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003000    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003003    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003006    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003009    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:58:08.004302 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003012    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003015    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003019    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003024    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003027    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003031    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003034    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003039    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003043    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003049    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003055    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003059    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003063    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003066    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003070    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003073    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003076    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003079    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003083    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:58:08.004823 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003086    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003910    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003917    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003921    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003924    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003927    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003930    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003933    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003935    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003939    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003942    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003945    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003947    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003950    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003953    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003956    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003959    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003963    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003966    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:58:08.005353 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003969    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003972    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003975    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003978    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003981    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003984    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003987    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003989    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003992    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003995    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.003997    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004000    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004003    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004006    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004008    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004011    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004014    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004018    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004023    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:58:08.005900 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004026    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004030    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004033    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004036    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004039    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004042    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004045    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004049    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004053    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004057    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004060    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004063    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004068    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004072    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004075    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004078    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004081    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004084    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004087    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:58:08.006444 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004091    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004093    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004096    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004099    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004103    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004106    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004109    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004112    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004115    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004118    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004121    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004124    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004126    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004129    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004132    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004135    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004137    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004140    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004143    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004147    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:58:08.006952 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004149    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004152    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004156    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004159    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004162    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004164    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004167    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004170    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004173    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004176    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004178    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004181    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004184    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004186    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004189    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004191    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004194    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004196    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004199    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004202    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:58:08.007491 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004204    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004207    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004209    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004661    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004666    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004670    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004673    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004676    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004679    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004682    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004684    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004687    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004690    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004693    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004696    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004699    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004702    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004705    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004708    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004711    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:58:08.008015 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004714    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004717    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004720    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004723    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004726    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004728    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004731    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004734    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004736    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004739    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004742    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004745    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004748    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004750    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004753    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004756    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004759    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004762    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004764    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:58:08.008550 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004767    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004770    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004774    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004778    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004781    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004784    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004787    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004790    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004793    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004798    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004801    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004804    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004807    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004811    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004820    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004823    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004826    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004830    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:58:08.009036 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004834    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004838    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004840    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004843    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004846    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004849    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004853    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004855    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004858    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004861    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004863    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004867    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004870    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004872    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004875    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004878    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004882    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004885    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004887    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004890    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:58:08.009527 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004893    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004895    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004898    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004901    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004904    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004907    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004909    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004912    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004916    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004919    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004922    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004924    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004927    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004930    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004932    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004935    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004938    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004941    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004944    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004946    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:58:08.010064 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004949    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004952    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004954    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004960    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.004963    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005039    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005047    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005063    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005068    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005072    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005076    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005080    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005085    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005088    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005091    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005095    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005098    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005102    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005105    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005108    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005111    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005115    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005118    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 02:58:08.010627 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005122    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005126    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005129    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005132    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005136    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005141    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005145    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005148    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005152    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005155    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005158    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005161    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005166    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005170    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005174    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005177    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005180    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005184    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005187    2576 flags.go:64] FLAG: --enable-server="true"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005190    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005195    2576 flags.go:64] FLAG: --event-burst="100"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005198    2576 flags.go:64] FLAG: --event-qps="50"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005202    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005205    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 02:58:08.011210 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005208    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005212    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005215    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005218    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005221    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005224    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005227    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005231    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005234    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005237    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005240    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005243    2576 flags.go:64] FLAG: --feature-gates=""
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005247    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005252    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005255    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005259    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005262    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005265    2576 flags.go:64] FLAG: --help="false"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005268    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005271    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005276    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005279    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005283    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 02:58:08.011827 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005286    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005289    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005292    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005296    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005299    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005302    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005305    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005308    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005311    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005314    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005317    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005321    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005323    2576 flags.go:64] FLAG: --lock-file=""
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005326    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005330    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005333    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005339    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005342    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005345    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005348    2576 flags.go:64] FLAG: --logging-format="text"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005351    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005355    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005359    2576 flags.go:64] FLAG: --manifest-url=""
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005363    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005368    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 02:58:08.012611 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005371    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005376    2576 flags.go:64] FLAG: --max-pods="110"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005379    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005382    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005388    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005391    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005394    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005397    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005401    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005408    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005411    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005415    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005418    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005421    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005427    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005430    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005433    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005436    2576 flags.go:64] FLAG: --port="10250"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005439    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005442    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00acd4fd7b9bc615f"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005446    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005449    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005458    2576 flags.go:64] FLAG: --register-node="true"
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005461    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 22 02:58:08.013258 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005465    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005469    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005489    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005492    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005496    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005502    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005506    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005509    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005512    2576 flags.go:64] FLAG: --runonce="false"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005516    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005519    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005523    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005526    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005531    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005534    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005538    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005541    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005544    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005547    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005550    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005553    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005557    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005560    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005563    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005569    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 02:58:08.013923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005572    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005575    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005579    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005582    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005585    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005588    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005591    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005594    2576 flags.go:64] FLAG: --v="2"
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005599    2576 flags.go:64] FLAG: --version="false"
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005604    2576 flags.go:64] FLAG: --vmodule=""
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005608    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.005611    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005751    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005756    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005760    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005763    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005766    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005769    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005772    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005775    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005779    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005782    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:58:08.014682 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005785    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005788    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005790    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005793    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005796    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005800    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005805    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005808    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005811    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005815    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005818    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005821    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005824    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005827    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005830    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005833    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005835    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005838    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005841    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:58:08.015271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005844    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005847    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005850    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005855    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005857    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005860    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005863    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005866    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005869    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005872    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005875    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005879    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005882    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005885    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005887    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005890    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005893    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005897    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005901    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005904    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:58:08.015773 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005907    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005910    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005913    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005916    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005918    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005922    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005925    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005927    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005930    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005933    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005936    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005939    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005941    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005944    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005947    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005951    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005954    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005957    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005959    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005963    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:58:08.016332 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005965    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005968    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005971    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005975    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005978    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005980    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005983    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005986    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005989    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005991    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005994    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.005997    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006000    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006003    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006006    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006008    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006011    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006014    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006016    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006019    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:58:08.016869 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006022    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006025    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006028    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006030    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006033    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006036    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006039    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006045    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006049    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.006053    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.007000    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.014020    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.014040    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.014945    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 02:58:08.017370 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.014955    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015024    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015030    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015034    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015039    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015042    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015045    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015048    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015051    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015054    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015057    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015059    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015063    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015067    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015071    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015074    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015077    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015080    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015084    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:58:08.017759 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015088    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015091    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015095    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015097    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015100    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015104    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015107    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015110    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015113    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015117    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015121    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015129    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015133    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015136    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015139    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015143    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015146    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015149    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015152    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015155    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:58:08.018342 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015158    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015161    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015163    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015166    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015169    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015172    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015175    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015178    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015180    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015183    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015186    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015189    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015191    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015194    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015197    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015199    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015202    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015205    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015208    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015211    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:58:08.018999 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015213    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015216    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015219    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015222    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015229    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015232    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015235    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015238    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015240    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015243    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015246    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015248    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015252    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015255    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015257    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015260    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015263    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015266    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015268    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015271    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:58:08.019533 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015274    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015277    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015280    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015283    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015285    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015288    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015291    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015294    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015296    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015299    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015302    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015305    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015308    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015311    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015314    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015317    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015320    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015324    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015327    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015330    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:58:08.020145 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015333    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.015338    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015508    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015515    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015519    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015522    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015524    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015527    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015530    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015533    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015536    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015539    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015541    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015544    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015547    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:58:08.020723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015550    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015552    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015555    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015558    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015560    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015563    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015566    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015569    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015572    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015575    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015578    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015581    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015584    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015587    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015590    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015599    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015602    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015605    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015608    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:58:08.021200 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015610    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015613    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015616    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015619    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015622    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015625    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015628    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015631    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015633    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015636    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015639    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015642    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015644    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015649    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015653    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015656    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015659    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015662    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015665    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:58:08.021731 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015668    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015671    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015674    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015677    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015680    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015682    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015685    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015690    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015693    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015696    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015707    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015711    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015713    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015716    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015719    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015722    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015724    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015727    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015730    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015733    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:58:08.022363 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015736    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015739    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015741    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015744    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015747    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015749    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015752    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015755    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015758    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015761    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015764    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015768    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015772    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015776    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015779    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015782    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015784    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015788    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015791    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015794    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:58:08.023276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015796    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015799    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015802    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015810    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015813    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015816    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015818    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:08.015821    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.015827    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.015992    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.018017    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.019623    2576 server.go:1019] "Starting client certificate rotation"
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.019756    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.020726    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 02:58:08.024026 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.022078    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 02:58:08.024449 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.023331    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 02:58:08.038358 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.038278    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 22 02:58:08.041185 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.041164    2576 log.go:25] "Validated CRI v1 image API"
Jul 22 02:58:08.042798 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.042779    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 02:58:08.046434 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.046411    2576 fs.go:135] Filesystem UUIDs: map[3dcb10ed-825d-4ccd-af18-9074b5eacd17:/dev/nvme0n1p3 3ef01228-ff82-42c4-8f62-2038b9288e6a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 22 02:58:08.046499 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.046434    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 02:58:08.053642 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.053505    2576 manager.go:216] Machine: {Timestamp:2026-07-22 02:58:08.051950046 +0000 UTC m=+1.938078180 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093747 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec256f8dee0118c1d51afe90fb090f73 SystemUUID:ec256f8d-ee01-18c1-d51a-fe90fb090f73 BootID:54a4b73c-cff2-41b9-834b-7465a833955c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:18:86:ae:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:18:86:ae:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:bc:85:7a:31:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 02:58:08.053642 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.053633    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 02:58:08.053803 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.053729    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 02:58:08.054461 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.054443    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 02:58:08.054855 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.054822    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 02:58:08.055032 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.054863    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-214.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 02:58:08.056178 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.056166    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 02:58:08.056221 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.056181    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 02:58:08.056221 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.056194    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 02:58:08.056919 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.056908    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 02:58:08.058269 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.058257    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 02:58:08.061830 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.061817    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 02:58:08.061969 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.061952    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 02:58:08.062011 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.061991    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 02:58:08.062011 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.062002    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 02:58:08.062068 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.062019    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 02:58:08.062068 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.062030    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 22 02:58:08.062068 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.062040    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 02:58:08.062454 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.062440    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 02:58:08.062510 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.062465    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 02:58:08.065197 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.065180    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 02:58:08.067585 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.067569    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 02:58:08.067666 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.067602    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 02:58:08.068766 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068745    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 02:58:08.068766 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068763    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 02:58:08.068766 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068770    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 02:58:08.068943 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068779    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 02:58:08.068943 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068794    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 02:58:08.068943 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068806    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 02:58:08.068943 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068816    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 02:58:08.068943 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068822    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 02:58:08.068943 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068830    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 02:58:08.068943 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068836    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 02:58:08.068943 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068856    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 02:58:08.068943 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.068862    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 02:58:08.069536 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.069523    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 02:58:08.069536 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.069535    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 02:58:08.071765 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.071735    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 02:58:08.071877 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.071853    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-214.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 02:58:08.073281 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.073267    2576 server.go:1268] "Started kubelet"
Jul 22 02:58:08.073394 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.073364    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 02:58:08.073978 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.073345    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 02:58:08.074146 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.074117    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 02:58:08.074619 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.074216    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-214.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 02:58:08.074801 ip-10-0-139-214 systemd[1]: Started Kubernetes Kubelet.
Jul 22 02:58:08.076259 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.076150    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 02:58:08.078217 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.078197    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 02:58:08.079078 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.079056    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dthc6"
Jul 22 02:58:08.080745 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.080713    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 02:58:08.082616 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.082603    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 02:58:08.082701 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.082617    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 02:58:08.082701 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.082681    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:08.083214 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.083190    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 02:58:08.083214 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.083192    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 02:58:08.083354 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.083226    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 02:58:08.083425 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.083360    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 02:58:08.083425 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.083371    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 02:58:08.084331 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.084305    2576 factory.go:55] Registering systemd factory
Jul 22 02:58:08.084331 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.084329    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 22 02:58:08.084584 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.084570    2576 factory.go:153] Registering CRI-O factory
Jul 22 02:58:08.084648 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.084587    2576 factory.go:223] Registration of the crio container factory successfully
Jul 22 02:58:08.084702 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.084647    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 02:58:08.084702 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.084675    2576 factory.go:103] Registering Raw factory
Jul 22 02:58:08.084702 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.084691    2576 manager.go:1196] Started watching for new ooms in manager
Jul 22 02:58:08.085073 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.084071    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-214.ec2.internal.18c47d45191f0fa7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-214.ec2.internal,UID:ip-10-0-139-214.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-214.ec2.internal,},FirstTimestamp:2026-07-22 02:58:08.073240487 +0000 UTC m=+1.959368621,LastTimestamp:2026-07-22 02:58:08.073240487 +0000 UTC m=+1.959368621,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-214.ec2.internal,}"
Jul 22 02:58:08.085582 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.085563    2576 manager.go:349] Starting recovery of all containers
Jul 22 02:58:08.088040 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.088013    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dthc6"
Jul 22 02:58:08.090617 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.090592    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-214.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 02:58:08.090768 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.090748    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 02:58:08.096312 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.096290    2576 manager.go:354] Recovery completed
Jul 22 02:58:08.100987 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.100970    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:58:08.103031 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.103006    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:58:08.103133 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.103042    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:58:08.103133 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.103054    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:58:08.103701 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.103681    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 02:58:08.103701 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.103699    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 02:58:08.103850 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.103724    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 02:58:08.103850 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.103733    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:58:08.104778 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.104760    2576 policy_none.go:49] "None policy: Start"
Jul 22 02:58:08.104861 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.104788    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 02:58:08.104861 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.104800    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 02:58:08.104940 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.104872    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:58:08.104940 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.104901    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:58:08.104940 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.104912    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:58:08.105668 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.105595    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-214.ec2.internal.18c47d451ae59185  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-214.ec2.internal,UID:ip-10-0-139-214.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-214.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-214.ec2.internal,},FirstTimestamp:2026-07-22 02:58:08.103027077 +0000 UTC m=+1.989155217,LastTimestamp:2026-07-22 02:58:08.103027077 +0000 UTC m=+1.989155217,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-214.ec2.internal,}"
Jul 22 02:58:08.105734 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.105672    2576 policy_none.go:47] "Start"
Jul 22 02:58:08.149208 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.149185    2576 manager.go:337] "Starting Device Plugin manager"
Jul 22 02:58:08.149338 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.149231    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 02:58:08.149338 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.149255    2576 server.go:87] "Starting device plugin registration server"
Jul 22 02:58:08.149725 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.149699    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 02:58:08.149725 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.149713    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 02:58:08.149885 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.149866    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 02:58:08.149997 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.149983    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 02:58:08.149997 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.149997    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 02:58:08.150503 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.150479    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 02:58:08.150611 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.150537    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:08.175659 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.175625    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 02:58:08.177036 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.177009    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 02:58:08.177136 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.177060    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 02:58:08.177136 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.177092    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 02:58:08.177233 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.177138    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 02:58:08.179346 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.179327    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:58:08.254117 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.254069    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:58:08.255218 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.255199    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:58:08.255317 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.255236    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:58:08.255317 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.255247    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:58:08.255317 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.255276    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.263527 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.263497    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.263676 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.263531    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-214.ec2.internal\": node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:08.277534 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.277503    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal"]
Jul 22 02:58:08.277681 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.277580    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:58:08.278569 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.278547    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:58:08.278676 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.278588    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:58:08.278676 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.278601    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:58:08.279720 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.279707    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:58:08.279868 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.279853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.279905 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.279884    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:58:08.280498 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.280483    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:58:08.280580 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.280495    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:58:08.280580 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.280508    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:58:08.280580 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.280522    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:58:08.280580 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.280524    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:58:08.280580 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.280533    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:58:08.281287 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.281268    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:08.281593 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.281579    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.281652 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.281605    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:58:08.282269 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.282253    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:58:08.282323 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.282287    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:58:08.282323 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.282301    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:58:08.310676 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.310567    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-214.ec2.internal\" not found" node="ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.315664 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.315646    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-214.ec2.internal\" not found" node="ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.382138 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.382115    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:08.384512 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.384490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35090b9d346aac976095a55200f0a993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal\" (UID: \"35090b9d346aac976095a55200f0a993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.384579 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.384523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35090b9d346aac976095a55200f0a993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal\" (UID: \"35090b9d346aac976095a55200f0a993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.384579 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.384542    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0dcf5c9a6ed001643e8598db403124c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-214.ec2.internal\" (UID: \"a0dcf5c9a6ed001643e8598db403124c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.482619 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.482572    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:08.484922 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.484905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35090b9d346aac976095a55200f0a993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal\" (UID: \"35090b9d346aac976095a55200f0a993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.484977 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.484931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35090b9d346aac976095a55200f0a993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal\" (UID: \"35090b9d346aac976095a55200f0a993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.484977 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.484949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0dcf5c9a6ed001643e8598db403124c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-214.ec2.internal\" (UID: \"a0dcf5c9a6ed001643e8598db403124c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.485067 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.485005    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0dcf5c9a6ed001643e8598db403124c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-214.ec2.internal\" (UID: \"a0dcf5c9a6ed001643e8598db403124c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.485067 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.485016    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/35090b9d346aac976095a55200f0a993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal\" (UID: \"35090b9d346aac976095a55200f0a993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.485067 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.485045    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35090b9d346aac976095a55200f0a993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal\" (UID: \"35090b9d346aac976095a55200f0a993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.583834 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.583755    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:08.615508 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.615480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.618243 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:08.618226    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:08.684292 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.684255    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:08.790211 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.790174    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:08.891146 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.891077    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:08.991422 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:08.991361    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:09.018012 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.017982    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:58:09.019085 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.019066    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 02:58:09.019201 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.019183    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 02:58:09.079200 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.079172    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:58:09.092127 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.092080    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 02:53:08 +0000 UTC" deadline="2028-04-12 15:24:19.820877438 +0000 UTC"
Jul 22 02:58:09.092127 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.092125    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15132h26m10.728757799s"
Jul 22 02:58:09.092372 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:09.092095    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:09.192992 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:09.192963    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:09.199011 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:09.198976    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35090b9d346aac976095a55200f0a993.slice/crio-0e010a3e91566be20d8c8a7477711974ba1f5bc9dbbce9c3921d07c53d35147a WatchSource:0}: Error finding container 0e010a3e91566be20d8c8a7477711974ba1f5bc9dbbce9c3921d07c53d35147a: Status 404 returned error can't find the container with id 0e010a3e91566be20d8c8a7477711974ba1f5bc9dbbce9c3921d07c53d35147a
Jul 22 02:58:09.203276 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:09.203232    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0dcf5c9a6ed001643e8598db403124c.slice/crio-75bc798358b77f3d3932bd88d7efe8048ab86f432bb25e9b560d937dc67e5030 WatchSource:0}: Error finding container 75bc798358b77f3d3932bd88d7efe8048ab86f432bb25e9b560d937dc67e5030: Status 404 returned error can't find the container with id 75bc798358b77f3d3932bd88d7efe8048ab86f432bb25e9b560d937dc67e5030
Jul 22 02:58:09.205770 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.205752    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 02:58:09.293764 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:09.293727    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:09.394901 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:09.394860    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:09.495670 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:09.495573    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:09.596414 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:09.596368    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-214.ec2.internal\" not found"
Jul 22 02:58:09.644046 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.644013    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:58:09.683079 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.683044    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:09.694410 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.694363    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 02:58:09.695581 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.695555    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal"
Jul 22 02:58:09.704577 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.704547    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 02:58:09.903687 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:09.903582    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:58:10.063157 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.062914    2576 apiserver.go:52] "Watching apiserver"
Jul 22 02:58:10.069623 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.069587    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 02:58:10.071035 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.071008    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-br9cp","openshift-multus/network-metrics-daemon-cs9qm","openshift-network-diagnostics/network-check-target-drd2l","openshift-network-operator/iptables-alerter-lcz54","openshift-ovn-kubernetes/ovnkube-node-8ktlt","kube-system/global-pull-secret-syncer-znwcl","kube-system/konnectivity-agent-sgp8g","kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd","openshift-cluster-node-tuning-operator/tuned-7fvpd","openshift-image-registry/node-ca-t5hpj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal","openshift-multus/multus-additional-cni-plugins-ww96c","openshift-dns/node-resolver-lvztc"]
Jul 22 02:58:10.072854 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.072829    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:10.074050 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.074024    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.075242 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.075195    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vcmq5\""
Jul 22 02:58:10.075349 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.075210    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 02:58:10.075349 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.075338    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 02:58:10.075499 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.075462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:10.075556 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.075531    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:10.076948 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.076678    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.076948 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.076744    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 02:58:10.076948 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.076794    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 02:58:10.076948 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.076905    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 02:58:10.077211 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.077022    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 02:58:10.077211 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.077200    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 02:58:10.077323 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.077303    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vzz55\""
Jul 22 02:58:10.078608 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.078393    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.079281 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.079260    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 02:58:10.079373 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.079319    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mkqr4\""
Jul 22 02:58:10.079430 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.079263    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:58:10.079634 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.079609    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 02:58:10.080004 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.079887    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:10.080004 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.079965    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:10.081103 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.080531    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 02:58:10.081103 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.080720    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 02:58:10.081103 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.080747    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5ch4h\""
Jul 22 02:58:10.081103 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.080536    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 02:58:10.081103 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.080947    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 02:58:10.081103 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.081053    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 02:58:10.081439 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.081321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.082160 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.082139    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 02:58:10.082608 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.082587    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.083079 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.083054    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 02:58:10.084017 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.083993    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 02:58:10.084204 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.084187    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 02:58:10.085263 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.085241    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5kn59\""
Jul 22 02:58:10.087536 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.086962    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 02:58:10.087946 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.087926    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:10.088067 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.088033    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:10.089171 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.088675    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 02:58:10.089675 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.089656    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nhb88\""
Jul 22 02:58:10.089789 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.089769    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.091398 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.090660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.092443 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.092398    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.092847 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.092826    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 02:58:10.093169 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.093152    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:58:10.093324 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.093305    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nlh5f\""
Jul 22 02:58:10.093603 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.093584    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zkbfs\""
Jul 22 02:58:10.093902 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.093882    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 02:58:10.093993 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.093900    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 02:58:10.095297 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.095201    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 02:58:10.095393 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.095352    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 02:58:10.095393 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.095378    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 02:58:10.095533 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.095463    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ct7fj\""
Jul 22 02:58:10.100123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqxt7\" (UniqueName: \"kubernetes.io/projected/88e116fe-677d-4d14-94dc-7cf43f32df95-kube-api-access-zqxt7\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.100226 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f3ebc44-1e39-458b-90fc-94951e07f565-kubelet-config\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:10.100226 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-cni-dir\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.100226 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100185    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-conf-dir\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.100226 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100219    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 02:58:10.100462 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100235    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwd7\" (UniqueName: \"kubernetes.io/projected/552549b9-1739-4b41-b3e0-423296732969-kube-api-access-8xwd7\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:10.100462 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:10.100462 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100345    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55c949b3-37d3-4884-a826-b18881136778-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.100462 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8147f8f1-e491-4942-a0af-05ff5ce449c7-iptables-alerter-script\") pod \"iptables-alerter-lcz54\" (UID: \"8147f8f1-e491-4942-a0af-05ff5ce449c7\") " pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.100655 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-registration-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.100655 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-system-cni-dir\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.100655 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da7fd337-2011-4001-9fa1-79a3c813aafd-agent-certs\") pod \"konnectivity-agent-sgp8g\" (UID: \"da7fd337-2011-4001-9fa1-79a3c813aafd\") " pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:10.100655 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-etc-openvswitch\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.100655 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-device-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.100971 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55c949b3-37d3-4884-a826-b18881136778-cni-binary-copy\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.100971 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-var-lib-cni-bin\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.100971 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-etc-selinux\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.100971 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100772    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8147f8f1-e491-4942-a0af-05ff5ce449c7-host-slash\") pod \"iptables-alerter-lcz54\" (UID: \"8147f8f1-e491-4942-a0af-05ff5ce449c7\") " pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.100971 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26bd034e-08ef-402e-84b5-92d8826a3e94-cni-binary-copy\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.100971 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-etc-kubernetes\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.100971 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-cni-netd\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.100971 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-ovnkube-config\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.100971 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crqv9\" (UniqueName: \"kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9\") pod \"network-check-target-drd2l\" (UID: \"cf953d49-185e-4ff2-bda6-e341c9943943\") " pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:10.100971 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-run-systemd\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.100989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-os-release\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101132    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-system-cni-dir\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-run-openvswitch\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-env-overrides\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzxhb\" (UniqueName: \"kubernetes.io/projected/55c949b3-37d3-4884-a826-b18881136778-kube-api-access-gzxhb\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101247    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-run-k8s-cni-cncf-io\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-var-lib-kubelet\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da7fd337-2011-4001-9fa1-79a3c813aafd-konnectivity-ca\") pod \"konnectivity-agent-sgp8g\" (UID: \"da7fd337-2011-4001-9fa1-79a3c813aafd\") " pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-log-socket\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-ovnkube-script-lib\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-sys-fs\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-kubelet\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f3ebc44-1e39-458b-90fc-94951e07f565-dbus\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:10.101489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-run-netns\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-systemd-units\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101573    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-os-release\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-socket-dir-parent\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhlzk\" (UniqueName: \"kubernetes.io/projected/26bd034e-08ef-402e-84b5-92d8826a3e94-kube-api-access-vhlzk\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-socket-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-slash\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpgj6\" (UniqueName: \"kubernetes.io/projected/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-kube-api-access-tpgj6\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-cnibin\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-var-lib-cni-multus\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-var-lib-openvswitch\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-run-ovn\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55c949b3-37d3-4884-a826-b18881136778-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.101952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-hostroot\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.102009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-daemon-config\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.102304 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.102038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-run-multus-certs\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.103231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.102074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-run-netns\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.103231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.102105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.103231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.102128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-ovn-node-metrics-cert\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.103231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.102157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.103231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.102192    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-cni-bin\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.103231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.102226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdgg8\" (UniqueName: \"kubernetes.io/projected/8147f8f1-e491-4942-a0af-05ff5ce449c7-kube-api-access-gdgg8\") pod \"iptables-alerter-lcz54\" (UID: \"8147f8f1-e491-4942-a0af-05ff5ce449c7\") " pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.103231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.102255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-cnibin\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.103231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.102284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-node-log\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.118653 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.118540    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-858hl"
Jul 22 02:58:10.126968 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.126941    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-858hl"
Jul 22 02:58:10.182123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.182072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal" event={"ID":"a0dcf5c9a6ed001643e8598db403124c","Type":"ContainerStarted","Data":"75bc798358b77f3d3932bd88d7efe8048ab86f432bb25e9b560d937dc67e5030"}
Jul 22 02:58:10.184074 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.184026    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal" event={"ID":"35090b9d346aac976095a55200f0a993","Type":"ContainerStarted","Data":"0e010a3e91566be20d8c8a7477711974ba1f5bc9dbbce9c3921d07c53d35147a"}
Jul 22 02:58:10.184235 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.184220    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 02:58:10.203132 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-sysctl-d\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.203305 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crqv9\" (UniqueName: \"kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9\") pod \"network-check-target-drd2l\" (UID: \"cf953d49-185e-4ff2-bda6-e341c9943943\") " pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:10.203305 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-run-systemd\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.203305 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.203305 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-os-release\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.203305 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:10.203305 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-system-cni-dir\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.203305 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-run-openvswitch\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.203305 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203296    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-run-systemd\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-env-overrides\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzxhb\" (UniqueName: \"kubernetes.io/projected/55c949b3-37d3-4884-a826-b18881136778-kube-api-access-gzxhb\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-run-k8s-cni-cncf-io\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-var-lib-kubelet\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-host\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da7fd337-2011-4001-9fa1-79a3c813aafd-konnectivity-ca\") pod \"konnectivity-agent-sgp8g\" (UID: \"da7fd337-2011-4001-9fa1-79a3c813aafd\") " pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-log-socket\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-ovnkube-script-lib\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-sys-fs\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5d4w\" (UniqueName: \"kubernetes.io/projected/f809ee84-b430-4412-a4e2-164df3f746d5-kube-api-access-t5d4w\") pod \"node-ca-t5hpj\" (UID: \"f809ee84-b430-4412-a4e2-164df3f746d5\") " pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-kubelet\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.203598    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f3ebc44-1e39-458b-90fc-94951e07f565-dbus\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-run-netns\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.203678    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret podName:3f3ebc44-1e39-458b-90fc-94951e07f565 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:10.703655629 +0000 UTC m=+4.589783772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret") pod "global-pull-secret-syncer-znwcl" (UID: "3f3ebc44-1e39-458b-90fc-94951e07f565") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-run-netns\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.203754 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-systemd\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-run-k8s-cni-cncf-io\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-env-overrides\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-os-release\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203902    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-systemd-units\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203934    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-system-cni-dir\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-os-release\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.203993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-socket-dir-parent\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-var-lib-kubelet\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhlzk\" (UniqueName: \"kubernetes.io/projected/26bd034e-08ef-402e-84b5-92d8826a3e94-kube-api-access-vhlzk\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-sysconfig\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-sysctl-conf\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-lib-modules\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-socket-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.204637 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-slash\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-systemd-units\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204213    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-slash\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpgj6\" (UniqueName: \"kubernetes.io/projected/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-kube-api-access-tpgj6\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204297    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-run-openvswitch\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-cnibin\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-cnibin\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-var-lib-cni-multus\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-var-lib-cni-multus\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88c2f\" (UniqueName: \"kubernetes.io/projected/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-kube-api-access-88c2f\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f809ee84-b430-4412-a4e2-164df3f746d5-serviceca\") pod \"node-ca-t5hpj\" (UID: \"f809ee84-b430-4412-a4e2-164df3f746d5\") " pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204415    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-os-release\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-var-lib-openvswitch\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204458    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-run-ovn\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55c949b3-37d3-4884-a826-b18881136778-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204529    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-socket-dir-parent\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-hostroot\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.205506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-daemon-config\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-run-multus-certs\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-kubelet\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-modprobe-d\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204654    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-tuned\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-run-netns\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-ovn-node-metrics-cert\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5f2z\" (UniqueName: \"kubernetes.io/projected/311a7a15-e954-4ed4-8158-b7fdb0246cf2-kube-api-access-c5f2z\") pod \"node-resolver-lvztc\" (UID: \"311a7a15-e954-4ed4-8158-b7fdb0246cf2\") " pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-cni-bin\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-ovnkube-script-lib\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdgg8\" (UniqueName: \"kubernetes.io/projected/8147f8f1-e491-4942-a0af-05ff5ce449c7-kube-api-access-gdgg8\") pod \"iptables-alerter-lcz54\" (UID: \"8147f8f1-e491-4942-a0af-05ff5ce449c7\") " pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-cnibin\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-node-log\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqxt7\" (UniqueName: \"kubernetes.io/projected/88e116fe-677d-4d14-94dc-7cf43f32df95-kube-api-access-zqxt7\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-log-socket\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.206355 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f3ebc44-1e39-458b-90fc-94951e07f565-kubelet-config\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-cni-dir\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-run-ovn\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-var-lib-openvswitch\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-conf-dir\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwd7\" (UniqueName: \"kubernetes.io/projected/552549b9-1739-4b41-b3e0-423296732969-kube-api-access-8xwd7\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-socket-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-kubernetes\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-var-lib-kubelet\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205073    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-node-log\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da7fd337-2011-4001-9fa1-79a3c813aafd-konnectivity-ca\") pod \"konnectivity-agent-sgp8g\" (UID: \"da7fd337-2011-4001-9fa1-79a3c813aafd\") " pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-hostroot\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205239    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-cnibin\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55c949b3-37d3-4884-a826-b18881136778-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8147f8f1-e491-4942-a0af-05ff5ce449c7-iptables-alerter-script\") pod \"iptables-alerter-lcz54\" (UID: \"8147f8f1-e491-4942-a0af-05ff5ce449c7\") " pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-sys\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.207180 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205688    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55c949b3-37d3-4884-a826-b18881136778-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204569    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f3ebc44-1e39-458b-90fc-94951e07f565-dbus\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/311a7a15-e954-4ed4-8158-b7fdb0246cf2-hosts-file\") pod \"node-resolver-lvztc\" (UID: \"311a7a15-e954-4ed4-8158-b7fdb0246cf2\") " pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.205801    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-daemon-config\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.204595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-sys-fs\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.205857    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs podName:552549b9-1739-4b41-b3e0-423296732969 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:10.70584146 +0000 UTC m=+4.591969580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs") pod "network-metrics-daemon-cs9qm" (UID: "552549b9-1739-4b41-b3e0-423296732969") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.205892    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f3ebc44-1e39-458b-90fc-94951e07f565-kubelet-config\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-cni-bin\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-cni-dir\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-run-multus-certs\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55c949b3-37d3-4884-a826-b18881136778-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-multus-conf-dir\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/311a7a15-e954-4ed4-8158-b7fdb0246cf2-tmp-dir\") pod \"node-resolver-lvztc\" (UID: \"311a7a15-e954-4ed4-8158-b7fdb0246cf2\") " pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-registration-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-system-cni-dir\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.208140 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206668    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-run\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-tmp\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8147f8f1-e491-4942-a0af-05ff5ce449c7-iptables-alerter-script\") pod \"iptables-alerter-lcz54\" (UID: \"8147f8f1-e491-4942-a0af-05ff5ce449c7\") " pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da7fd337-2011-4001-9fa1-79a3c813aafd-agent-certs\") pod \"konnectivity-agent-sgp8g\" (UID: \"da7fd337-2011-4001-9fa1-79a3c813aafd\") " pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-etc-openvswitch\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-device-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c949b3-37d3-4884-a826-b18881136778-system-cni-dir\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55c949b3-37d3-4884-a826-b18881136778-cni-binary-copy\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-var-lib-cni-bin\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-registration-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-etc-selinux\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.206980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8147f8f1-e491-4942-a0af-05ff5ce449c7-host-slash\") pod \"iptables-alerter-lcz54\" (UID: \"8147f8f1-e491-4942-a0af-05ff5ce449c7\") " pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-run-netns\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26bd034e-08ef-402e-84b5-92d8826a3e94-cni-binary-copy\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-etc-kubernetes\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.209020 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f809ee84-b430-4412-a4e2-164df3f746d5-host\") pod \"node-ca-t5hpj\" (UID: \"f809ee84-b430-4412-a4e2-164df3f746d5\") " pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-cni-netd\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-ovnkube-config\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-host-var-lib-cni-bin\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207287    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-etc-openvswitch\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207895    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26bd034e-08ef-402e-84b5-92d8826a3e94-cni-binary-copy\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.209161    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-device-dir\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.209271    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88e116fe-677d-4d14-94dc-7cf43f32df95-etc-selinux\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.209313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26bd034e-08ef-402e-84b5-92d8826a3e94-etc-kubernetes\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.207464    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-host-cni-netd\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.209362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8147f8f1-e491-4942-a0af-05ff5ce449c7-host-slash\") pod \"iptables-alerter-lcz54\" (UID: \"8147f8f1-e491-4942-a0af-05ff5ce449c7\") " pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.209431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55c949b3-37d3-4884-a826-b18881136778-cni-binary-copy\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.209954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.209409    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-ovnkube-config\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.210602 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.210312    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:58:10.210602 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.210335    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:58:10.210602 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.210358    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crqv9 for pod openshift-network-diagnostics/network-check-target-drd2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:10.210602 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.210414    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9 podName:cf953d49-185e-4ff2-bda6-e341c9943943 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:10.710397871 +0000 UTC m=+4.596526012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-crqv9" (UniqueName: "kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9") pod "network-check-target-drd2l" (UID: "cf953d49-185e-4ff2-bda6-e341c9943943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:10.212426 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.211846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-ovn-node-metrics-cert\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.212426 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.212194    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da7fd337-2011-4001-9fa1-79a3c813aafd-agent-certs\") pod \"konnectivity-agent-sgp8g\" (UID: \"da7fd337-2011-4001-9fa1-79a3c813aafd\") " pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:10.216082 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.215276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzxhb\" (UniqueName: \"kubernetes.io/projected/55c949b3-37d3-4884-a826-b18881136778-kube-api-access-gzxhb\") pod \"multus-additional-cni-plugins-ww96c\" (UID: \"55c949b3-37d3-4884-a826-b18881136778\") " pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.216082 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.215910    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdgg8\" (UniqueName: \"kubernetes.io/projected/8147f8f1-e491-4942-a0af-05ff5ce449c7-kube-api-access-gdgg8\") pod \"iptables-alerter-lcz54\" (UID: \"8147f8f1-e491-4942-a0af-05ff5ce449c7\") " pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.218449 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.216445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqxt7\" (UniqueName: \"kubernetes.io/projected/88e116fe-677d-4d14-94dc-7cf43f32df95-kube-api-access-zqxt7\") pod \"aws-ebs-csi-driver-node-k2vkd\" (UID: \"88e116fe-677d-4d14-94dc-7cf43f32df95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.218449 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.217060    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpgj6\" (UniqueName: \"kubernetes.io/projected/d65809c0-05e1-4e2c-bf51-967d1cc4bc4e-kube-api-access-tpgj6\") pod \"ovnkube-node-8ktlt\" (UID: \"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.218829 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.218744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhlzk\" (UniqueName: \"kubernetes.io/projected/26bd034e-08ef-402e-84b5-92d8826a3e94-kube-api-access-vhlzk\") pod \"multus-br9cp\" (UID: \"26bd034e-08ef-402e-84b5-92d8826a3e94\") " pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.219730 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.218996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwd7\" (UniqueName: \"kubernetes.io/projected/552549b9-1739-4b41-b3e0-423296732969-kube-api-access-8xwd7\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:10.307568 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-sysctl-d\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.307785 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-host\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.307785 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5d4w\" (UniqueName: \"kubernetes.io/projected/f809ee84-b430-4412-a4e2-164df3f746d5-kube-api-access-t5d4w\") pod \"node-ca-t5hpj\" (UID: \"f809ee84-b430-4412-a4e2-164df3f746d5\") " pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.307785 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-systemd\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.307785 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-systemd\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.307785 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-host\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.307785 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-sysctl-d\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.307785 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-sysconfig\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-sysctl-conf\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-lib-modules\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307832    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-sysconfig\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88c2f\" (UniqueName: \"kubernetes.io/projected/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-kube-api-access-88c2f\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f809ee84-b430-4412-a4e2-164df3f746d5-serviceca\") pod \"node-ca-t5hpj\" (UID: \"f809ee84-b430-4412-a4e2-164df3f746d5\") " pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-modprobe-d\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-tuned\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5f2z\" (UniqueName: \"kubernetes.io/projected/311a7a15-e954-4ed4-8158-b7fdb0246cf2-kube-api-access-c5f2z\") pod \"node-resolver-lvztc\" (UID: \"311a7a15-e954-4ed4-8158-b7fdb0246cf2\") " pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-kubernetes\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-sysctl-conf\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.307962    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-var-lib-kubelet\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-sys\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-modprobe-d\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/311a7a15-e954-4ed4-8158-b7fdb0246cf2-hosts-file\") pod \"node-resolver-lvztc\" (UID: \"311a7a15-e954-4ed4-8158-b7fdb0246cf2\") " pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/311a7a15-e954-4ed4-8158-b7fdb0246cf2-tmp-dir\") pod \"node-resolver-lvztc\" (UID: \"311a7a15-e954-4ed4-8158-b7fdb0246cf2\") " pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-run\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308100    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-lib-modules\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.308215 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-tmp\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.309123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308156    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-kubernetes\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.309123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f809ee84-b430-4412-a4e2-164df3f746d5-host\") pod \"node-ca-t5hpj\" (UID: \"f809ee84-b430-4412-a4e2-164df3f746d5\") " pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.309123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-var-lib-kubelet\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.309123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308213    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/311a7a15-e954-4ed4-8158-b7fdb0246cf2-hosts-file\") pod \"node-resolver-lvztc\" (UID: \"311a7a15-e954-4ed4-8158-b7fdb0246cf2\") " pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.309123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308250    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-run\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.309123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308261    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f809ee84-b430-4412-a4e2-164df3f746d5-host\") pod \"node-ca-t5hpj\" (UID: \"f809ee84-b430-4412-a4e2-164df3f746d5\") " pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.309123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308306    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-sys\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.309123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/311a7a15-e954-4ed4-8158-b7fdb0246cf2-tmp-dir\") pod \"node-resolver-lvztc\" (UID: \"311a7a15-e954-4ed4-8158-b7fdb0246cf2\") " pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.309123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.308770    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f809ee84-b430-4412-a4e2-164df3f746d5-serviceca\") pod \"node-ca-t5hpj\" (UID: \"f809ee84-b430-4412-a4e2-164df3f746d5\") " pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.311189 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.311163    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-etc-tuned\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.311317 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.311195    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-tmp\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.316891 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.316842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5f2z\" (UniqueName: \"kubernetes.io/projected/311a7a15-e954-4ed4-8158-b7fdb0246cf2-kube-api-access-c5f2z\") pod \"node-resolver-lvztc\" (UID: \"311a7a15-e954-4ed4-8158-b7fdb0246cf2\") " pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.318586 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.318566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88c2f\" (UniqueName: \"kubernetes.io/projected/fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e-kube-api-access-88c2f\") pod \"tuned-7fvpd\" (UID: \"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e\") " pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.318721 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.318700    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5d4w\" (UniqueName: \"kubernetes.io/projected/f809ee84-b430-4412-a4e2-164df3f746d5-kube-api-access-t5d4w\") pod \"node-ca-t5hpj\" (UID: \"f809ee84-b430-4412-a4e2-164df3f746d5\") " pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.397708 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.397630    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:10.407951 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.407877    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ww96c"
Jul 22 02:58:10.417703 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.417672    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lcz54"
Jul 22 02:58:10.425580 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.425554    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:10.434821 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.434796    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd"
Jul 22 02:58:10.443633 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.443610    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-br9cp"
Jul 22 02:58:10.450372 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.450343    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7fvpd"
Jul 22 02:58:10.459187 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.459160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t5hpj"
Jul 22 02:58:10.464995 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.464963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lvztc"
Jul 22 02:58:10.712087 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.712047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crqv9\" (UniqueName: \"kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9\") pod \"network-check-target-drd2l\" (UID: \"cf953d49-185e-4ff2-bda6-e341c9943943\") " pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:10.712261 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.712102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:10.712261 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:10.712162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:10.712351 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.712270    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:58:10.712351 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.712309    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:58:10.712351 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.712323    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crqv9 for pod openshift-network-diagnostics/network-check-target-drd2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:10.712481 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.712276    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:10.712481 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.712389    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9 podName:cf953d49-185e-4ff2-bda6-e341c9943943 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:11.712367085 +0000 UTC m=+5.598495226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-crqv9" (UniqueName: "kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9") pod "network-check-target-drd2l" (UID: "cf953d49-185e-4ff2-bda6-e341c9943943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:10.712481 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.712447    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs podName:552549b9-1739-4b41-b3e0-423296732969 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:11.712432339 +0000 UTC m=+5.598560459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs") pod "network-metrics-daemon-cs9qm" (UID: "552549b9-1739-4b41-b3e0-423296732969") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:10.712481 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.712277    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:10.712651 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:10.712512    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret podName:3f3ebc44-1e39-458b-90fc-94951e07f565 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:11.712495783 +0000 UTC m=+5.598623909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret") pod "global-pull-secret-syncer-znwcl" (UID: "3f3ebc44-1e39-458b-90fc-94951e07f565") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:11.129431 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:11.129323    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:53:10 +0000 UTC" deadline="2028-01-14 10:41:19.524880181 +0000 UTC"
Jul 22 02:58:11.129431 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:11.129365    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12991h43m8.395520122s"
Jul 22 02:58:11.286723 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:11.286627    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26bd034e_08ef_402e_84b5_92d8826a3e94.slice/crio-eb17ebdd5e92b900fc347c5c11b97e81196019e09c444027dcb31073130fd73f WatchSource:0}: Error finding container eb17ebdd5e92b900fc347c5c11b97e81196019e09c444027dcb31073130fd73f: Status 404 returned error can't find the container with id eb17ebdd5e92b900fc347c5c11b97e81196019e09c444027dcb31073130fd73f
Jul 22 02:58:11.288987 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:11.288963    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd7b1b8_a3f8_49cf_b665_1ee1e295d42e.slice/crio-a7299e612cdc470ccb3721a988b51090663106ca21401f312e6bbf32b7e085cd WatchSource:0}: Error finding container a7299e612cdc470ccb3721a988b51090663106ca21401f312e6bbf32b7e085cd: Status 404 returned error can't find the container with id a7299e612cdc470ccb3721a988b51090663106ca21401f312e6bbf32b7e085cd
Jul 22 02:58:11.293279 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:11.292738    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e116fe_677d_4d14_94dc_7cf43f32df95.slice/crio-9d7a00ce3e8cdfdac6f0b8e1efc2571474d48dec136a947e1b8af90291bbda4d WatchSource:0}: Error finding container 9d7a00ce3e8cdfdac6f0b8e1efc2571474d48dec136a947e1b8af90291bbda4d: Status 404 returned error can't find the container with id 9d7a00ce3e8cdfdac6f0b8e1efc2571474d48dec136a947e1b8af90291bbda4d
Jul 22 02:58:11.293517 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:11.293347    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8147f8f1_e491_4942_a0af_05ff5ce449c7.slice/crio-85b4ab05408dc9a007177ba6fbc35c3ceb6920429ccdb07a2a8dcf13e6889d18 WatchSource:0}: Error finding container 85b4ab05408dc9a007177ba6fbc35c3ceb6920429ccdb07a2a8dcf13e6889d18: Status 404 returned error can't find the container with id 85b4ab05408dc9a007177ba6fbc35c3ceb6920429ccdb07a2a8dcf13e6889d18
Jul 22 02:58:11.295113 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:11.295081    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c949b3_37d3_4884_a826_b18881136778.slice/crio-67ad5e92cb3cf311aad19a1338b33cd6bb905aeaac0f0cb0ee436e82509b39db WatchSource:0}: Error finding container 67ad5e92cb3cf311aad19a1338b33cd6bb905aeaac0f0cb0ee436e82509b39db: Status 404 returned error can't find the container with id 67ad5e92cb3cf311aad19a1338b33cd6bb905aeaac0f0cb0ee436e82509b39db
Jul 22 02:58:11.296841 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:11.296349    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf809ee84_b430_4412_a4e2_164df3f746d5.slice/crio-ef5f0a598e19b00edc3d06be25069479eda0acc8a3a3944359e64deb54fdcf2e WatchSource:0}: Error finding container ef5f0a598e19b00edc3d06be25069479eda0acc8a3a3944359e64deb54fdcf2e: Status 404 returned error can't find the container with id ef5f0a598e19b00edc3d06be25069479eda0acc8a3a3944359e64deb54fdcf2e
Jul 22 02:58:11.297959 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:11.297260    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65809c0_05e1_4e2c_bf51_967d1cc4bc4e.slice/crio-829df491a184fd19227f256382e97d5511be9d80ff61920fde6098bd59ab7c82 WatchSource:0}: Error finding container 829df491a184fd19227f256382e97d5511be9d80ff61920fde6098bd59ab7c82: Status 404 returned error can't find the container with id 829df491a184fd19227f256382e97d5511be9d80ff61920fde6098bd59ab7c82
Jul 22 02:58:11.719983 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:11.719889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crqv9\" (UniqueName: \"kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9\") pod \"network-check-target-drd2l\" (UID: \"cf953d49-185e-4ff2-bda6-e341c9943943\") " pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:11.719983 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:11.719947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:11.720231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:11.720025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:11.720231 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:11.720163    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:11.720231 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:11.720233    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs podName:552549b9-1739-4b41-b3e0-423296732969 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:13.720212157 +0000 UTC m=+7.606340286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs") pod "network-metrics-daemon-cs9qm" (UID: "552549b9-1739-4b41-b3e0-423296732969") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:11.720726 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:11.720596    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:11.720726 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:11.720661    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret podName:3f3ebc44-1e39-458b-90fc-94951e07f565 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:13.720645118 +0000 UTC m=+7.606773242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret") pod "global-pull-secret-syncer-znwcl" (UID: "3f3ebc44-1e39-458b-90fc-94951e07f565") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:11.720726 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:11.720674    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:58:11.720726 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:11.720694    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:58:11.720726 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:11.720708    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crqv9 for pod openshift-network-diagnostics/network-check-target-drd2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:11.721093 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:11.720746    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9 podName:cf953d49-185e-4ff2-bda6-e341c9943943 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:13.720734276 +0000 UTC m=+7.606862397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-crqv9" (UniqueName: "kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9") pod "network-check-target-drd2l" (UID: "cf953d49-185e-4ff2-bda6-e341c9943943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:12.129709 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.129581    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:53:10 +0000 UTC" deadline="2028-03-28 19:58:28.74017254 +0000 UTC"
Jul 22 02:58:12.129709 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.129657    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14777h0m16.610520581s"
Jul 22 02:58:12.181457 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.181426    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:12.181640 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:12.181589    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:12.182054 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.182033    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:12.182163 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:12.182141    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:12.182234 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.182219    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:12.182321 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:12.182303    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:12.196548 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.196511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lvztc" event={"ID":"311a7a15-e954-4ed4-8158-b7fdb0246cf2","Type":"ContainerStarted","Data":"4eb7bcf24612db3824302160135e67ceb5e725e49308709d5378feca36ae583c"}
Jul 22 02:58:12.213729 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.213690    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sgp8g" event={"ID":"da7fd337-2011-4001-9fa1-79a3c813aafd","Type":"ContainerStarted","Data":"19aa376a78989707e6ad3ca44bd310fe1ae095b00b303922a6748980b498ad81"}
Jul 22 02:58:12.217238 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.217203    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt" event={"ID":"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e","Type":"ContainerStarted","Data":"829df491a184fd19227f256382e97d5511be9d80ff61920fde6098bd59ab7c82"}
Jul 22 02:58:12.241737 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.241690    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lcz54" event={"ID":"8147f8f1-e491-4942-a0af-05ff5ce449c7","Type":"ContainerStarted","Data":"85b4ab05408dc9a007177ba6fbc35c3ceb6920429ccdb07a2a8dcf13e6889d18"}
Jul 22 02:58:12.279828 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.279784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t5hpj" event={"ID":"f809ee84-b430-4412-a4e2-164df3f746d5","Type":"ContainerStarted","Data":"ef5f0a598e19b00edc3d06be25069479eda0acc8a3a3944359e64deb54fdcf2e"}
Jul 22 02:58:12.294540 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.294498    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww96c" event={"ID":"55c949b3-37d3-4884-a826-b18881136778","Type":"ContainerStarted","Data":"67ad5e92cb3cf311aad19a1338b33cd6bb905aeaac0f0cb0ee436e82509b39db"}
Jul 22 02:58:12.322056 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.322010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd" event={"ID":"88e116fe-677d-4d14-94dc-7cf43f32df95","Type":"ContainerStarted","Data":"9d7a00ce3e8cdfdac6f0b8e1efc2571474d48dec136a947e1b8af90291bbda4d"}
Jul 22 02:58:12.331786 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.331661    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7fvpd" event={"ID":"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e","Type":"ContainerStarted","Data":"a7299e612cdc470ccb3721a988b51090663106ca21401f312e6bbf32b7e085cd"}
Jul 22 02:58:12.347927 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.346245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-br9cp" event={"ID":"26bd034e-08ef-402e-84b5-92d8826a3e94","Type":"ContainerStarted","Data":"eb17ebdd5e92b900fc347c5c11b97e81196019e09c444027dcb31073130fd73f"}
Jul 22 02:58:12.367246 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.367200    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal" event={"ID":"a0dcf5c9a6ed001643e8598db403124c","Type":"ContainerStarted","Data":"124e57d2d4129ca85bbcb62eb14a0e6301d90d8b80ded851bb641c061505ce6e"}
Jul 22 02:58:12.384789 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.384427    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-214.ec2.internal" podStartSLOduration=2.38440304 podStartE2EDuration="2.38440304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:12.383702758 +0000 UTC m=+6.269830903" watchObservedRunningTime="2026-07-22 02:58:12.38440304 +0000 UTC m=+6.270531185"
Jul 22 02:58:12.388496 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.388345    2576 generic.go:356] "Generic (PLEG): container finished" podID="35090b9d346aac976095a55200f0a993" containerID="bb4ee7abffe0659f9e578f028edfda59fb707b9c1d897d92b50d722c25c2e3a4" exitCode=0
Jul 22 02:58:12.388496 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:12.388390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal" event={"ID":"35090b9d346aac976095a55200f0a993","Type":"ContainerDied","Data":"bb4ee7abffe0659f9e578f028edfda59fb707b9c1d897d92b50d722c25c2e3a4"}
Jul 22 02:58:13.421579 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:13.421493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal" event={"ID":"35090b9d346aac976095a55200f0a993","Type":"ContainerStarted","Data":"50eecdfaaf64b5416d17654a449d33fb271d47db396f2a86c91024ebd7cd1b0d"}
Jul 22 02:58:13.738416 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:13.738315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:13.738416 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:13.738391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crqv9\" (UniqueName: \"kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9\") pod \"network-check-target-drd2l\" (UID: \"cf953d49-185e-4ff2-bda6-e341c9943943\") " pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:13.738710 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:13.738426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:13.738710 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:13.738513    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:13.738710 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:13.738588    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:13.738710 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:13.738596    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs podName:552549b9-1739-4b41-b3e0-423296732969 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:17.738574658 +0000 UTC m=+11.624702794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs") pod "network-metrics-daemon-cs9qm" (UID: "552549b9-1739-4b41-b3e0-423296732969") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:13.738710 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:13.738653    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret podName:3f3ebc44-1e39-458b-90fc-94951e07f565 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:17.738637187 +0000 UTC m=+11.624765315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret") pod "global-pull-secret-syncer-znwcl" (UID: "3f3ebc44-1e39-458b-90fc-94951e07f565") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:13.738985 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:13.738742    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:58:13.738985 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:13.738755    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:58:13.738985 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:13.738768    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crqv9 for pod openshift-network-diagnostics/network-check-target-drd2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:13.738985 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:13.738806    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9 podName:cf953d49-185e-4ff2-bda6-e341c9943943 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:17.738794376 +0000 UTC m=+11.624922499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-crqv9" (UniqueName: "kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9") pod "network-check-target-drd2l" (UID: "cf953d49-185e-4ff2-bda6-e341c9943943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:14.180062 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:14.179966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:14.180239 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:14.180108    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:14.180239 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:14.180199    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:14.180350 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:14.180288    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:14.180350 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:14.180341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:14.180454 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:14.180415    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:16.178021 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:16.177788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:16.178526 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:16.178164    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:16.178526 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:16.177910    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:16.178526 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:16.178313    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:16.178526 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:16.177788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:16.178526 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:16.178380    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:17.775547 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:17.775510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crqv9\" (UniqueName: \"kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9\") pod \"network-check-target-drd2l\" (UID: \"cf953d49-185e-4ff2-bda6-e341c9943943\") " pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:17.775547 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:17.775563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:17.776087 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:17.775628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:17.776087 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:17.775764    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:17.776087 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:17.775835    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs podName:552549b9-1739-4b41-b3e0-423296732969 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:25.775813421 +0000 UTC m=+19.661941559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs") pod "network-metrics-daemon-cs9qm" (UID: "552549b9-1739-4b41-b3e0-423296732969") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:17.776247 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:17.776236    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:58:17.776311 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:17.776251    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:58:17.776311 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:17.776261    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crqv9 for pod openshift-network-diagnostics/network-check-target-drd2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:17.776311 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:17.776297    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9 podName:cf953d49-185e-4ff2-bda6-e341c9943943 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:25.776286166 +0000 UTC m=+19.662414285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-crqv9" (UniqueName: "kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9") pod "network-check-target-drd2l" (UID: "cf953d49-185e-4ff2-bda6-e341c9943943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:17.776496 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:17.776340    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:17.776496 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:17.776363    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret podName:3f3ebc44-1e39-458b-90fc-94951e07f565 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:25.776354064 +0000 UTC m=+19.662482184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret") pod "global-pull-secret-syncer-znwcl" (UID: "3f3ebc44-1e39-458b-90fc-94951e07f565") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:18.179319 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:18.179203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:18.180052 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:18.179229    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:18.180052 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:18.179643    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:18.180052 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:18.179741    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:18.180052 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:18.179272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:18.180052 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:18.179838    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:20.179031 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:20.178507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:20.179031 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:20.178516    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:20.179031 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:20.178640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:20.179031 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:20.178637    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:20.179031 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:20.178769    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:20.179031 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:20.178865    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:22.177544 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:22.177512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:22.177976 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:22.177655    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:22.177976 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:22.177512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:22.177976 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:22.177747    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:22.177976 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:22.177767    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:22.177976 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:22.177842    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:24.177782 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:24.177748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:24.178190 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:24.177789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:24.178190 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:24.177750    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:24.178190 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:24.177875    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:24.178190 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:24.177968    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:24.178190 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:24.178069    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:25.835593 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:25.835548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crqv9\" (UniqueName: \"kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9\") pod \"network-check-target-drd2l\" (UID: \"cf953d49-185e-4ff2-bda6-e341c9943943\") " pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:25.835593 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:25.835592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:25.836187 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:25.835694    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:25.836187 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:25.835716    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:58:25.836187 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:25.835745    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:58:25.836187 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:25.835760    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crqv9 for pod openshift-network-diagnostics/network-check-target-drd2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:25.836187 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:25.835748    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret podName:3f3ebc44-1e39-458b-90fc-94951e07f565 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:41.835735309 +0000 UTC m=+35.721863427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret") pod "global-pull-secret-syncer-znwcl" (UID: "3f3ebc44-1e39-458b-90fc-94951e07f565") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:25.836187 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:25.835825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:25.836187 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:25.835861    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9 podName:cf953d49-185e-4ff2-bda6-e341c9943943 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:41.835837284 +0000 UTC m=+35.721965413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-crqv9" (UniqueName: "kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9") pod "network-check-target-drd2l" (UID: "cf953d49-185e-4ff2-bda6-e341c9943943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:25.836187 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:25.835919    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:25.836187 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:25.835989    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs podName:552549b9-1739-4b41-b3e0-423296732969 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:41.835969602 +0000 UTC m=+35.722097737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs") pod "network-metrics-daemon-cs9qm" (UID: "552549b9-1739-4b41-b3e0-423296732969") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:26.177569 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:26.177482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:26.177738 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:26.177482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:26.177738 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:26.177622    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:26.177738 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:26.177482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:26.177738 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:26.177688    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:26.178003 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:26.177744    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:28.180515 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:28.180486    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:28.180515 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:28.180501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:28.181032 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:28.180521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:28.181032 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:28.180608    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:28.181032 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:28.180735    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:28.181032 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:28.180817    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:30.178469 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:30.178433    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:30.179052 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:30.178433    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:30.179052 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:30.178581    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:30.179052 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:30.178433    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:30.179052 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:30.178644    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:30.179052 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:30.178703    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:31.470138 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.469963    2576 generic.go:356] "Generic (PLEG): container finished" podID="55c949b3-37d3-4884-a826-b18881136778" containerID="bbe48276a7323ef92cacf6cb67933c76a4859a8f05d6305a3294b9c9b9a68cfa" exitCode=0
Jul 22 02:58:31.470907 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.470043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww96c" event={"ID":"55c949b3-37d3-4884-a826-b18881136778","Type":"ContainerDied","Data":"bbe48276a7323ef92cacf6cb67933c76a4859a8f05d6305a3294b9c9b9a68cfa"}
Jul 22 02:58:31.471727 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.471701    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd" event={"ID":"88e116fe-677d-4d14-94dc-7cf43f32df95","Type":"ContainerStarted","Data":"af8170e164cdc1972332240844e64969bab4b0709710bd75d54aa1edda712610"}
Jul 22 02:58:31.473202 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.473148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7fvpd" event={"ID":"fbd7b1b8-a3f8-49cf-b665-1ee1e295d42e","Type":"ContainerStarted","Data":"06491e0bcd0eb736d505c23918e2a81a93380f81719e8ee6a67786e739c94475"}
Jul 22 02:58:31.474722 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.474702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-br9cp" event={"ID":"26bd034e-08ef-402e-84b5-92d8826a3e94","Type":"ContainerStarted","Data":"35121b280f3bccb060509fb4f0547cd6dc656de162345c522ff942a280d39256"}
Jul 22 02:58:31.476066 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.476046    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lvztc" event={"ID":"311a7a15-e954-4ed4-8158-b7fdb0246cf2","Type":"ContainerStarted","Data":"23de3d0497b0b81da977dd745c53385f367cdc40e16ee07ea82b8363e967266f"}
Jul 22 02:58:31.477446 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.477427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sgp8g" event={"ID":"da7fd337-2011-4001-9fa1-79a3c813aafd","Type":"ContainerStarted","Data":"88f7227efc4b48118529db4cdd53f9073fc59e3e673ffe23554ed1f94a0d657f"}
Jul 22 02:58:31.480229 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.480209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt" event={"ID":"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e","Type":"ContainerStarted","Data":"f2fd32e3e43471b3382bf1c90c59e0ed20140110083fbb998d1746b22ec129b5"}
Jul 22 02:58:31.480319 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.480265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt" event={"ID":"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e","Type":"ContainerStarted","Data":"5410d1133ab448d2336067fd7e66a8f4fc6454d2b3efaca1f0bb9bcd9f6d7269"}
Jul 22 02:58:31.480319 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.480308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt" event={"ID":"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e","Type":"ContainerStarted","Data":"6b0ade8083c692a87c06ef45fa59d59e20f0d8c975747b138753f9d2b6cf47ed"}
Jul 22 02:58:31.480473 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.480342    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt" event={"ID":"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e","Type":"ContainerStarted","Data":"54593a189410abf0b005ef2a2687a9e1b0f110dd6c399e5e24e59b615e5db663"}
Jul 22 02:58:31.480473 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.480371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt" event={"ID":"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e","Type":"ContainerStarted","Data":"c8deabf69c6aca6ed95aca3aeef58f30c8e9ea7852329d3e5eeede6673e91b1d"}
Jul 22 02:58:31.480473 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.480423    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt" event={"ID":"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e","Type":"ContainerStarted","Data":"bf53532810f9971a87c34311b006609ca683e42f16739197b44e2e02e4bc94bb"}
Jul 22 02:58:31.481501 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.481485    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t5hpj" event={"ID":"f809ee84-b430-4412-a4e2-164df3f746d5","Type":"ContainerStarted","Data":"e98a01612f7d64c48510b96ff7613bf48f145f5e11a203bfbad22a0d1e2fb6b3"}
Jul 22 02:58:31.491645 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.491607    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-214.ec2.internal" podStartSLOduration=21.491594732 podStartE2EDuration="21.491594732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:13.437534681 +0000 UTC m=+7.323662823" watchObservedRunningTime="2026-07-22 02:58:31.491594732 +0000 UTC m=+25.377722872"
Jul 22 02:58:31.507457 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.507389    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-br9cp" podStartSLOduration=3.337423705 podStartE2EDuration="22.507371249s" totalImagesPullingTime="19.169947544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:31.507155169 +0000 UTC m=+25.393283309" watchObservedRunningTime="2026-07-22 02:58:31.507371249 +0000 UTC m=+25.393499389"
Jul 22 02:58:31.521991 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.521941    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t5hpj" podStartSLOduration=3.416916737 podStartE2EDuration="22.521927288s" totalImagesPullingTime="19.105010551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:31.521474676 +0000 UTC m=+25.407602816" watchObservedRunningTime="2026-07-22 02:58:31.521927288 +0000 UTC m=+25.408055427"
Jul 22 02:58:31.539716 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.539653    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sgp8g" podStartSLOduration=3.448598252 podStartE2EDuration="22.539632315s" totalImagesPullingTime="19.091034063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:31.539334729 +0000 UTC m=+25.425462869" watchObservedRunningTime="2026-07-22 02:58:31.539632315 +0000 UTC m=+25.425760455"
Jul 22 02:58:31.556721 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.556669    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7fvpd" podStartSLOduration=3.402305738 podStartE2EDuration="22.556654595s" totalImagesPullingTime="19.154348857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:31.556367677 +0000 UTC m=+25.442495818" watchObservedRunningTime="2026-07-22 02:58:31.556654595 +0000 UTC m=+25.442782734"
Jul 22 02:58:31.571580 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.571528    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lvztc" podStartSLOduration=3.469615835 podStartE2EDuration="22.571512939s" totalImagesPullingTime="19.101897104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:31.571139935 +0000 UTC m=+25.457268076" watchObservedRunningTime="2026-07-22 02:58:31.571512939 +0000 UTC m=+25.457641079"
Jul 22 02:58:31.850715 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:31.850493    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 02:58:32.163467 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:32.163229    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T02:58:31.850706494Z","UUID":"4947d75f-3cbc-4be7-af66-80bcf379d218","Handler":null,"Name":"","Endpoint":""}
Jul 22 02:58:32.164988 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:32.164969    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 02:58:32.165097 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:32.165005    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 02:58:32.178032 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:32.178005    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:32.178192 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:32.178005    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:32.178192 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:32.178145    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:32.178192 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:32.178005    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:32.178340 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:32.178192    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:32.178340 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:32.178303    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:32.487630 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:32.487539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd" event={"ID":"88e116fe-677d-4d14-94dc-7cf43f32df95","Type":"ContainerStarted","Data":"274cded1b60e8adf6f629b1c59d16ad21862c9c256a37804215fbb2d997bd419"}
Jul 22 02:58:32.490384 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:32.490235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lcz54" event={"ID":"8147f8f1-e491-4942-a0af-05ff5ce449c7","Type":"ContainerStarted","Data":"eb74a2674b670b7763c7ade5e519861ded1bcde36d4cf2c2a2942aab498a4f3d"}
Jul 22 02:58:32.506152 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:32.506096    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lcz54" podStartSLOduration=4.397323361 podStartE2EDuration="23.506079518s" totalImagesPullingTime="19.108756157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:32.505716594 +0000 UTC m=+26.391844735" watchObservedRunningTime="2026-07-22 02:58:32.506079518 +0000 UTC m=+26.392207670"
Jul 22 02:58:33.495278 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:33.495189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt" event={"ID":"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e","Type":"ContainerStarted","Data":"f57e8ae1640c82d02dfbf26875412dbc87a73b859aee6536a4b396eeb9f18776"}
Jul 22 02:58:33.497423 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:33.497309    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd" event={"ID":"88e116fe-677d-4d14-94dc-7cf43f32df95","Type":"ContainerStarted","Data":"82b28d97d4ba3ba6071f7b711710ba3339201c9cfa3dd67ac1398331453fa0fc"}
Jul 22 02:58:33.514830 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:33.514786    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2vkd" podStartSLOduration=2.99693521 podStartE2EDuration="24.514770298s" totalImagesPullingTime="21.517835088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:33.514674665 +0000 UTC m=+27.400802809" watchObservedRunningTime="2026-07-22 02:58:33.514770298 +0000 UTC m=+27.400898462"
Jul 22 02:58:34.177862 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:34.177832    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:34.178079 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:34.177832    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:34.178079 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:34.177955    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:34.178079 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:34.178051    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:34.178079 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:34.177832    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:34.178319 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:34.178133    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:35.823887 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:35.823738    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:35.824320 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:35.824300    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:36.177568 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.177532    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:36.177568 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.177563    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:36.177809 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.177532    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:36.177809 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:36.177642    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:36.177809 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:36.177711    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:36.177809 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:36.177781    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:36.506111 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.506030    2576 generic.go:356] "Generic (PLEG): container finished" podID="55c949b3-37d3-4884-a826-b18881136778" containerID="d6cab58a2ed870778e32aff0a9bcbee303751d9e0bf0b9211fb74077d9147e07" exitCode=0
Jul 22 02:58:36.506252 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.506121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww96c" event={"ID":"55c949b3-37d3-4884-a826-b18881136778","Type":"ContainerDied","Data":"d6cab58a2ed870778e32aff0a9bcbee303751d9e0bf0b9211fb74077d9147e07"}
Jul 22 02:58:36.510043 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.510015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt" event={"ID":"d65809c0-05e1-4e2c-bf51-967d1cc4bc4e","Type":"ContainerStarted","Data":"a6a8163c0e2fe63847942dfaeced77ce9f9c1f28a5339f497a0c4dc5894ea245"}
Jul 22 02:58:36.510230 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.510199    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:36.510285 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.510234    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:36.510285 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.510281    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:36.511059 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.511041    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sgp8g"
Jul 22 02:58:36.525329 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.525305    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:36.578877 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:36.578819    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt" podStartSLOduration=8.402713657 podStartE2EDuration="27.578804017s" totalImagesPullingTime="19.17609036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:36.578658144 +0000 UTC m=+30.464786284" watchObservedRunningTime="2026-07-22 02:58:36.578804017 +0000 UTC m=+30.464932157"
Jul 22 02:58:37.513232 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:37.513200    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:37.528375 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:37.528351    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:58:37.864075 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:37.863802    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-znwcl"]
Jul 22 02:58:37.864277 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:37.864193    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:37.864338 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:37.864311    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:37.867046 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:37.867025    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-drd2l"]
Jul 22 02:58:37.867152 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:37.867107    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:37.867194 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:37.867170    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:37.879746 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:37.879716    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cs9qm"]
Jul 22 02:58:37.879892 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:37.879835    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:37.879992 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:37.879945    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:38.517489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:38.517455    2576 generic.go:356] "Generic (PLEG): container finished" podID="55c949b3-37d3-4884-a826-b18881136778" containerID="f3c8d80de6f14186a44ab1718c64d25dcdf821c224fa30e921ce804b3ec600ef" exitCode=0
Jul 22 02:58:38.517867 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:38.517545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww96c" event={"ID":"55c949b3-37d3-4884-a826-b18881136778","Type":"ContainerDied","Data":"f3c8d80de6f14186a44ab1718c64d25dcdf821c224fa30e921ce804b3ec600ef"}
Jul 22 02:58:39.177899 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:39.177868    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:39.178069 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:39.177969    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:40.177983 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:40.177949    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:40.178378 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:40.178076    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:40.178378 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:40.178128    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:40.178378 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:40.178213    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:40.524461 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:40.524355    2576 generic.go:356] "Generic (PLEG): container finished" podID="55c949b3-37d3-4884-a826-b18881136778" containerID="231cb596b8a4f75e0805c851accb2f090eb1504a93c6969a5cf525fcd453f7ee" exitCode=0
Jul 22 02:58:40.524461 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:40.524418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww96c" event={"ID":"55c949b3-37d3-4884-a826-b18881136778","Type":"ContainerDied","Data":"231cb596b8a4f75e0805c851accb2f090eb1504a93c6969a5cf525fcd453f7ee"}
Jul 22 02:58:41.178162 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:41.178114    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:41.178587 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:41.178243    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:41.864751 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:41.864719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crqv9\" (UniqueName: \"kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9\") pod \"network-check-target-drd2l\" (UID: \"cf953d49-185e-4ff2-bda6-e341c9943943\") " pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:41.864751 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:41.864755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:41.865002 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:41.864808    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:41.865002 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:41.864893    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:41.865002 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:41.864910    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:41.865002 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:41.864951    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs podName:552549b9-1739-4b41-b3e0-423296732969 nodeName:}" failed. No retries permitted until 2026-07-22 02:59:13.864935357 +0000 UTC m=+67.751063477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs") pod "network-metrics-daemon-cs9qm" (UID: "552549b9-1739-4b41-b3e0-423296732969") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:58:41.865002 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:41.864896    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:58:41.865002 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:41.864978    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret podName:3f3ebc44-1e39-458b-90fc-94951e07f565 nodeName:}" failed. No retries permitted until 2026-07-22 02:59:13.864959077 +0000 UTC m=+67.751087204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret") pod "global-pull-secret-syncer-znwcl" (UID: "3f3ebc44-1e39-458b-90fc-94951e07f565") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:58:41.865002 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:41.864989    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:58:41.865002 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:41.865004    2576 projected.go:196] Error preparing data for projected volume kube-api-access-crqv9 for pod openshift-network-diagnostics/network-check-target-drd2l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:41.865293 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:41.865049    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9 podName:cf953d49-185e-4ff2-bda6-e341c9943943 nodeName:}" failed. No retries permitted until 2026-07-22 02:59:13.865038322 +0000 UTC m=+67.751166457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-crqv9" (UniqueName: "kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9") pod "network-check-target-drd2l" (UID: "cf953d49-185e-4ff2-bda6-e341c9943943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:58:42.177651 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:42.177560    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:42.177651 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:42.177591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:42.177868 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:42.177727    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:42.177868 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:42.177841    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:43.178037 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:43.177860    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:43.178559 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:43.178141    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znwcl" podUID="3f3ebc44-1e39-458b-90fc-94951e07f565"
Jul 22 02:58:44.177621 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.177540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:44.177788 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.177554    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:44.177788 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:44.177688    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-drd2l" podUID="cf953d49-185e-4ff2-bda6-e341c9943943"
Jul 22 02:58:44.177788 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:44.177765    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs9qm" podUID="552549b9-1739-4b41-b3e0-423296732969"
Jul 22 02:58:44.441087 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.441011    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-214.ec2.internal" event="NodeReady"
Jul 22 02:58:44.441489 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.441153    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 02:58:44.483266 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.483230    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4x7n6"]
Jul 22 02:58:44.486146 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.486105    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t25b7"]
Jul 22 02:58:44.486315 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.486245    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.487710 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.487690    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t25b7"
Jul 22 02:58:44.488712 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.488686    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 02:58:44.488856 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.488691    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sn76t\""
Jul 22 02:58:44.488944 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.488855    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 02:58:44.490009 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.489984    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 02:58:44.490112 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.490032    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 02:58:44.490185 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.490141    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h84cw\""
Jul 22 02:58:44.490315 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.490302    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 02:58:44.496628 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.496347    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t25b7"]
Jul 22 02:58:44.501026 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.501002    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4x7n6"]
Jul 22 02:58:44.519469 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.519446    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"]
Jul 22 02:58:44.521244 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.521225    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.524519 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.524500    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:58:44.524748 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.524730    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 22 02:58:44.524872 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.524737    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lmz84\""
Jul 22 02:58:44.528385 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.525691    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 22 02:58:44.528385 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.525780    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 22 02:58:44.532090 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.532052    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68489bc688-4q4jw"]
Jul 22 02:58:44.533751 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.533731    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vs88k"]
Jul 22 02:58:44.533923 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.533902    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.535390 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.535351    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"]
Jul 22 02:58:44.535513 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.535467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.536481 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.536265    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 22 02:58:44.536481 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.536329    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vsfrq\""
Jul 22 02:58:44.536669 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.536632    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 22 02:58:44.536669 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.536651    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 22 02:58:44.536853 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.536653    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 22 02:58:44.536853 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.536672    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 02:58:44.536853 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.536694    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 02:58:44.537717 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.537699    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 22 02:58:44.537818 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.537733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t8dlb\""
Jul 22 02:58:44.538573 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.538554    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 02:58:44.538750 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.538735    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 22 02:58:44.538973 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.538957    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 02:58:44.545715 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.545697    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 22 02:58:44.550658 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.550633    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vs88k"]
Jul 22 02:58:44.552123 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.552070    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68489bc688-4q4jw"]
Jul 22 02:58:44.584666 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.584635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-config-volume\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.584666 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.584663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03bc3bf8-3b85-4914-85f2-c6d99f758092-cert\") pod \"ingress-canary-t25b7\" (UID: \"03bc3bf8-3b85-4914-85f2-c6d99f758092\") " pod="openshift-ingress-canary/ingress-canary-t25b7"
Jul 22 02:58:44.584888 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.584684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-tmp-dir\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.584888 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.584735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk5gg\" (UniqueName: \"kubernetes.io/projected/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-kube-api-access-pk5gg\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.584888 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.584781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.584888 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.584806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7wsg\" (UniqueName: \"kubernetes.io/projected/03bc3bf8-3b85-4914-85f2-c6d99f758092-kube-api-access-q7wsg\") pod \"ingress-canary-t25b7\" (UID: \"03bc3bf8-3b85-4914-85f2-c6d99f758092\") " pod="openshift-ingress-canary/ingress-canary-t25b7"
Jul 22 02:58:44.626768 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.626733    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"]
Jul 22 02:58:44.628636 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.628616    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:58:44.631596 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.631571    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mljk8\""
Jul 22 02:58:44.631770 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.631751    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 22 02:58:44.631851 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.631754    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:58:44.632023 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.632004    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 22 02:58:44.642079 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.642053    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"]
Jul 22 02:58:44.686188 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-service-ca-bundle\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.686383 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6n88\" (UniqueName: \"kubernetes.io/projected/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-kube-api-access-v6n88\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.686383 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.686383 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2d40318-cee0-4d9f-85ec-d2d91cdaeb26-config\") pod \"service-ca-operator-5bcbc94c78-qwcmj\" (UID: \"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.686383 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.686383 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.686632 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7wsg\" (UniqueName: \"kubernetes.io/projected/03bc3bf8-3b85-4914-85f2-c6d99f758092-kube-api-access-q7wsg\") pod \"ingress-canary-t25b7\" (UID: \"03bc3bf8-3b85-4914-85f2-c6d99f758092\") " pod="openshift-ingress-canary/ingress-canary-t25b7"
Jul 22 02:58:44.686632 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686440    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.686632 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:44.686453    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:58:44.686632 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2d40318-cee0-4d9f-85ec-d2d91cdaeb26-serving-cert\") pod \"service-ca-operator-5bcbc94c78-qwcmj\" (UID: \"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.686632 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:44.686524    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls podName:4afe1cd6-32e5-4436-8e05-a9ae78fcd219 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:45.18649701 +0000 UTC m=+39.072625128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls") pod "dns-default-4x7n6" (UID: "4afe1cd6-32e5-4436-8e05-a9ae78fcd219") : secret "dns-default-metrics-tls" not found
Jul 22 02:58:44.686632 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-config-volume\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.686632 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03bc3bf8-3b85-4914-85f2-c6d99f758092-cert\") pod \"ingress-canary-t25b7\" (UID: \"03bc3bf8-3b85-4914-85f2-c6d99f758092\") " pod="openshift-ingress-canary/ingress-canary-t25b7"
Jul 22 02:58:44.686927 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-tmp\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.686927 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-default-certificate\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.686927 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-tmp-dir\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.686927 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-snapshots\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.686927 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgsrj\" (UniqueName: \"kubernetes.io/projected/23505e5c-1564-4aca-8eed-0058bab33390-kube-api-access-pgsrj\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.686927 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-stats-auth\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.686927 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22c52\" (UniqueName: \"kubernetes.io/projected/d2d40318-cee0-4d9f-85ec-d2d91cdaeb26-kube-api-access-22c52\") pod \"service-ca-operator-5bcbc94c78-qwcmj\" (UID: \"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.687174 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk5gg\" (UniqueName: \"kubernetes.io/projected/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-kube-api-access-pk5gg\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.687174 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.686968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-serving-cert\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.687271 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.687252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-config-volume\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.687319 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.687252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-tmp-dir\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.691359 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.691306    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03bc3bf8-3b85-4914-85f2-c6d99f758092-cert\") pod \"ingress-canary-t25b7\" (UID: \"03bc3bf8-3b85-4914-85f2-c6d99f758092\") " pod="openshift-ingress-canary/ingress-canary-t25b7"
Jul 22 02:58:44.701316 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.701287    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7wsg\" (UniqueName: \"kubernetes.io/projected/03bc3bf8-3b85-4914-85f2-c6d99f758092-kube-api-access-q7wsg\") pod \"ingress-canary-t25b7\" (UID: \"03bc3bf8-3b85-4914-85f2-c6d99f758092\") " pod="openshift-ingress-canary/ingress-canary-t25b7"
Jul 22 02:58:44.701465 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.701294    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk5gg\" (UniqueName: \"kubernetes.io/projected/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-kube-api-access-pk5gg\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:44.787592 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6n88\" (UniqueName: \"kubernetes.io/projected/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-kube-api-access-v6n88\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.787592 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.787833 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2d40318-cee0-4d9f-85ec-d2d91cdaeb26-config\") pod \"service-ca-operator-5bcbc94c78-qwcmj\" (UID: \"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.787833 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.787833 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787682    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.787833 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2d40318-cee0-4d9f-85ec-d2d91cdaeb26-serving-cert\") pod \"service-ca-operator-5bcbc94c78-qwcmj\" (UID: \"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.787833 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:44.787726    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:58:44.787833 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k24wb\" (UniqueName: \"kubernetes.io/projected/4666b731-80a9-49ee-8de6-ac67756efd2a-kube-api-access-k24wb\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:58:44.787833 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:44.787803    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:45.287780851 +0000 UTC m=+39.173909007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : secret "router-metrics-certs-default" not found
Jul 22 02:58:44.788176 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-tmp\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.788176 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-default-certificate\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.788176 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-snapshots\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.788176 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.787980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:58:44.788176 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.788046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgsrj\" (UniqueName: \"kubernetes.io/projected/23505e5c-1564-4aca-8eed-0058bab33390-kube-api-access-pgsrj\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.788176 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.788080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-stats-auth\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.788176 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.788104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22c52\" (UniqueName: \"kubernetes.io/projected/d2d40318-cee0-4d9f-85ec-d2d91cdaeb26-kube-api-access-22c52\") pod \"service-ca-operator-5bcbc94c78-qwcmj\" (UID: \"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.788176 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.788136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-serving-cert\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.788585 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:44.788221    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:45.288199948 +0000 UTC m=+39.174328090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : configmap references non-existent config key: service-ca.crt
Jul 22 02:58:44.788585 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.788372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2d40318-cee0-4d9f-85ec-d2d91cdaeb26-config\") pod \"service-ca-operator-5bcbc94c78-qwcmj\" (UID: \"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.788585 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.788463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-service-ca-bundle\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.788740 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.788657    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-tmp\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.788790 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.788776    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.789269 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.789202    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-snapshots\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.789269 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.789254    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-service-ca-bundle\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.790871 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.790847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2d40318-cee0-4d9f-85ec-d2d91cdaeb26-serving-cert\") pod \"service-ca-operator-5bcbc94c78-qwcmj\" (UID: \"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.791013 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.790994    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-default-certificate\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.791077 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.791033    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-stats-auth\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.791569 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.791550    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-serving-cert\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.800245 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.800216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22c52\" (UniqueName: \"kubernetes.io/projected/d2d40318-cee0-4d9f-85ec-d2d91cdaeb26-kube-api-access-22c52\") pod \"service-ca-operator-5bcbc94c78-qwcmj\" (UID: \"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.800651 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.800630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6n88\" (UniqueName: \"kubernetes.io/projected/67cb0d95-a82d-471e-9fa4-8ccef9a610e3-kube-api-access-v6n88\") pod \"insights-operator-555d9d7885-vs88k\" (UID: \"67cb0d95-a82d-471e-9fa4-8ccef9a610e3\") " pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.800862 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.800842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgsrj\" (UniqueName: \"kubernetes.io/projected/23505e5c-1564-4aca-8eed-0058bab33390-kube-api-access-pgsrj\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:44.807290 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.807270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t25b7"
Jul 22 02:58:44.832811 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.832780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"
Jul 22 02:58:44.854740 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.854708    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-vs88k"
Jul 22 02:58:44.889358 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.888907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:58:44.889358 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.889073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k24wb\" (UniqueName: \"kubernetes.io/projected/4666b731-80a9-49ee-8de6-ac67756efd2a-kube-api-access-k24wb\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:58:44.889358 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:44.889198    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:58:44.889358 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:44.889259    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls podName:4666b731-80a9-49ee-8de6-ac67756efd2a nodeName:}" failed. No retries permitted until 2026-07-22 02:58:45.389244051 +0000 UTC m=+39.275372172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-f8dwh" (UID: "4666b731-80a9-49ee-8de6-ac67756efd2a") : secret "samples-operator-tls" not found
Jul 22 02:58:44.898841 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:44.898811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k24wb\" (UniqueName: \"kubernetes.io/projected/4666b731-80a9-49ee-8de6-ac67756efd2a-kube-api-access-k24wb\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:58:45.023643 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.023600    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vs88k"]
Jul 22 02:58:45.028424 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.027252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t25b7"]
Jul 22 02:58:45.030016 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.029807    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj"]
Jul 22 02:58:45.035009 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:58:45.034987    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d40318_cee0_4d9f_85ec_d2d91cdaeb26.slice/crio-a619de6da64ad6a190480b7fa37fc9ec632c10323add3106c0be71c45ab2c7da WatchSource:0}: Error finding container a619de6da64ad6a190480b7fa37fc9ec632c10323add3106c0be71c45ab2c7da: Status 404 returned error can't find the container with id a619de6da64ad6a190480b7fa37fc9ec632c10323add3106c0be71c45ab2c7da
Jul 22 02:58:45.178024 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.177998    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:58:45.180735 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.180710    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 02:58:45.192207 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.192184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:45.192329 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:45.192315    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:58:45.192407 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:45.192384    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls podName:4afe1cd6-32e5-4436-8e05-a9ae78fcd219 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:46.192368605 +0000 UTC m=+40.078496763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls") pod "dns-default-4x7n6" (UID: "4afe1cd6-32e5-4436-8e05-a9ae78fcd219") : secret "dns-default-metrics-tls" not found
Jul 22 02:58:45.293683 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.293556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:45.293683 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.293602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:45.293891 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:45.293728    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:58:45.293891 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:45.293754    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:46.293740808 +0000 UTC m=+40.179868929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : configmap references non-existent config key: service-ca.crt
Jul 22 02:58:45.293891 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:45.293793    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:46.293774722 +0000 UTC m=+40.179902846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : secret "router-metrics-certs-default" not found
Jul 22 02:58:45.394421 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.394368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:58:45.394573 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:45.394527    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:58:45.394631 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:45.394590    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls podName:4666b731-80a9-49ee-8de6-ac67756efd2a nodeName:}" failed. No retries permitted until 2026-07-22 02:58:46.394573531 +0000 UTC m=+40.280701649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-f8dwh" (UID: "4666b731-80a9-49ee-8de6-ac67756efd2a") : secret "samples-operator-tls" not found
Jul 22 02:58:45.540201 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.540162    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t25b7" event={"ID":"03bc3bf8-3b85-4914-85f2-c6d99f758092","Type":"ContainerStarted","Data":"349006c96c466005da8cc9b92ef6964272e0d00bff6b37d4d0fe9a469fcb60fd"}
Jul 22 02:58:45.541343 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.541319    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj" event={"ID":"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26","Type":"ContainerStarted","Data":"a619de6da64ad6a190480b7fa37fc9ec632c10323add3106c0be71c45ab2c7da"}
Jul 22 02:58:45.542412 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.542378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vs88k" event={"ID":"67cb0d95-a82d-471e-9fa4-8ccef9a610e3","Type":"ContainerStarted","Data":"399d9303119af3576d1986873eccddf9f67fb00b5a37281089efaceaf807d5c9"}
Jul 22 02:58:45.545067 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.544998    2576 generic.go:356] "Generic (PLEG): container finished" podID="55c949b3-37d3-4884-a826-b18881136778" containerID="abb680539fc740fce263dcb6b67a50d06755306d4592b55a0385372c6ebd3b64" exitCode=0
Jul 22 02:58:45.545067 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:45.545035    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww96c" event={"ID":"55c949b3-37d3-4884-a826-b18881136778","Type":"ContainerDied","Data":"abb680539fc740fce263dcb6b67a50d06755306d4592b55a0385372c6ebd3b64"}
Jul 22 02:58:46.178181 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.178120    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:58:46.178356 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.178134    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:58:46.183277 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.182657    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sqq4d\""
Jul 22 02:58:46.183277 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.182978    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nztgp\""
Jul 22 02:58:46.183277 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.182994    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 02:58:46.183277 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.183176    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 02:58:46.183277 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.183203    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 02:58:46.202338 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.202312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:46.202570 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:46.202547    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:58:46.202638 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:46.202615    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls podName:4afe1cd6-32e5-4436-8e05-a9ae78fcd219 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:48.20259674 +0000 UTC m=+42.088724863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls") pod "dns-default-4x7n6" (UID: "4afe1cd6-32e5-4436-8e05-a9ae78fcd219") : secret "dns-default-metrics-tls" not found
Jul 22 02:58:46.302914 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.302877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:46.303093 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.302944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:46.303314 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:46.303282    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:58:46.303464 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:46.303344    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:48.303320239 +0000 UTC m=+42.189448361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : configmap references non-existent config key: service-ca.crt
Jul 22 02:58:46.303464 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:46.303371    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:48.303363245 +0000 UTC m=+42.189491363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : secret "router-metrics-certs-default" not found
Jul 22 02:58:46.404440 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.403869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:58:46.404440 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:46.404086    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:58:46.404440 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:46.404159    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls podName:4666b731-80a9-49ee-8de6-ac67756efd2a nodeName:}" failed. No retries permitted until 2026-07-22 02:58:48.40413739 +0000 UTC m=+42.290265510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-f8dwh" (UID: "4666b731-80a9-49ee-8de6-ac67756efd2a") : secret "samples-operator-tls" not found
Jul 22 02:58:46.551746 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.551546    2576 generic.go:356] "Generic (PLEG): container finished" podID="55c949b3-37d3-4884-a826-b18881136778" containerID="672e45d9d2a8b8b9b50187d5e996ff4bcb002d8c7e13ffb9abd7902981b02855" exitCode=0
Jul 22 02:58:46.551746 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:46.551598    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww96c" event={"ID":"55c949b3-37d3-4884-a826-b18881136778","Type":"ContainerDied","Data":"672e45d9d2a8b8b9b50187d5e996ff4bcb002d8c7e13ffb9abd7902981b02855"}
Jul 22 02:58:47.558710 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:47.558665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ww96c" event={"ID":"55c949b3-37d3-4884-a826-b18881136778","Type":"ContainerStarted","Data":"39cd3cbf6f19f8f22b6e2a0f64e0e6dea745ae88be50f4c19c2331ef06efa1b1"}
Jul 22 02:58:48.221010 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:48.220813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:48.221210 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:48.220967    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:58:48.221210 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:48.221144    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls podName:4afe1cd6-32e5-4436-8e05-a9ae78fcd219 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:52.221123375 +0000 UTC m=+46.107251493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls") pod "dns-default-4x7n6" (UID: "4afe1cd6-32e5-4436-8e05-a9ae78fcd219") : secret "dns-default-metrics-tls" not found
Jul 22 02:58:48.321687 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:48.321641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:48.321687 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:48.321693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:48.321932 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:48.321809    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:58:48.321932 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:48.321834    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:52.321814876 +0000 UTC m=+46.207942993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : configmap references non-existent config key: service-ca.crt
Jul 22 02:58:48.321932 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:48.321867    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:52.321850321 +0000 UTC m=+46.207978441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : secret "router-metrics-certs-default" not found
Jul 22 02:58:48.422607 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:48.422562    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:58:48.422767 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:48.422730    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:58:48.422842 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:48.422809    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls podName:4666b731-80a9-49ee-8de6-ac67756efd2a nodeName:}" failed. No retries permitted until 2026-07-22 02:58:52.422789122 +0000 UTC m=+46.308917240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-f8dwh" (UID: "4666b731-80a9-49ee-8de6-ac67756efd2a") : secret "samples-operator-tls" not found
Jul 22 02:58:49.565726 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:49.565630    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj" event={"ID":"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26","Type":"ContainerStarted","Data":"7a017d0092ba7160fc9ba5c05c79ada3ba3209623cf08636b164405bd19f932f"}
Jul 22 02:58:49.567282 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:49.567248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vs88k" event={"ID":"67cb0d95-a82d-471e-9fa4-8ccef9a610e3","Type":"ContainerStarted","Data":"fed93615557e9df063f1d842a4c49cafc0d41a3169287c806b0629b824fe7d6c"}
Jul 22 02:58:49.568719 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:49.568697    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t25b7" event={"ID":"03bc3bf8-3b85-4914-85f2-c6d99f758092","Type":"ContainerStarted","Data":"adeaed72bded00fe0502316681f4ca8ef7b9ffda5d952b065fc502b2c8791faa"}
Jul 22 02:58:49.585138 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:49.585091    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj" podStartSLOduration=1.496716251 podStartE2EDuration="5.585077278s" totalImagesPullingTime="4.088361027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:49.58477551 +0000 UTC m=+43.470903651" watchObservedRunningTime="2026-07-22 02:58:49.585077278 +0000 UTC m=+43.471205417"
Jul 22 02:58:49.585285 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:49.585245    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ww96c" podStartSLOduration=10.483088823 podStartE2EDuration="40.58524031s" totalImagesPullingTime="30.102151487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:47.584480306 +0000 UTC m=+41.470608437" watchObservedRunningTime="2026-07-22 02:58:49.58524031 +0000 UTC m=+43.471368450"
Jul 22 02:58:49.600616 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:49.600564    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t25b7" podStartSLOduration=1.503161613 podStartE2EDuration="5.600541417s" totalImagesPullingTime="4.097379804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:49.599779177 +0000 UTC m=+43.485907315" watchObservedRunningTime="2026-07-22 02:58:49.600541417 +0000 UTC m=+43.486669556"
Jul 22 02:58:50.236951 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.236895    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-vs88k" podStartSLOduration=2.143542111 podStartE2EDuration="6.236876502s" totalImagesPullingTime="4.093334391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:58:49.617373983 +0000 UTC m=+43.503502123" watchObservedRunningTime="2026-07-22 02:58:50.236876502 +0000 UTC m=+44.123004642"
Jul 22 02:58:50.237135 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.237122    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6xxgw"]
Jul 22 02:58:50.261713 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.261683    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6xxgw"]
Jul 22 02:58:50.261862 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.261805    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.264191 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.264167    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 02:58:50.264414 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.264383    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 02:58:50.264580 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.264446    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zh2d9\""
Jul 22 02:58:50.439568 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.439535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.439568 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.439569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.439767 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.439666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4eeed88-ed48-4d3e-8053-2de02a23f931-crio-socket\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.439767 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.439707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4eeed88-ed48-4d3e-8053-2de02a23f931-data-volume\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.439767 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.439724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq9s5\" (UniqueName: \"kubernetes.io/projected/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-api-access-pq9s5\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.540766 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.540683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4eeed88-ed48-4d3e-8053-2de02a23f931-crio-socket\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.540766 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.540724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4eeed88-ed48-4d3e-8053-2de02a23f931-data-volume\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.540766 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.540744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq9s5\" (UniqueName: \"kubernetes.io/projected/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-api-access-pq9s5\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.540983 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.540818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4eeed88-ed48-4d3e-8053-2de02a23f931-crio-socket\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.540983 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.540833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.540983 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.540884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.540983 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:50.540900    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:58:50.540983 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:50.540957    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm podName:d4eeed88-ed48-4d3e-8053-2de02a23f931 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:51.040939674 +0000 UTC m=+44.927067812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6xxgw" (UID: "d4eeed88-ed48-4d3e-8053-2de02a23f931") : configmap "kube-rbac-proxy" not found
Jul 22 02:58:50.540983 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:50.540980    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:58:50.541195 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.541018    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4eeed88-ed48-4d3e-8053-2de02a23f931-data-volume\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:50.541195 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:50.541029    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls podName:d4eeed88-ed48-4d3e-8053-2de02a23f931 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:51.041015627 +0000 UTC m=+44.927143745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6xxgw" (UID: "d4eeed88-ed48-4d3e-8053-2de02a23f931") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:58:50.552233 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:50.552202    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq9s5\" (UniqueName: \"kubernetes.io/projected/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-api-access-pq9s5\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:51.046254 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:51.046219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:51.046699 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:51.046266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:51.046699 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:51.046346    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:58:51.046699 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:51.046445    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm podName:d4eeed88-ed48-4d3e-8053-2de02a23f931 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:52.046429252 +0000 UTC m=+45.932557373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6xxgw" (UID: "d4eeed88-ed48-4d3e-8053-2de02a23f931") : configmap "kube-rbac-proxy" not found
Jul 22 02:58:51.046699 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:51.046466    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:58:51.046699 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:51.046532    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls podName:d4eeed88-ed48-4d3e-8053-2de02a23f931 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:52.046519242 +0000 UTC m=+45.932647365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6xxgw" (UID: "d4eeed88-ed48-4d3e-8053-2de02a23f931") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:58:52.054060 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:52.054019    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:52.054060 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:52.054058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:52.054514 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.054142    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:58:52.054514 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.054167    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:58:52.054514 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.054211    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm podName:d4eeed88-ed48-4d3e-8053-2de02a23f931 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:54.054192893 +0000 UTC m=+47.940321012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6xxgw" (UID: "d4eeed88-ed48-4d3e-8053-2de02a23f931") : configmap "kube-rbac-proxy" not found
Jul 22 02:58:52.054514 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.054225    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls podName:d4eeed88-ed48-4d3e-8053-2de02a23f931 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:54.054219406 +0000 UTC m=+47.940347524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6xxgw" (UID: "d4eeed88-ed48-4d3e-8053-2de02a23f931") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:58:52.255838 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:52.255807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:58:52.255996 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.255973    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:58:52.256050 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.256043    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls podName:4afe1cd6-32e5-4436-8e05-a9ae78fcd219 nodeName:}" failed. No retries permitted until 2026-07-22 02:59:00.256026768 +0000 UTC m=+54.142154886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls") pod "dns-default-4x7n6" (UID: "4afe1cd6-32e5-4436-8e05-a9ae78fcd219") : secret "dns-default-metrics-tls" not found
Jul 22 02:58:52.357104 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:52.357005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:52.357104 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:52.357056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:58:52.357329 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.357168    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:58:52.357329 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.357237    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:59:00.357218026 +0000 UTC m=+54.243346158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : configmap references non-existent config key: service-ca.crt
Jul 22 02:58:52.357329 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.357256    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:59:00.357248114 +0000 UTC m=+54.243376231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : secret "router-metrics-certs-default" not found
Jul 22 02:58:52.458625 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:52.458584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:58:52.458832 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.458761    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:58:52.458893 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:52.458840    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls podName:4666b731-80a9-49ee-8de6-ac67756efd2a nodeName:}" failed. No retries permitted until 2026-07-22 02:59:00.458821017 +0000 UTC m=+54.344949152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-f8dwh" (UID: "4666b731-80a9-49ee-8de6-ac67756efd2a") : secret "samples-operator-tls" not found
Jul 22 02:58:53.222624 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:53.222593    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lvztc_311a7a15-e954-4ed4-8158-b7fdb0246cf2/dns-node-resolver/0.log"
Jul 22 02:58:54.022571 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:54.022536    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t5hpj_f809ee84-b430-4412-a4e2-164df3f746d5/node-ca/0.log"
Jul 22 02:58:54.073010 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:54.072975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:54.073010 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:54.073015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:54.073195 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:54.073093    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:58:54.073195 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:54.073150    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:58:54.073195 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:54.073157    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm podName:d4eeed88-ed48-4d3e-8053-2de02a23f931 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:58.073139887 +0000 UTC m=+51.959268005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6xxgw" (UID: "d4eeed88-ed48-4d3e-8053-2de02a23f931") : configmap "kube-rbac-proxy" not found
Jul 22 02:58:54.073195 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:54.073188    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls podName:d4eeed88-ed48-4d3e-8053-2de02a23f931 nodeName:}" failed. No retries permitted until 2026-07-22 02:58:58.073177834 +0000 UTC m=+51.959305951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6xxgw" (UID: "d4eeed88-ed48-4d3e-8053-2de02a23f931") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:58:55.023248 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:55.023218    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t25b7_03bc3bf8-3b85-4914-85f2-c6d99f758092/serve-healthcheck-canary/0.log"
Jul 22 02:58:58.103231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:58.103192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:58.103231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:58:58.103231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:58:58.103688 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:58.103322    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:58:58.103688 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:58.103384    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:58:58.103688 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:58.103426    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm podName:d4eeed88-ed48-4d3e-8053-2de02a23f931 nodeName:}" failed. No retries permitted until 2026-07-22 02:59:06.10337675 +0000 UTC m=+59.989504885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6xxgw" (UID: "d4eeed88-ed48-4d3e-8053-2de02a23f931") : configmap "kube-rbac-proxy" not found
Jul 22 02:58:58.103688 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:58:58.103446    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls podName:d4eeed88-ed48-4d3e-8053-2de02a23f931 nodeName:}" failed. No retries permitted until 2026-07-22 02:59:06.103436602 +0000 UTC m=+59.989564725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6xxgw" (UID: "d4eeed88-ed48-4d3e-8053-2de02a23f931") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:59:00.324190 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.324149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:59:00.326434 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.326409    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4afe1cd6-32e5-4436-8e05-a9ae78fcd219-metrics-tls\") pod \"dns-default-4x7n6\" (UID: \"4afe1cd6-32e5-4436-8e05-a9ae78fcd219\") " pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:59:00.399560 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.399521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:59:00.425172 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.425134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:59:00.425323 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.425198    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:59:00.425383 ip-10-0-139-214 kubenswrapper[2576]: E0722 02:59:00.425331    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle podName:23505e5c-1564-4aca-8eed-0058bab33390 nodeName:}" failed. No retries permitted until 2026-07-22 02:59:16.425308558 +0000 UTC m=+70.311436696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle") pod "router-default-68489bc688-4q4jw" (UID: "23505e5c-1564-4aca-8eed-0058bab33390") : configmap references non-existent config key: service-ca.crt
Jul 22 02:59:00.427522 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.427498    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23505e5c-1564-4aca-8eed-0058bab33390-metrics-certs\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:59:00.526204 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.526172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:59:00.532331 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.528518    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4666b731-80a9-49ee-8de6-ac67756efd2a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-f8dwh\" (UID: \"4666b731-80a9-49ee-8de6-ac67756efd2a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:59:00.538381 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.538341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"
Jul 22 02:59:00.540294 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.540270    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4x7n6"]
Jul 22 02:59:00.542938 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:00.542912    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4afe1cd6_32e5_4436_8e05_a9ae78fcd219.slice/crio-49e64ec4f17bdae1ef01a4e484345200d8b7a4b676439781a4d64d4ef0718daa WatchSource:0}: Error finding container 49e64ec4f17bdae1ef01a4e484345200d8b7a4b676439781a4d64d4ef0718daa: Status 404 returned error can't find the container with id 49e64ec4f17bdae1ef01a4e484345200d8b7a4b676439781a4d64d4ef0718daa
Jul 22 02:59:00.596379 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.596299    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4x7n6" event={"ID":"4afe1cd6-32e5-4436-8e05-a9ae78fcd219","Type":"ContainerStarted","Data":"49e64ec4f17bdae1ef01a4e484345200d8b7a4b676439781a4d64d4ef0718daa"}
Jul 22 02:59:00.687038 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:00.687006    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh"]
Jul 22 02:59:01.600745 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:01.600708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh" event={"ID":"4666b731-80a9-49ee-8de6-ac67756efd2a","Type":"ContainerStarted","Data":"857f3aecd7aca73b89aea4e7e90f0d2db76af3d959f8aa8d29af515a24363299"}
Jul 22 02:59:03.609515 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:03.609476    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh" event={"ID":"4666b731-80a9-49ee-8de6-ac67756efd2a","Type":"ContainerStarted","Data":"d436dad8d5c0d11e8f761d94ae05462729f03b0fc4b70be41e16a36743e0971c"}
Jul 22 02:59:03.610024 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:03.609529    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh" event={"ID":"4666b731-80a9-49ee-8de6-ac67756efd2a","Type":"ContainerStarted","Data":"3813a685681c3ed91db31296ff9798c6efdd7cfaa79d12cf76b652434783d8de"}
Jul 22 02:59:03.611199 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:03.611171    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4x7n6" event={"ID":"4afe1cd6-32e5-4436-8e05-a9ae78fcd219","Type":"ContainerStarted","Data":"555eafcd11738b084517de74389c248978cf747f739e8388801faccbb9e7cdd6"}
Jul 22 02:59:03.611299 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:03.611220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4x7n6" event={"ID":"4afe1cd6-32e5-4436-8e05-a9ae78fcd219","Type":"ContainerStarted","Data":"49ecc2a9384ed9ca2a467f3e011f75232e7b46a6e1e2ed7fee2b081e18acc187"}
Jul 22 02:59:03.611299 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:03.611257    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:59:03.626875 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:03.626826    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-f8dwh" podStartSLOduration=17.284994022 podStartE2EDuration="19.626811741s" totalImagesPullingTime="2.341817719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:03.626008339 +0000 UTC m=+57.512136479" watchObservedRunningTime="2026-07-22 02:59:03.626811741 +0000 UTC m=+57.512939939"
Jul 22 02:59:03.644916 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:03.644866    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4x7n6" podStartSLOduration=17.104747643 podStartE2EDuration="19.644849685s" totalImagesPullingTime="2.540102042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:03.644167069 +0000 UTC m=+57.530295208" watchObservedRunningTime="2026-07-22 02:59:03.644849685 +0000 UTC m=+57.530977825"
Jul 22 02:59:06.177585 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:06.177546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:59:06.177585 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:06.177586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:59:06.178199 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:06.178174    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4eeed88-ed48-4d3e-8053-2de02a23f931-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:59:06.180049 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:06.180028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4eeed88-ed48-4d3e-8053-2de02a23f931-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6xxgw\" (UID: \"d4eeed88-ed48-4d3e-8053-2de02a23f931\") " pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:59:06.471802 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:06.471712    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6xxgw"
Jul 22 02:59:06.603010 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:06.602987    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6xxgw"]
Jul 22 02:59:06.605511 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:06.605473    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4eeed88_ed48_4d3e_8053_2de02a23f931.slice/crio-743fc700a7f35e21f99218b7c78fcdbe0b4cc3e2a35a8a324dce7ca8098e0907 WatchSource:0}: Error finding container 743fc700a7f35e21f99218b7c78fcdbe0b4cc3e2a35a8a324dce7ca8098e0907: Status 404 returned error can't find the container with id 743fc700a7f35e21f99218b7c78fcdbe0b4cc3e2a35a8a324dce7ca8098e0907
Jul 22 02:59:06.622469 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:06.622431    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xxgw" event={"ID":"d4eeed88-ed48-4d3e-8053-2de02a23f931","Type":"ContainerStarted","Data":"743fc700a7f35e21f99218b7c78fcdbe0b4cc3e2a35a8a324dce7ca8098e0907"}
Jul 22 02:59:09.537445 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:09.537391    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8ktlt"
Jul 22 02:59:12.650790 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:12.650746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xxgw" event={"ID":"d4eeed88-ed48-4d3e-8053-2de02a23f931","Type":"ContainerStarted","Data":"62c99c90fc2949164afd50048fcb0d86321a78552eec651ab476c3c3f17c538c"}
Jul 22 02:59:13.618107 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.618070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4x7n6"
Jul 22 02:59:13.951783 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.951747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:59:13.952256 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.951801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:59:13.952256 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.951967    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crqv9\" (UniqueName: \"kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9\") pod \"network-check-target-drd2l\" (UID: \"cf953d49-185e-4ff2-bda6-e341c9943943\") " pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:59:13.954850 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.954823    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 02:59:13.954970 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.954863    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 02:59:13.954970 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.954916    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 02:59:13.965508 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.965452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/552549b9-1739-4b41-b3e0-423296732969-metrics-certs\") pod \"network-metrics-daemon-cs9qm\" (UID: \"552549b9-1739-4b41-b3e0-423296732969\") " pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:59:13.965692 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.965672    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3ebc44-1e39-458b-90fc-94951e07f565-original-pull-secret\") pod \"global-pull-secret-syncer-znwcl\" (UID: \"3f3ebc44-1e39-458b-90fc-94951e07f565\") " pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:59:13.965782 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.965692    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 02:59:13.976214 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.976183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crqv9\" (UniqueName: \"kubernetes.io/projected/cf953d49-185e-4ff2-bda6-e341c9943943-kube-api-access-crqv9\") pod \"network-check-target-drd2l\" (UID: \"cf953d49-185e-4ff2-bda6-e341c9943943\") " pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:59:13.987148 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:13.987122    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znwcl"
Jul 22 02:59:14.100173 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:14.100134    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sqq4d\""
Jul 22 02:59:14.106621 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:14.106597    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nztgp\""
Jul 22 02:59:14.108493 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:14.108474    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs9qm"
Jul 22 02:59:14.114451 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:14.114426    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:59:15.191762 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:15.191664    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-znwcl"]
Jul 22 02:59:15.195109 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:15.195079    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3ebc44_1e39_458b_90fc_94951e07f565.slice/crio-ffd947f2b04a4bdadf2bb479bfa20a6026407b2ec9a45563b9becfd846ee61a5 WatchSource:0}: Error finding container ffd947f2b04a4bdadf2bb479bfa20a6026407b2ec9a45563b9becfd846ee61a5: Status 404 returned error can't find the container with id ffd947f2b04a4bdadf2bb479bfa20a6026407b2ec9a45563b9becfd846ee61a5
Jul 22 02:59:15.203758 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:15.203687    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cs9qm"]
Jul 22 02:59:15.207056 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:15.207027    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552549b9_1739_4b41_b3e0_423296732969.slice/crio-c9e647b8361f8706f6e48d9a61b5074d6556c5e41935570c31763e9f8a941cdc WatchSource:0}: Error finding container c9e647b8361f8706f6e48d9a61b5074d6556c5e41935570c31763e9f8a941cdc: Status 404 returned error can't find the container with id c9e647b8361f8706f6e48d9a61b5074d6556c5e41935570c31763e9f8a941cdc
Jul 22 02:59:15.222903 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:15.222869    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-drd2l"]
Jul 22 02:59:15.226692 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:15.226668    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf953d49_185e_4ff2_bda6_e341c9943943.slice/crio-d0c0652103bdf951eb2ca428f533d8867f174892169a35e1dd98db4bdebee3da WatchSource:0}: Error finding container d0c0652103bdf951eb2ca428f533d8867f174892169a35e1dd98db4bdebee3da: Status 404 returned error can't find the container with id d0c0652103bdf951eb2ca428f533d8867f174892169a35e1dd98db4bdebee3da
Jul 22 02:59:15.664448 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:15.664389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-drd2l" event={"ID":"cf953d49-185e-4ff2-bda6-e341c9943943","Type":"ContainerStarted","Data":"d0c0652103bdf951eb2ca428f533d8867f174892169a35e1dd98db4bdebee3da"}
Jul 22 02:59:15.667036 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:15.666947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xxgw" event={"ID":"d4eeed88-ed48-4d3e-8053-2de02a23f931","Type":"ContainerStarted","Data":"28a4ef3615b951dfa2abb9f1b2485fc1b29171159ff9c57b0e7fdf6a3e4a109d"}
Jul 22 02:59:15.668604 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:15.668570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-znwcl" event={"ID":"3f3ebc44-1e39-458b-90fc-94951e07f565","Type":"ContainerStarted","Data":"ffd947f2b04a4bdadf2bb479bfa20a6026407b2ec9a45563b9becfd846ee61a5"}
Jul 22 02:59:15.670221 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:15.670163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cs9qm" event={"ID":"552549b9-1739-4b41-b3e0-423296732969","Type":"ContainerStarted","Data":"c9e647b8361f8706f6e48d9a61b5074d6556c5e41935570c31763e9f8a941cdc"}
Jul 22 02:59:16.472530 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:16.472486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:59:16.473145 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:16.473119    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23505e5c-1564-4aca-8eed-0058bab33390-service-ca-bundle\") pod \"router-default-68489bc688-4q4jw\" (UID: \"23505e5c-1564-4aca-8eed-0058bab33390\") " pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:59:16.649016 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:16.648970    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vsfrq\""
Jul 22 02:59:16.657365 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:16.657189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:59:16.837144 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:16.837039    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68489bc688-4q4jw"]
Jul 22 02:59:16.903708 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:16.903673    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23505e5c_1564_4aca_8eed_0058bab33390.slice/crio-3a44db2cf89296136c4523012648910d7a1d10481254a322cb7caf02b3f6ac90 WatchSource:0}: Error finding container 3a44db2cf89296136c4523012648910d7a1d10481254a322cb7caf02b3f6ac90: Status 404 returned error can't find the container with id 3a44db2cf89296136c4523012648910d7a1d10481254a322cb7caf02b3f6ac90
Jul 22 02:59:17.682457 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:17.682297    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cs9qm" event={"ID":"552549b9-1739-4b41-b3e0-423296732969","Type":"ContainerStarted","Data":"5f088c628e6e76a123ae374a9f8bb8c6c4ec2f36e11034572a516a389ba4a90a"}
Jul 22 02:59:17.682457 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:17.682419    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cs9qm" event={"ID":"552549b9-1739-4b41-b3e0-423296732969","Type":"ContainerStarted","Data":"0ee64731e2b6e1106fe3eb713953ec2d55239039d3c9e2bd3ee61642906c8c6b"}
Jul 22 02:59:17.684529 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:17.684499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68489bc688-4q4jw" event={"ID":"23505e5c-1564-4aca-8eed-0058bab33390","Type":"ContainerStarted","Data":"bfee3fe896fe69e6498ded461533005cd42161615d7546d76223495e859eec43"}
Jul 22 02:59:17.684723 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:17.684548    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68489bc688-4q4jw" event={"ID":"23505e5c-1564-4aca-8eed-0058bab33390","Type":"ContainerStarted","Data":"3a44db2cf89296136c4523012648910d7a1d10481254a322cb7caf02b3f6ac90"}
Jul 22 02:59:17.699904 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:17.699854    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cs9qm" podStartSLOduration=66.975095755 podStartE2EDuration="1m8.699838347s" totalImagesPullingTime="1.724742592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:17.699248354 +0000 UTC m=+71.585376496" watchObservedRunningTime="2026-07-22 02:59:17.699838347 +0000 UTC m=+71.585966486"
Jul 22 02:59:17.722504 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:17.722450    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-68489bc688-4q4jw" podStartSLOduration=33.722431294 podStartE2EDuration="33.722431294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:58:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:17.721077291 +0000 UTC m=+71.607205434" watchObservedRunningTime="2026-07-22 02:59:17.722431294 +0000 UTC m=+71.608559435"
Jul 22 02:59:18.454631 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.454305    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"]
Jul 22 02:59:18.546429 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.546383    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"]
Jul 22 02:59:18.546626 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.546532    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"
Jul 22 02:59:18.556300 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.556277    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sz7rq\""
Jul 22 02:59:18.556528 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.556509    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 22 02:59:18.564989 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.564965    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 22 02:59:18.570679 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.570654    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"]
Jul 22 02:59:18.570810 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.570694    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"]
Jul 22 02:59:18.570810 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.570801    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.574554 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.574528    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 02:59:18.576007 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.575986    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 02:59:18.576112 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.576004    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 02:59:18.576425 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.576390    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 02:59:18.576522 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.576447    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 02:59:18.576522 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.576459    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 02:59:18.576742 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.576722    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 02:59:18.658291 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.658249    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:59:18.661422 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.661366    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:59:18.689303 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.689175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7893395e-09be-40cb-bfe8-d4053aa11b2f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r4vp5\" (UID: \"7893395e-09be-40cb-bfe8-d4053aa11b2f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"
Jul 22 02:59:18.689303 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.689221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9ct2\" (UniqueName: \"kubernetes.io/projected/aeecf104-e953-4044-a4ce-f0da8a6207cd-kube-api-access-r9ct2\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.689303 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.689253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.689303 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.689275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-hub\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.689954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.689338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeecf104-e953-4044-a4ce-f0da8a6207cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.689954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.689351    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:59:18.689954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.689460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.689954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.689496    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7893395e-09be-40cb-bfe8-d4053aa11b2f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-r4vp5\" (UID: \"7893395e-09be-40cb-bfe8-d4053aa11b2f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"
Jul 22 02:59:18.689954 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.689530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-ca\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.690970 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.690929    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68489bc688-4q4jw"
Jul 22 02:59:18.790241 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.790207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeecf104-e953-4044-a4ce-f0da8a6207cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.790432 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.790267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.790432 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.790287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7893395e-09be-40cb-bfe8-d4053aa11b2f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-r4vp5\" (UID: \"7893395e-09be-40cb-bfe8-d4053aa11b2f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"
Jul 22 02:59:18.790432 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.790310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-ca\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.790432 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.790365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7893395e-09be-40cb-bfe8-d4053aa11b2f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r4vp5\" (UID: \"7893395e-09be-40cb-bfe8-d4053aa11b2f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"
Jul 22 02:59:18.790432 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.790416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ct2\" (UniqueName: \"kubernetes.io/projected/aeecf104-e953-4044-a4ce-f0da8a6207cd-kube-api-access-r9ct2\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.790669 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.790464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.790669 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.790493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-hub\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.791898 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.791749    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7893395e-09be-40cb-bfe8-d4053aa11b2f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-r4vp5\" (UID: \"7893395e-09be-40cb-bfe8-d4053aa11b2f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"
Jul 22 02:59:18.793433 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.793020    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aeecf104-e953-4044-a4ce-f0da8a6207cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.795454 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.795361    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.799281 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.798221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-hub\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.799281 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.798279    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.801666 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.801623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aeecf104-e953-4044-a4ce-f0da8a6207cd-ca\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.801765 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.801741    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7893395e-09be-40cb-bfe8-d4053aa11b2f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r4vp5\" (UID: \"7893395e-09be-40cb-bfe8-d4053aa11b2f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"
Jul 22 02:59:18.806535 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.806509    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9ct2\" (UniqueName: \"kubernetes.io/projected/aeecf104-e953-4044-a4ce-f0da8a6207cd-kube-api-access-r9ct2\") pod \"cluster-proxy-proxy-agent-7687fd4d94-xbrgc\" (UID: \"aeecf104-e953-4044-a4ce-f0da8a6207cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:18.856964 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.856925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"
Jul 22 02:59:18.893221 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:18.893186    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"
Jul 22 02:59:22.246766 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.246715    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc"]
Jul 22 02:59:22.249271 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:22.249143    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeecf104_e953_4044_a4ce_f0da8a6207cd.slice/crio-f6af70c1408c44066c58cfb1733094ebed0e77e029316fcbd87f0f9a80118352 WatchSource:0}: Error finding container f6af70c1408c44066c58cfb1733094ebed0e77e029316fcbd87f0f9a80118352: Status 404 returned error can't find the container with id f6af70c1408c44066c58cfb1733094ebed0e77e029316fcbd87f0f9a80118352
Jul 22 02:59:22.267541 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.267511    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5"]
Jul 22 02:59:22.270109 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:22.270083    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7893395e_09be_40cb_bfe8_d4053aa11b2f.slice/crio-2f7ff9b7d4bd55b47e902af5268d43a0a6c2f7aeebf62e9f907f00fccbb2e2b7 WatchSource:0}: Error finding container 2f7ff9b7d4bd55b47e902af5268d43a0a6c2f7aeebf62e9f907f00fccbb2e2b7: Status 404 returned error can't find the container with id 2f7ff9b7d4bd55b47e902af5268d43a0a6c2f7aeebf62e9f907f00fccbb2e2b7
Jul 22 02:59:22.704477 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.704443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-drd2l" event={"ID":"cf953d49-185e-4ff2-bda6-e341c9943943","Type":"ContainerStarted","Data":"dcca06fbe8b63357943ee86f09a53f57d00c384acd4e8bf626bb64a07d096db2"}
Jul 22 02:59:22.704682 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.704547    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:59:22.705716 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.705695    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5" event={"ID":"7893395e-09be-40cb-bfe8-d4053aa11b2f","Type":"ContainerStarted","Data":"2f7ff9b7d4bd55b47e902af5268d43a0a6c2f7aeebf62e9f907f00fccbb2e2b7"}
Jul 22 02:59:22.707593 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.707572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6xxgw" event={"ID":"d4eeed88-ed48-4d3e-8053-2de02a23f931","Type":"ContainerStarted","Data":"c1ac0bf997038eb552370cd0d4ade33e56acd15ba0e6eb25b04f94afe82a8704"}
Jul 22 02:59:22.708928 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.708904    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-znwcl" event={"ID":"3f3ebc44-1e39-458b-90fc-94951e07f565","Type":"ContainerStarted","Data":"a170cb2a75ad6a0cba3fcd73b682bffb4cee3ba07931e80ce66f9b9cd04e00f8"}
Jul 22 02:59:22.709951 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.709932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc" event={"ID":"aeecf104-e953-4044-a4ce-f0da8a6207cd","Type":"ContainerStarted","Data":"f6af70c1408c44066c58cfb1733094ebed0e77e029316fcbd87f0f9a80118352"}
Jul 22 02:59:22.720378 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.720336    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-drd2l" podStartSLOduration=66.846277722 podStartE2EDuration="1m13.720324109s" totalImagesPullingTime="6.874046387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:22.719380145 +0000 UTC m=+76.605508297" watchObservedRunningTime="2026-07-22 02:59:22.720324109 +0000 UTC m=+76.606452249"
Jul 22 02:59:22.739642 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.739595    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6xxgw" podStartSLOduration=17.388755677 podStartE2EDuration="32.739580439s" totalImagesPullingTime="15.350824762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:22.73861189 +0000 UTC m=+76.624740034" watchObservedRunningTime="2026-07-22 02:59:22.739580439 +0000 UTC m=+76.625708614"
Jul 22 02:59:22.756962 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:22.756913    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-znwcl" podStartSLOduration=66.855266735 podStartE2EDuration="1m13.756897224s" totalImagesPullingTime="6.901630489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:22.756536209 +0000 UTC m=+76.642664444" watchObservedRunningTime="2026-07-22 02:59:22.756897224 +0000 UTC m=+76.643025393"
Jul 22 02:59:23.716346 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:23.716292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5" event={"ID":"7893395e-09be-40cb-bfe8-d4053aa11b2f","Type":"ContainerStarted","Data":"ab2681e31c6edb7f528f2490b604efda86a79d650d844b6aa45b1d00e43f457c"}
Jul 22 02:59:23.734441 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:23.734264    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r4vp5" podStartSLOduration=4.52031089 podStartE2EDuration="5.734030126s" totalImagesPullingTime="1.213719236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:23.733831201 +0000 UTC m=+77.619959418" watchObservedRunningTime="2026-07-22 02:59:23.734030126 +0000 UTC m=+77.620158267"
Jul 22 02:59:26.731132 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:26.731092    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc" event={"ID":"aeecf104-e953-4044-a4ce-f0da8a6207cd","Type":"ContainerStarted","Data":"77a89c89ba41b759e0e247b004156fd3912fb0ec17ea5d6fae544b8392822c73"}
Jul 22 02:59:26.731132 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:26.731141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc" event={"ID":"aeecf104-e953-4044-a4ce-f0da8a6207cd","Type":"ContainerStarted","Data":"288a3564e785415daaf8ee553359bad5ea0be14c26bb6c8ca6af0f28e3ec9f84"}
Jul 22 02:59:26.731591 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:26.731153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc" event={"ID":"aeecf104-e953-4044-a4ce-f0da8a6207cd","Type":"ContainerStarted","Data":"b468baf96c7196fd57ecb9acdcd6df6d7880819f92a09589e160e2aca59ddbe2"}
Jul 22 02:59:26.751298 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:26.751247    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7687fd4d94-xbrgc" podStartSLOduration=4.9716102840000005 podStartE2EDuration="8.751230832s" totalImagesPullingTime="3.779620548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:26.750198906 +0000 UTC m=+80.636327046" watchObservedRunningTime="2026-07-22 02:59:26.751230832 +0000 UTC m=+80.637358973"
Jul 22 02:59:33.119096 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.118979    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wh5gs"]
Jul 22 02:59:33.121731 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.121710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.124055 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.124033    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 02:59:33.124177 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.124146    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 02:59:33.124412 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.124374    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 02:59:33.124525 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.124464    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 02:59:33.125414 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.125374    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 02:59:33.125414 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.125377    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 02:59:33.125566 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.125473    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ffkrv\""
Jul 22 02:59:33.303761 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.303726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5btl\" (UniqueName: \"kubernetes.io/projected/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-kube-api-access-s5btl\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.303918 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.303777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-root\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.303918 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.303857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-textfile\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.303918 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.303889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-wtmp\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.303918 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.303916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-sys\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.304045 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.303932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-tls\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.304045 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.303977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-metrics-client-ca\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.304045 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.304021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.304135 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.304043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-accelerators-collector-config\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405106 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-textfile\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405106 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-wtmp\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405341 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-sys\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405341 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-tls\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405341 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-metrics-client-ca\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405341 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405341 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405222    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-sys\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405341 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-accelerators-collector-config\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405341 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5btl\" (UniqueName: \"kubernetes.io/projected/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-kube-api-access-s5btl\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405698 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-root\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405698 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405421    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-wtmp\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405698 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-root\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405698 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-textfile\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.405931 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.405910    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-metrics-client-ca\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.406177 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.406157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-accelerators-collector-config\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.407922 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.407897    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-tls\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.407976 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.407941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.415933 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.414088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5btl\" (UniqueName: \"kubernetes.io/projected/0bb0b2ab-3ccd-4b49-8b56-49737e117cdf-kube-api-access-s5btl\") pod \"node-exporter-wh5gs\" (UID: \"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf\") " pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.431232 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.431199    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wh5gs"
Jul 22 02:59:33.441964 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:33.441936    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb0b2ab_3ccd_4b49_8b56_49737e117cdf.slice/crio-7c6bce74012890e5424788b32515c6343b26a1389722b86f5a13ba7f2896607a WatchSource:0}: Error finding container 7c6bce74012890e5424788b32515c6343b26a1389722b86f5a13ba7f2896607a: Status 404 returned error can't find the container with id 7c6bce74012890e5424788b32515c6343b26a1389722b86f5a13ba7f2896607a
Jul 22 02:59:33.754321 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:33.754238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wh5gs" event={"ID":"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf","Type":"ContainerStarted","Data":"7c6bce74012890e5424788b32515c6343b26a1389722b86f5a13ba7f2896607a"}
Jul 22 02:59:34.759987 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:34.759867    2576 generic.go:356] "Generic (PLEG): container finished" podID="0bb0b2ab-3ccd-4b49-8b56-49737e117cdf" containerID="3b7f8e9eff12ba88e9f714a44ef8c49f07fbefaa5782fdf21a926c8637d68c8f" exitCode=0
Jul 22 02:59:34.759987 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:34.759955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wh5gs" event={"ID":"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf","Type":"ContainerDied","Data":"3b7f8e9eff12ba88e9f714a44ef8c49f07fbefaa5782fdf21a926c8637d68c8f"}
Jul 22 02:59:35.765467 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:35.765431    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wh5gs" event={"ID":"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf","Type":"ContainerStarted","Data":"719a44262f5ff01c3464274980a5472af241fa3432697a9aa1d350f08aebd67d"}
Jul 22 02:59:35.765861 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:35.765484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wh5gs" event={"ID":"0bb0b2ab-3ccd-4b49-8b56-49737e117cdf","Type":"ContainerStarted","Data":"3d18df3c758fd9cf661408c09017587f33102dcc50edc681e65ddc2ac738bcfc"}
Jul 22 02:59:35.785708 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:35.785662    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wh5gs" podStartSLOduration=1.758254652 podStartE2EDuration="2.785644284s" totalImagesPullingTime="963.491153ms" totalInitContainerRuntime="63.898479ms" isStatefulPod=true podCreationTimestamp="2026-07-22 02:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:35.784799901 +0000 UTC m=+89.670928042" watchObservedRunningTime="2026-07-22 02:59:35.785644284 +0000 UTC m=+89.671772423"
Jul 22 02:59:37.437230 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.437192    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"]
Jul 22 02:59:37.440095 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.440077    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.443555 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.443529    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 22 02:59:37.443749 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.443533    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fttvh03agscv1\""
Jul 22 02:59:37.443749 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.443576    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 22 02:59:37.443749 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.443577    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 22 02:59:37.443749 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.443580    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 02:59:37.443749 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.443585    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2thsm\""
Jul 22 02:59:37.455918 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.453999    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"]
Jul 22 02:59:37.537696 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.537661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-secret-metrics-server-tls\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.537696 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.537701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-metrics-server-audit-profiles\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.537979 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.537740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.537979 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.537764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-audit-log\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.537979 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.537781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96xg8\" (UniqueName: \"kubernetes.io/projected/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-kube-api-access-96xg8\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.537979 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.537814    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-secret-metrics-server-client-certs\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.537979 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.537832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-client-ca-bundle\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.638510 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.638468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-secret-metrics-server-tls\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.638510 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.638511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-metrics-server-audit-profiles\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.638790 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.638544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.638790 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.638570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-audit-log\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.638790 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.638587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96xg8\" (UniqueName: \"kubernetes.io/projected/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-kube-api-access-96xg8\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.638790 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.638621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-secret-metrics-server-client-certs\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.638790 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.638641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-client-ca-bundle\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.639133 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.639110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-audit-log\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.639450 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.639421    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.639623 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.639601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-metrics-server-audit-profiles\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.641187 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.641168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-secret-metrics-server-tls\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.641307 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.641287    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-client-ca-bundle\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.641365 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.641343    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-secret-metrics-server-client-certs\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.647297 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.647272    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96xg8\" (UniqueName: \"kubernetes.io/projected/4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354-kube-api-access-96xg8\") pod \"metrics-server-6c6c9c9bd8-z5r2l\" (UID: \"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354\") " pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.749137 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.749039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:37.907505 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:37.907471    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"]
Jul 22 02:59:37.907875 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:37.907848    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4a0b55_f05d_4b91_9cc8_4a83d5dc4354.slice/crio-90df0d70401e8f6bce7f1429db7dcc920524c3ee036418303c8d94a5c6e32311 WatchSource:0}: Error finding container 90df0d70401e8f6bce7f1429db7dcc920524c3ee036418303c8d94a5c6e32311: Status 404 returned error can't find the container with id 90df0d70401e8f6bce7f1429db7dcc920524c3ee036418303c8d94a5c6e32311
Jul 22 02:59:38.777408 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:38.777353    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l" event={"ID":"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354","Type":"ContainerStarted","Data":"90df0d70401e8f6bce7f1429db7dcc920524c3ee036418303c8d94a5c6e32311"}
Jul 22 02:59:39.053334 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.053249    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8c688d6fb-pj8vc"]
Jul 22 02:59:39.057613 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.057584    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.060081 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.060059    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 02:59:39.060231 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.060059    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 02:59:39.060868 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.060842    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 02:59:39.060986 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.060883    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 02:59:39.060986 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.060901    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-srtb2\""
Jul 22 02:59:39.060986 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.060937    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 02:59:39.060986 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.060939    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 02:59:39.061219 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.061204    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 02:59:39.066566 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.066043    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 02:59:39.068434 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.068409    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c688d6fb-pj8vc"]
Jul 22 02:59:39.250495 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.250456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-oauth-config\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.250672 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.250519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-service-ca\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.250672 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.250587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-serving-cert\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.250672 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.250637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkbvk\" (UniqueName: \"kubernetes.io/projected/41273332-1218-4746-ad36-bf662a93a5cf-kube-api-access-bkbvk\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.250672 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.250666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-console-config\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.250860 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.250700    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-trusted-ca-bundle\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.250860 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.250744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-oauth-serving-cert\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.351539 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.351512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkbvk\" (UniqueName: \"kubernetes.io/projected/41273332-1218-4746-ad36-bf662a93a5cf-kube-api-access-bkbvk\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.351665 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.351556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-console-config\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.351665 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.351584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-trusted-ca-bundle\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.351665 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.351629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-oauth-serving-cert\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.351822 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.351673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-oauth-config\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.351822 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.351745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-service-ca\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.351822 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.351797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-serving-cert\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.352638 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.352443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-console-config\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.352758 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.352682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-oauth-serving-cert\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.352758 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.352685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-service-ca\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.352993 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.352975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-trusted-ca-bundle\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.354442 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.354416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-serving-cert\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.354717 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.354695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-oauth-config\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.364612 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.364581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkbvk\" (UniqueName: \"kubernetes.io/projected/41273332-1218-4746-ad36-bf662a93a5cf-kube-api-access-bkbvk\") pod \"console-8c688d6fb-pj8vc\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") " pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.370262 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.370203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:39.508571 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.508014    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c688d6fb-pj8vc"]
Jul 22 02:59:39.514038 ip-10-0-139-214 kubenswrapper[2576]: W0722 02:59:39.514008    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41273332_1218_4746_ad36_bf662a93a5cf.slice/crio-a58d0c7d9350f7cd819510095be495ba649b6202c84c93bc559c299adf3d239e WatchSource:0}: Error finding container a58d0c7d9350f7cd819510095be495ba649b6202c84c93bc559c299adf3d239e: Status 404 returned error can't find the container with id a58d0c7d9350f7cd819510095be495ba649b6202c84c93bc559c299adf3d239e
Jul 22 02:59:39.782941 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.782902    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c688d6fb-pj8vc" event={"ID":"41273332-1218-4746-ad36-bf662a93a5cf","Type":"ContainerStarted","Data":"a58d0c7d9350f7cd819510095be495ba649b6202c84c93bc559c299adf3d239e"}
Jul 22 02:59:39.784506 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.784472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l" event={"ID":"4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354","Type":"ContainerStarted","Data":"9e6ae7fbf24d697a742aa9515b558e9409112c75bac32a27cd82dc82142b809a"}
Jul 22 02:59:39.803198 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:39.803145    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l" podStartSLOduration=1.427645473 podStartE2EDuration="2.803126368s" totalImagesPullingTime="1.375480895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:39.802101585 +0000 UTC m=+93.688229725" watchObservedRunningTime="2026-07-22 02:59:39.803126368 +0000 UTC m=+93.689254509"
Jul 22 02:59:42.798556 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:42.798519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c688d6fb-pj8vc" event={"ID":"41273332-1218-4746-ad36-bf662a93a5cf","Type":"ContainerStarted","Data":"fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837"}
Jul 22 02:59:42.817036 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:42.816893    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8c688d6fb-pj8vc" podStartSLOduration=1.286338841 podStartE2EDuration="3.816870208s" totalImagesPullingTime="2.530531367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:59:42.816108798 +0000 UTC m=+96.702236946" watchObservedRunningTime="2026-07-22 02:59:42.816870208 +0000 UTC m=+96.702998349"
Jul 22 02:59:49.370757 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:49.370705    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:49.371173 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:49.370816    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:49.375600 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:49.375577    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:49.828026 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:49.827995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 02:59:53.719703 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:53.719671    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-drd2l"
Jul 22 02:59:57.749284 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:57.749252    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 02:59:57.749673 ip-10-0-139-214 kubenswrapper[2576]: I0722 02:59:57.749321    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 03:00:00.863791 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:00:00.863756    2576 generic.go:356] "Generic (PLEG): container finished" podID="d2d40318-cee0-4d9f-85ec-d2d91cdaeb26" containerID="7a017d0092ba7160fc9ba5c05c79ada3ba3209623cf08636b164405bd19f932f" exitCode=0
Jul 22 03:00:00.864224 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:00:00.863814    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj" event={"ID":"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26","Type":"ContainerDied","Data":"7a017d0092ba7160fc9ba5c05c79ada3ba3209623cf08636b164405bd19f932f"}
Jul 22 03:00:00.864224 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:00:00.864105    2576 scope.go:117] "RemoveContainer" containerID="7a017d0092ba7160fc9ba5c05c79ada3ba3209623cf08636b164405bd19f932f"
Jul 22 03:00:01.868941 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:00:01.868903    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qwcmj" event={"ID":"d2d40318-cee0-4d9f-85ec-d2d91cdaeb26","Type":"ContainerStarted","Data":"d82996029600bb7b26c27350e15341d99c5b8dd957a8fd3a4b518bb11b0bb779"}
Jul 22 03:00:17.755100 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:00:17.755068    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 03:00:17.759012 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:00:17.758984    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c6c9c9bd8-z5r2l"
Jul 22 03:00:19.932701 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:00:19.932662    2576 generic.go:356] "Generic (PLEG): container finished" podID="67cb0d95-a82d-471e-9fa4-8ccef9a610e3" containerID="fed93615557e9df063f1d842a4c49cafc0d41a3169287c806b0629b824fe7d6c" exitCode=0
Jul 22 03:00:19.933085 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:00:19.932737    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vs88k" event={"ID":"67cb0d95-a82d-471e-9fa4-8ccef9a610e3","Type":"ContainerDied","Data":"fed93615557e9df063f1d842a4c49cafc0d41a3169287c806b0629b824fe7d6c"}
Jul 22 03:00:19.933085 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:00:19.933083    2576 scope.go:117] "RemoveContainer" containerID="fed93615557e9df063f1d842a4c49cafc0d41a3169287c806b0629b824fe7d6c"
Jul 22 03:00:20.937896 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:00:20.937862    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vs88k" event={"ID":"67cb0d95-a82d-471e-9fa4-8ccef9a610e3","Type":"ContainerStarted","Data":"52e60f4cbf3d7a767fe2cdb6d4db1bf1086221c3cd181508236139851956e4be"}
Jul 22 03:01:08.229038 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.228938    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-789bcfb6b8-9449t"]
Jul 22 03:01:08.232781 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.232750    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.243211 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.243185    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789bcfb6b8-9449t"]
Jul 22 03:01:08.360755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.360716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-oauth-serving-cert\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.360755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.360762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-config\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.360971 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.360782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgssm\" (UniqueName: \"kubernetes.io/projected/3258ab6b-01dd-4ef4-a13a-4a85828222a2-kube-api-access-rgssm\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.360971 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.360886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-service-ca\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.360971 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.360922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-trusted-ca-bundle\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.360971 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.360947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-serving-cert\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.361105 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.360982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-oauth-config\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.461378 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.461339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-oauth-serving-cert\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.461378 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.461381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-config\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.461599 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.461422    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgssm\" (UniqueName: \"kubernetes.io/projected/3258ab6b-01dd-4ef4-a13a-4a85828222a2-kube-api-access-rgssm\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.461599 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.461459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-service-ca\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.461599 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.461488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-trusted-ca-bundle\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.461599 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.461515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-serving-cert\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.461599 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.461549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-oauth-config\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.462176 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.462151    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-oauth-serving-cert\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.462280 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.462246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-service-ca\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.462280 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.462263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-config\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.462384 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.462335    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-trusted-ca-bundle\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.464024 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.464002    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-oauth-config\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.464122 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.464104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-serving-cert\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.471369 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.471343    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgssm\" (UniqueName: \"kubernetes.io/projected/3258ab6b-01dd-4ef4-a13a-4a85828222a2-kube-api-access-rgssm\") pod \"console-789bcfb6b8-9449t\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") " pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.543042 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.542944    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:08.677908 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:08.677876    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789bcfb6b8-9449t"]
Jul 22 03:01:08.681099 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:01:08.681074    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3258ab6b_01dd_4ef4_a13a_4a85828222a2.slice/crio-27a4b98d7abdef6ba01df3c95e26013c03d80bc7f24ffcfde2d74f00e2c9430b WatchSource:0}: Error finding container 27a4b98d7abdef6ba01df3c95e26013c03d80bc7f24ffcfde2d74f00e2c9430b: Status 404 returned error can't find the container with id 27a4b98d7abdef6ba01df3c95e26013c03d80bc7f24ffcfde2d74f00e2c9430b
Jul 22 03:01:09.110898 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:09.110854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789bcfb6b8-9449t" event={"ID":"3258ab6b-01dd-4ef4-a13a-4a85828222a2","Type":"ContainerStarted","Data":"b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875"}
Jul 22 03:01:09.111102 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:09.110908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789bcfb6b8-9449t" event={"ID":"3258ab6b-01dd-4ef4-a13a-4a85828222a2","Type":"ContainerStarted","Data":"27a4b98d7abdef6ba01df3c95e26013c03d80bc7f24ffcfde2d74f00e2c9430b"}
Jul 22 03:01:18.543063 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:18.543025    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:18.543568 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:18.543103    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:18.548236 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:18.548212    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:18.573523 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:18.573473    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-789bcfb6b8-9449t" podStartSLOduration=10.57345709 podStartE2EDuration="10.57345709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:01:09.144713913 +0000 UTC m=+183.030842052" watchObservedRunningTime="2026-07-22 03:01:18.57345709 +0000 UTC m=+192.459585223"
Jul 22 03:01:19.150547 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:19.150517    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:01:19.207284 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:19.207245    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c688d6fb-pj8vc"]
Jul 22 03:01:44.236437 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.236339    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8c688d6fb-pj8vc" podUID="41273332-1218-4746-ad36-bf662a93a5cf" containerName="console" containerID="cri-o://fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837" gracePeriod=15
Jul 22 03:01:44.486310 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.486285    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 03:01:44.561451 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.561336    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-serving-cert\") pod \"41273332-1218-4746-ad36-bf662a93a5cf\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") "
Jul 22 03:01:44.561451 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.561371    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-console-config\") pod \"41273332-1218-4746-ad36-bf662a93a5cf\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") "
Jul 22 03:01:44.561451 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.561439    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-oauth-config\") pod \"41273332-1218-4746-ad36-bf662a93a5cf\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") "
Jul 22 03:01:44.561743 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.561466    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-oauth-serving-cert\") pod \"41273332-1218-4746-ad36-bf662a93a5cf\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") "
Jul 22 03:01:44.561743 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.561491    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-service-ca\") pod \"41273332-1218-4746-ad36-bf662a93a5cf\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") "
Jul 22 03:01:44.561743 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.561515    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkbvk\" (UniqueName: \"kubernetes.io/projected/41273332-1218-4746-ad36-bf662a93a5cf-kube-api-access-bkbvk\") pod \"41273332-1218-4746-ad36-bf662a93a5cf\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") "
Jul 22 03:01:44.561743 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.561554    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-trusted-ca-bundle\") pod \"41273332-1218-4746-ad36-bf662a93a5cf\" (UID: \"41273332-1218-4746-ad36-bf662a93a5cf\") "
Jul 22 03:01:44.561998 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.561948    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "41273332-1218-4746-ad36-bf662a93a5cf" (UID: "41273332-1218-4746-ad36-bf662a93a5cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:01:44.562054 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.562000    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-console-config" (OuterVolumeSpecName: "console-config") pod "41273332-1218-4746-ad36-bf662a93a5cf" (UID: "41273332-1218-4746-ad36-bf662a93a5cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:01:44.562054 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.562012    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "41273332-1218-4746-ad36-bf662a93a5cf" (UID: "41273332-1218-4746-ad36-bf662a93a5cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:01:44.562173 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.562076    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "41273332-1218-4746-ad36-bf662a93a5cf" (UID: "41273332-1218-4746-ad36-bf662a93a5cf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:01:44.563880 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.563857    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "41273332-1218-4746-ad36-bf662a93a5cf" (UID: "41273332-1218-4746-ad36-bf662a93a5cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:01:44.563880 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.563870    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "41273332-1218-4746-ad36-bf662a93a5cf" (UID: "41273332-1218-4746-ad36-bf662a93a5cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:01:44.564031 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.563897    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41273332-1218-4746-ad36-bf662a93a5cf-kube-api-access-bkbvk" (OuterVolumeSpecName: "kube-api-access-bkbvk") pod "41273332-1218-4746-ad36-bf662a93a5cf" (UID: "41273332-1218-4746-ad36-bf662a93a5cf"). InnerVolumeSpecName "kube-api-access-bkbvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:01:44.662679 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.662637    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-oauth-config\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:01:44.662679 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.662673    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-oauth-serving-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:01:44.662679 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.662683    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-service-ca\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:01:44.662926 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.662692    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkbvk\" (UniqueName: \"kubernetes.io/projected/41273332-1218-4746-ad36-bf662a93a5cf-kube-api-access-bkbvk\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:01:44.662926 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.662703    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-trusted-ca-bundle\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:01:44.662926 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.662712    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41273332-1218-4746-ad36-bf662a93a5cf-console-serving-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:01:44.662926 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:44.662721    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41273332-1218-4746-ad36-bf662a93a5cf-console-config\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:01:45.238934 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:45.238899    2576 generic.go:356] "Generic (PLEG): container finished" podID="41273332-1218-4746-ad36-bf662a93a5cf" containerID="fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837" exitCode=0
Jul 22 03:01:45.239371 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:45.238944    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c688d6fb-pj8vc"
Jul 22 03:01:45.239371 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:45.238972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c688d6fb-pj8vc" event={"ID":"41273332-1218-4746-ad36-bf662a93a5cf","Type":"ContainerDied","Data":"fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837"}
Jul 22 03:01:45.239371 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:45.239012    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c688d6fb-pj8vc" event={"ID":"41273332-1218-4746-ad36-bf662a93a5cf","Type":"ContainerDied","Data":"a58d0c7d9350f7cd819510095be495ba649b6202c84c93bc559c299adf3d239e"}
Jul 22 03:01:45.239371 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:45.239033    2576 scope.go:117] "RemoveContainer" containerID="fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837"
Jul 22 03:01:45.248089 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:45.248071    2576 scope.go:117] "RemoveContainer" containerID="fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837"
Jul 22 03:01:45.248386 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:01:45.248358    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837\": container with ID starting with fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837 not found: ID does not exist" containerID="fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837"
Jul 22 03:01:45.248466 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:45.248411    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837"} err="failed to get container status \"fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837\": rpc error: code = NotFound desc = could not find container \"fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837\": container with ID starting with fdae7958800828cf8ce1761be4129f3e99b79730bf909813f9519b3d71621837 not found: ID does not exist"
Jul 22 03:01:45.264672 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:45.264637    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c688d6fb-pj8vc"]
Jul 22 03:01:45.266459 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:45.266431    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8c688d6fb-pj8vc"]
Jul 22 03:01:46.182198 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:01:46.182164    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41273332-1218-4746-ad36-bf662a93a5cf" path="/var/lib/kubelet/pods/41273332-1218-4746-ad36-bf662a93a5cf/volumes"
Jul 22 03:02:37.020775 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.020693    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-96bqv"]
Jul 22 03:02:37.021228 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.021022    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41273332-1218-4746-ad36-bf662a93a5cf" containerName="console"
Jul 22 03:02:37.021228 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.021038    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="41273332-1218-4746-ad36-bf662a93a5cf" containerName="console"
Jul 22 03:02:37.021228 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.021115    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="41273332-1218-4746-ad36-bf662a93a5cf" containerName="console"
Jul 22 03:02:37.028671 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.028638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-96bqv"
Jul 22 03:02:37.033172 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.033150    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 03:02:37.034009 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.033985    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8ckjt\""
Jul 22 03:02:37.034120 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.033985    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 03:02:37.037483 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.037460    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-96bqv"]
Jul 22 03:02:37.173604 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.173557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blswp\" (UniqueName: \"kubernetes.io/projected/d5b9b3b5-eb95-4870-95e5-d84542dfd0b6-kube-api-access-blswp\") pod \"cert-manager-55b4d954d5-96bqv\" (UID: \"d5b9b3b5-eb95-4870-95e5-d84542dfd0b6\") " pod="cert-manager/cert-manager-55b4d954d5-96bqv"
Jul 22 03:02:37.173785 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.173633    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5b9b3b5-eb95-4870-95e5-d84542dfd0b6-bound-sa-token\") pod \"cert-manager-55b4d954d5-96bqv\" (UID: \"d5b9b3b5-eb95-4870-95e5-d84542dfd0b6\") " pod="cert-manager/cert-manager-55b4d954d5-96bqv"
Jul 22 03:02:37.274941 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.274826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5b9b3b5-eb95-4870-95e5-d84542dfd0b6-bound-sa-token\") pod \"cert-manager-55b4d954d5-96bqv\" (UID: \"d5b9b3b5-eb95-4870-95e5-d84542dfd0b6\") " pod="cert-manager/cert-manager-55b4d954d5-96bqv"
Jul 22 03:02:37.275128 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.275037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blswp\" (UniqueName: \"kubernetes.io/projected/d5b9b3b5-eb95-4870-95e5-d84542dfd0b6-kube-api-access-blswp\") pod \"cert-manager-55b4d954d5-96bqv\" (UID: \"d5b9b3b5-eb95-4870-95e5-d84542dfd0b6\") " pod="cert-manager/cert-manager-55b4d954d5-96bqv"
Jul 22 03:02:37.289369 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.289332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blswp\" (UniqueName: \"kubernetes.io/projected/d5b9b3b5-eb95-4870-95e5-d84542dfd0b6-kube-api-access-blswp\") pod \"cert-manager-55b4d954d5-96bqv\" (UID: \"d5b9b3b5-eb95-4870-95e5-d84542dfd0b6\") " pod="cert-manager/cert-manager-55b4d954d5-96bqv"
Jul 22 03:02:37.289519 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.289383    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5b9b3b5-eb95-4870-95e5-d84542dfd0b6-bound-sa-token\") pod \"cert-manager-55b4d954d5-96bqv\" (UID: \"d5b9b3b5-eb95-4870-95e5-d84542dfd0b6\") " pod="cert-manager/cert-manager-55b4d954d5-96bqv"
Jul 22 03:02:37.337649 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.337611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-96bqv"
Jul 22 03:02:37.474710 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:37.474530    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-96bqv"]
Jul 22 03:02:37.477621 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:02:37.477593    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5b9b3b5_eb95_4870_95e5_d84542dfd0b6.slice/crio-d3149f88c2e0f76169a1662892c149d14205296cd9ed44ff509677cd178fd033 WatchSource:0}: Error finding container d3149f88c2e0f76169a1662892c149d14205296cd9ed44ff509677cd178fd033: Status 404 returned error can't find the container with id d3149f88c2e0f76169a1662892c149d14205296cd9ed44ff509677cd178fd033
Jul 22 03:02:38.425468 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:38.425433    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-96bqv" event={"ID":"d5b9b3b5-eb95-4870-95e5-d84542dfd0b6","Type":"ContainerStarted","Data":"d3149f88c2e0f76169a1662892c149d14205296cd9ed44ff509677cd178fd033"}
Jul 22 03:02:42.444559 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:42.444513    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-96bqv" event={"ID":"d5b9b3b5-eb95-4870-95e5-d84542dfd0b6","Type":"ContainerStarted","Data":"57d9a90f907bf44c796ce02ac0a9d6f811543e88d15317a508f641a5a21ccfe3"}
Jul 22 03:02:42.467935 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:02:42.467879    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-96bqv" podStartSLOduration=2.136769884 podStartE2EDuration="6.467861689s" totalImagesPullingTime="4.331091805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:02:42.465919364 +0000 UTC m=+276.352047506" watchObservedRunningTime="2026-07-22 03:02:42.467861689 +0000 UTC m=+276.353989829"
Jul 22 03:03:02.687590 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.687553    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"]
Jul 22 03:03:02.690815 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.690797    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.694046 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.694024    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 03:03:02.694167 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.694109    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f4xjc\""
Jul 22 03:03:02.694932 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.694907    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 03:03:02.695177 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.695162    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 03:03:02.698168 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.698151    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 03:03:02.727982 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.727951    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"]
Jul 22 03:03:02.776679 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.776638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgxkg\" (UniqueName: \"kubernetes.io/projected/7a51a9ae-66a7-42e4-a786-6053b12476e4-kube-api-access-dgxkg\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.776849 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.776698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a51a9ae-66a7-42e4-a786-6053b12476e4-manifests\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.776849 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.776721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a51a9ae-66a7-42e4-a786-6053b12476e4-tmp\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.776849 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.776751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a51a9ae-66a7-42e4-a786-6053b12476e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.776849 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.776804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a51a9ae-66a7-42e4-a786-6053b12476e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.878001 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.877953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a51a9ae-66a7-42e4-a786-6053b12476e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.878001 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.878007    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a51a9ae-66a7-42e4-a786-6053b12476e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.878158 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.878073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgxkg\" (UniqueName: \"kubernetes.io/projected/7a51a9ae-66a7-42e4-a786-6053b12476e4-kube-api-access-dgxkg\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.878158 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.878103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a51a9ae-66a7-42e4-a786-6053b12476e4-manifests\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.878158 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.878126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a51a9ae-66a7-42e4-a786-6053b12476e4-tmp\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.878593 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.878573    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a51a9ae-66a7-42e4-a786-6053b12476e4-manifests\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.880447 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.880416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a51a9ae-66a7-42e4-a786-6053b12476e4-tmp\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.880669 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.880651    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a51a9ae-66a7-42e4-a786-6053b12476e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.880761 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.880744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a51a9ae-66a7-42e4-a786-6053b12476e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:02.896467 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:02.896440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgxkg\" (UniqueName: \"kubernetes.io/projected/7a51a9ae-66a7-42e4-a786-6053b12476e4-kube-api-access-dgxkg\") pod \"opendatahub-operator-controller-manager-94fc48448-h7qw9\" (UID: \"7a51a9ae-66a7-42e4-a786-6053b12476e4\") " pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:03.001691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:03.001590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:03.148349 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:03.148305    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"]
Jul 22 03:03:03.152690 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:03:03.152661    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a51a9ae_66a7_42e4_a786_6053b12476e4.slice/crio-3cf7621c969f90e0276a992e0865fcd50cacdf562137c86e1bcb0f8db07564a3 WatchSource:0}: Error finding container 3cf7621c969f90e0276a992e0865fcd50cacdf562137c86e1bcb0f8db07564a3: Status 404 returned error can't find the container with id 3cf7621c969f90e0276a992e0865fcd50cacdf562137c86e1bcb0f8db07564a3
Jul 22 03:03:03.518105 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:03.518069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9" event={"ID":"7a51a9ae-66a7-42e4-a786-6053b12476e4","Type":"ContainerStarted","Data":"3cf7621c969f90e0276a992e0865fcd50cacdf562137c86e1bcb0f8db07564a3"}
Jul 22 03:03:06.533269 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:06.533180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9" event={"ID":"7a51a9ae-66a7-42e4-a786-6053b12476e4","Type":"ContainerStarted","Data":"b6447841f228f98a89eb80218f301b2e3abdd55be517363e6d68ae72426e96f3"}
Jul 22 03:03:07.541739 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:07.541704    2576 generic.go:356] "Generic (PLEG): container finished" podID="7a51a9ae-66a7-42e4-a786-6053b12476e4" containerID="b6447841f228f98a89eb80218f301b2e3abdd55be517363e6d68ae72426e96f3" exitCode=0
Jul 22 03:03:07.542137 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:07.541745    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9" event={"ID":"7a51a9ae-66a7-42e4-a786-6053b12476e4","Type":"ContainerDied","Data":"b6447841f228f98a89eb80218f301b2e3abdd55be517363e6d68ae72426e96f3"}
Jul 22 03:03:08.116196 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:08.116125    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 03:03:08.548710 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:08.548666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9" event={"ID":"7a51a9ae-66a7-42e4-a786-6053b12476e4","Type":"ContainerStarted","Data":"0efea3e0e669da0885cf67d9e7c07ca83e177634c465b7d437946c699e2b1333"}
Jul 22 03:03:08.551078 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:08.548794    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:08.585602 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:08.585537    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9" podStartSLOduration=2.072438553 podStartE2EDuration="6.58551581s" totalImagesPullingTime="3.418178406s" totalInitContainerRuntime="1.094898851s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:03:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:03:08.583195915 +0000 UTC m=+302.469324055" watchObservedRunningTime="2026-07-22 03:03:08.58551581 +0000 UTC m=+302.471643951"
Jul 22 03:03:19.555540 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:19.555509    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-94fc48448-h7qw9"
Jul 22 03:03:22.568881 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.568845    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"]
Jul 22 03:03:22.575529 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.575505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:22.578878 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.578850    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 03:03:22.579036 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.579017    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 03:03:22.584107 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.584080    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"]
Jul 22 03:03:22.653789 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.653745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72c42\" (UniqueName: \"kubernetes.io/projected/6725026a-7ba0-47f5-971a-ec5283e697f8-kube-api-access-72c42\") pod \"kube-auth-proxy-684578bfd-h7qhm\" (UID: \"6725026a-7ba0-47f5-971a-ec5283e697f8\") " pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:22.653976 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.653890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6725026a-7ba0-47f5-971a-ec5283e697f8-tmp\") pod \"kube-auth-proxy-684578bfd-h7qhm\" (UID: \"6725026a-7ba0-47f5-971a-ec5283e697f8\") " pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:22.653976 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.653965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6725026a-7ba0-47f5-971a-ec5283e697f8-tls-certs\") pod \"kube-auth-proxy-684578bfd-h7qhm\" (UID: \"6725026a-7ba0-47f5-971a-ec5283e697f8\") " pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:22.754826 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.754789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72c42\" (UniqueName: \"kubernetes.io/projected/6725026a-7ba0-47f5-971a-ec5283e697f8-kube-api-access-72c42\") pod \"kube-auth-proxy-684578bfd-h7qhm\" (UID: \"6725026a-7ba0-47f5-971a-ec5283e697f8\") " pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:22.755025 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.754861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6725026a-7ba0-47f5-971a-ec5283e697f8-tmp\") pod \"kube-auth-proxy-684578bfd-h7qhm\" (UID: \"6725026a-7ba0-47f5-971a-ec5283e697f8\") " pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:22.755025 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.754901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6725026a-7ba0-47f5-971a-ec5283e697f8-tls-certs\") pod \"kube-auth-proxy-684578bfd-h7qhm\" (UID: \"6725026a-7ba0-47f5-971a-ec5283e697f8\") " pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:22.757245 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.757218    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6725026a-7ba0-47f5-971a-ec5283e697f8-tmp\") pod \"kube-auth-proxy-684578bfd-h7qhm\" (UID: \"6725026a-7ba0-47f5-971a-ec5283e697f8\") " pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:22.757513 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.757493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6725026a-7ba0-47f5-971a-ec5283e697f8-tls-certs\") pod \"kube-auth-proxy-684578bfd-h7qhm\" (UID: \"6725026a-7ba0-47f5-971a-ec5283e697f8\") " pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:22.773094 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.773059    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72c42\" (UniqueName: \"kubernetes.io/projected/6725026a-7ba0-47f5-971a-ec5283e697f8-kube-api-access-72c42\") pod \"kube-auth-proxy-684578bfd-h7qhm\" (UID: \"6725026a-7ba0-47f5-971a-ec5283e697f8\") " pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:22.885200 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:22.885113    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"
Jul 22 03:03:23.041487 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:23.041450    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-684578bfd-h7qhm"]
Jul 22 03:03:23.042773 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:03:23.042744    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6725026a_7ba0_47f5_971a_ec5283e697f8.slice/crio-707b00abfce18f44f662eb51abd91d9a1be8ac06b56e3dadb0ef52167b1cbdb7 WatchSource:0}: Error finding container 707b00abfce18f44f662eb51abd91d9a1be8ac06b56e3dadb0ef52167b1cbdb7: Status 404 returned error can't find the container with id 707b00abfce18f44f662eb51abd91d9a1be8ac06b56e3dadb0ef52167b1cbdb7
Jul 22 03:03:23.045293 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:23.045275    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:03:23.606335 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:23.606292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm" event={"ID":"6725026a-7ba0-47f5-971a-ec5283e697f8","Type":"ContainerStarted","Data":"707b00abfce18f44f662eb51abd91d9a1be8ac06b56e3dadb0ef52167b1cbdb7"}
Jul 22 03:03:26.621695 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:26.621653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm" event={"ID":"6725026a-7ba0-47f5-971a-ec5283e697f8","Type":"ContainerStarted","Data":"f349125f33d6c4f6ecf901ceda2cec88696b8ed57d68cb53cf7302669d10cf79"}
Jul 22 03:03:26.640803 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:26.640739    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-684578bfd-h7qhm" podStartSLOduration=1.935439683 podStartE2EDuration="4.640720742s" totalImagesPullingTime="2.705281059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:03:26.639753262 +0000 UTC m=+320.525881407" watchObservedRunningTime="2026-07-22 03:03:26.640720742 +0000 UTC m=+320.526848909"
Jul 22 03:03:30.111004 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.110960    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"]
Jul 22 03:03:30.113876 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.113855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.116529 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.116503    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 03:03:30.116735 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.116720    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wwqtf\""
Jul 22 03:03:30.130767 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.130739    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"]
Jul 22 03:03:30.221778 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.221739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.221778 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.221782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.222006 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.221835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/159ba033-8ef8-410c-a86a-9e001944d4fe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.222006 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.221862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9596\" (UniqueName: \"kubernetes.io/projected/159ba033-8ef8-410c-a86a-9e001944d4fe-kube-api-access-q9596\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.222006 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.221883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.222006 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.221936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.222006 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.221991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.222006 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.222007    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.222212 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.222031    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323022 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.322987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323022 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/159ba033-8ef8-410c-a86a-9e001944d4fe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9596\" (UniqueName: \"kubernetes.io/projected/159ba033-8ef8-410c-a86a-9e001944d4fe-kube-api-access-q9596\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323701 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323760 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323820 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.323820 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.323804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.324039 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.324022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/159ba033-8ef8-410c-a86a-9e001944d4fe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.325551 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.325528    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.325661 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.325594    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.338047 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.338012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9596\" (UniqueName: \"kubernetes.io/projected/159ba033-8ef8-410c-a86a-9e001944d4fe-kube-api-access-q9596\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.339286 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.339261    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/159ba033-8ef8-410c-a86a-9e001944d4fe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dvd6c\" (UID: \"159ba033-8ef8-410c-a86a-9e001944d4fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.424281 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.424241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:30.595100 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.595073    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"]
Jul 22 03:03:30.596220 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:03:30.596197    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159ba033_8ef8_410c_a86a_9e001944d4fe.slice/crio-840ef920fe66a31b6f348d36b9c3859256cee5963523796ab7abe4c2d7cc0d4e WatchSource:0}: Error finding container 840ef920fe66a31b6f348d36b9c3859256cee5963523796ab7abe4c2d7cc0d4e: Status 404 returned error can't find the container with id 840ef920fe66a31b6f348d36b9c3859256cee5963523796ab7abe4c2d7cc0d4e
Jul 22 03:03:30.638641 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:30.638607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c" event={"ID":"159ba033-8ef8-410c-a86a-9e001944d4fe","Type":"ContainerStarted","Data":"840ef920fe66a31b6f348d36b9c3859256cee5963523796ab7abe4c2d7cc0d4e"}
Jul 22 03:03:32.560864 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.560828    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"]
Jul 22 03:03:32.568008 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.567976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.573732 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.573703    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 03:03:32.573882 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.573837    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 03:03:32.573882 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.573852    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-f8ldd\""
Jul 22 03:03:32.573990 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.573926    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:03:32.574043 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.573986    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 03:03:32.577192 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.577171    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 03:03:32.629508 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.629465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"]
Jul 22 03:03:32.643150 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.643121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr5wt\" (UniqueName: \"kubernetes.io/projected/4b914323-4bea-473a-960d-d48c6d546db8-kube-api-access-zr5wt\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.643340 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.643171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b914323-4bea-473a-960d-d48c6d546db8-metrics-cert\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.643340 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.643256    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b914323-4bea-473a-960d-d48c6d546db8-cert\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.643501 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.643336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b914323-4bea-473a-960d-d48c6d546db8-manager-config\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.744372 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.744334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b914323-4bea-473a-960d-d48c6d546db8-cert\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.744595 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.744393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b914323-4bea-473a-960d-d48c6d546db8-manager-config\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.744595 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.744473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr5wt\" (UniqueName: \"kubernetes.io/projected/4b914323-4bea-473a-960d-d48c6d546db8-kube-api-access-zr5wt\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.744595 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.744509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b914323-4bea-473a-960d-d48c6d546db8-metrics-cert\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.745333 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.745310    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b914323-4bea-473a-960d-d48c6d546db8-manager-config\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.747323 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.747300    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b914323-4bea-473a-960d-d48c6d546db8-cert\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.747446 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.747392    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b914323-4bea-473a-960d-d48c6d546db8-metrics-cert\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.754264 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.754225    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr5wt\" (UniqueName: \"kubernetes.io/projected/4b914323-4bea-473a-960d-d48c6d546db8-kube-api-access-zr5wt\") pod \"lws-controller-manager-58c8df6b5b-7r5bs\" (UID: \"4b914323-4bea-473a-960d-d48c6d546db8\") " pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:32.879134 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:32.879045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:33.167752 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:33.167710    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:03:33.167873 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:33.167808    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:03:33.167873 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:33.167857    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:03:33.278611 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:33.278573    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"]
Jul 22 03:03:33.282283 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:03:33.282255    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b914323_4bea_473a_960d_d48c6d546db8.slice/crio-d9e29d7f1843d46403e274b7e5647cbe114e3bc48d3cda67da273b21fd812867 WatchSource:0}: Error finding container d9e29d7f1843d46403e274b7e5647cbe114e3bc48d3cda67da273b21fd812867: Status 404 returned error can't find the container with id d9e29d7f1843d46403e274b7e5647cbe114e3bc48d3cda67da273b21fd812867
Jul 22 03:03:33.658246 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:33.658202    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs" event={"ID":"4b914323-4bea-473a-960d-d48c6d546db8","Type":"ContainerStarted","Data":"d9e29d7f1843d46403e274b7e5647cbe114e3bc48d3cda67da273b21fd812867"}
Jul 22 03:03:33.659585 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:33.659560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c" event={"ID":"159ba033-8ef8-410c-a86a-9e001944d4fe","Type":"ContainerStarted","Data":"8654cbbb706663a09b7cf4af6ad15c18ce32058c357631879f81adeb11b567d2"}
Jul 22 03:03:33.708940 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:33.708881    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c" podStartSLOduration=1.139923289 podStartE2EDuration="3.708863176s" totalImagesPullingTime="2.568939887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:03:33.705094963 +0000 UTC m=+327.591223104" watchObservedRunningTime="2026-07-22 03:03:33.708863176 +0000 UTC m=+327.594991315"
Jul 22 03:03:34.425144 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:34.425103    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:34.431016 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:34.430991    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:34.663963 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:34.663926    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:34.665064 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:34.665038    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dvd6c"
Jul 22 03:03:36.673730 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:36.673693    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs" event={"ID":"4b914323-4bea-473a-960d-d48c6d546db8","Type":"ContainerStarted","Data":"5d6554c059093aa7b3cc748fa6d28af525dfe504346df19609e80edf39f05efc"}
Jul 22 03:03:36.674130 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:36.673772    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:03:36.694108 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:36.694055    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs" podStartSLOduration=1.631028416 podStartE2EDuration="4.694037535s" totalImagesPullingTime="3.063009119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:03:36.693068177 +0000 UTC m=+330.579196315" watchObservedRunningTime="2026-07-22 03:03:36.694037535 +0000 UTC m=+330.580165675"
Jul 22 03:03:47.680232 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:03:47.680148    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58c8df6b5b-7r5bs"
Jul 22 03:05:56.356983 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.356944    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-76xkf"]
Jul 22 03:05:56.360254 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.360232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-76xkf"
Jul 22 03:05:56.363723 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.363686    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gsr6f\""
Jul 22 03:05:56.363975 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.363960    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 03:05:56.364442 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.364425    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 03:05:56.368994 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.368969    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-76xkf"]
Jul 22 03:05:56.437675 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.437638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv7dw\" (UniqueName: \"kubernetes.io/projected/aeca5aee-48e9-4e84-8f04-e2467c22b7d5-kube-api-access-bv7dw\") pod \"authorino-58cd955675-76xkf\" (UID: \"aeca5aee-48e9-4e84-8f04-e2467c22b7d5\") " pod="kuadrant-system/authorino-58cd955675-76xkf"
Jul 22 03:05:56.538421 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.538369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7dw\" (UniqueName: \"kubernetes.io/projected/aeca5aee-48e9-4e84-8f04-e2467c22b7d5-kube-api-access-bv7dw\") pod \"authorino-58cd955675-76xkf\" (UID: \"aeca5aee-48e9-4e84-8f04-e2467c22b7d5\") " pod="kuadrant-system/authorino-58cd955675-76xkf"
Jul 22 03:05:56.553935 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.553902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv7dw\" (UniqueName: \"kubernetes.io/projected/aeca5aee-48e9-4e84-8f04-e2467c22b7d5-kube-api-access-bv7dw\") pod \"authorino-58cd955675-76xkf\" (UID: \"aeca5aee-48e9-4e84-8f04-e2467c22b7d5\") " pod="kuadrant-system/authorino-58cd955675-76xkf"
Jul 22 03:05:56.633583 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.633503    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2zqpm"]
Jul 22 03:05:56.636662 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.636641    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2zqpm"
Jul 22 03:05:56.645607 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.645574    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2zqpm"]
Jul 22 03:05:56.670098 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.670068    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-76xkf"
Jul 22 03:05:56.740446 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.740410    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srj9p\" (UniqueName: \"kubernetes.io/projected/45fa4c88-733e-4d3e-9127-de8924822944-kube-api-access-srj9p\") pod \"authorino-75d556bd77-2zqpm\" (UID: \"45fa4c88-733e-4d3e-9127-de8924822944\") " pod="kuadrant-system/authorino-75d556bd77-2zqpm"
Jul 22 03:05:56.802985 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.802861    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-76xkf"]
Jul 22 03:05:56.805679 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:05:56.805644    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeca5aee_48e9_4e84_8f04_e2467c22b7d5.slice/crio-d1489d5c4a96d295cbad1f47bede933fa8eb943c9c13ca8b6e10ee43219e6f02 WatchSource:0}: Error finding container d1489d5c4a96d295cbad1f47bede933fa8eb943c9c13ca8b6e10ee43219e6f02: Status 404 returned error can't find the container with id d1489d5c4a96d295cbad1f47bede933fa8eb943c9c13ca8b6e10ee43219e6f02
Jul 22 03:05:56.841124 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.841077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srj9p\" (UniqueName: \"kubernetes.io/projected/45fa4c88-733e-4d3e-9127-de8924822944-kube-api-access-srj9p\") pod \"authorino-75d556bd77-2zqpm\" (UID: \"45fa4c88-733e-4d3e-9127-de8924822944\") " pod="kuadrant-system/authorino-75d556bd77-2zqpm"
Jul 22 03:05:56.850856 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.850827    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srj9p\" (UniqueName: \"kubernetes.io/projected/45fa4c88-733e-4d3e-9127-de8924822944-kube-api-access-srj9p\") pod \"authorino-75d556bd77-2zqpm\" (UID: \"45fa4c88-733e-4d3e-9127-de8924822944\") " pod="kuadrant-system/authorino-75d556bd77-2zqpm"
Jul 22 03:05:56.946497 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:56.946452    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2zqpm"
Jul 22 03:05:57.086470 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:57.086444    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2zqpm"]
Jul 22 03:05:57.252728 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:57.252635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2zqpm" event={"ID":"45fa4c88-733e-4d3e-9127-de8924822944","Type":"ContainerStarted","Data":"4119eee0f27e75ea63f523b8b53ee8da0afe083cea759498d5fe179137367079"}
Jul 22 03:05:57.253689 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:05:57.253665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-76xkf" event={"ID":"aeca5aee-48e9-4e84-8f04-e2467c22b7d5","Type":"ContainerStarted","Data":"d1489d5c4a96d295cbad1f47bede933fa8eb943c9c13ca8b6e10ee43219e6f02"}
Jul 22 03:06:01.281971 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:01.281929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2zqpm" event={"ID":"45fa4c88-733e-4d3e-9127-de8924822944","Type":"ContainerStarted","Data":"3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3"}
Jul 22 03:06:01.284257 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:01.284216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-76xkf" event={"ID":"aeca5aee-48e9-4e84-8f04-e2467c22b7d5","Type":"ContainerStarted","Data":"ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7"}
Jul 22 03:06:01.303301 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:01.303243    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2zqpm" podStartSLOduration=2.030364842 podStartE2EDuration="5.303226199s" totalImagesPullingTime="3.272861357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:06:01.301622606 +0000 UTC m=+475.187750743" watchObservedRunningTime="2026-07-22 03:06:01.303226199 +0000 UTC m=+475.189354339"
Jul 22 03:06:01.323245 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:01.323190    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-76xkf" podStartSLOduration=1.775954163 podStartE2EDuration="5.323172266s" totalImagesPullingTime="3.547218103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:06:01.323038005 +0000 UTC m=+475.209166146" watchObservedRunningTime="2026-07-22 03:06:01.323172266 +0000 UTC m=+475.209300406"
Jul 22 03:06:01.336044 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:01.336011    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-76xkf"]
Jul 22 03:06:03.294112 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:03.294075    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-76xkf" podUID="aeca5aee-48e9-4e84-8f04-e2467c22b7d5" containerName="authorino" containerID="cri-o://ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7" gracePeriod=30
Jul 22 03:06:03.545746 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:03.545685    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-76xkf"
Jul 22 03:06:03.604196 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:03.604158    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv7dw\" (UniqueName: \"kubernetes.io/projected/aeca5aee-48e9-4e84-8f04-e2467c22b7d5-kube-api-access-bv7dw\") pod \"aeca5aee-48e9-4e84-8f04-e2467c22b7d5\" (UID: \"aeca5aee-48e9-4e84-8f04-e2467c22b7d5\") "
Jul 22 03:06:03.606408 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:03.606372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeca5aee-48e9-4e84-8f04-e2467c22b7d5-kube-api-access-bv7dw" (OuterVolumeSpecName: "kube-api-access-bv7dw") pod "aeca5aee-48e9-4e84-8f04-e2467c22b7d5" (UID: "aeca5aee-48e9-4e84-8f04-e2467c22b7d5"). InnerVolumeSpecName "kube-api-access-bv7dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:06:03.708681 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:03.708639    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv7dw\" (UniqueName: \"kubernetes.io/projected/aeca5aee-48e9-4e84-8f04-e2467c22b7d5-kube-api-access-bv7dw\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:04.299287 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:04.299252    2576 generic.go:356] "Generic (PLEG): container finished" podID="aeca5aee-48e9-4e84-8f04-e2467c22b7d5" containerID="ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7" exitCode=0
Jul 22 03:06:04.299758 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:04.299307    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-76xkf"
Jul 22 03:06:04.299758 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:04.299323    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-76xkf" event={"ID":"aeca5aee-48e9-4e84-8f04-e2467c22b7d5","Type":"ContainerDied","Data":"ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7"}
Jul 22 03:06:04.299758 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:04.299355    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-76xkf" event={"ID":"aeca5aee-48e9-4e84-8f04-e2467c22b7d5","Type":"ContainerDied","Data":"d1489d5c4a96d295cbad1f47bede933fa8eb943c9c13ca8b6e10ee43219e6f02"}
Jul 22 03:06:04.299758 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:04.299377    2576 scope.go:117] "RemoveContainer" containerID="ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7"
Jul 22 03:06:04.307805 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:04.307783    2576 scope.go:117] "RemoveContainer" containerID="ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7"
Jul 22 03:06:04.308058 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:06:04.308032    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7\": container with ID starting with ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7 not found: ID does not exist" containerID="ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7"
Jul 22 03:06:04.308107 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:04.308058    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7"} err="failed to get container status \"ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7\": rpc error: code = NotFound desc = could not find container \"ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7\": container with ID starting with ca49a2d504862ade72ed73a9f9e3564dc48143a24ee28ec185e54012385a6fc7 not found: ID does not exist"
Jul 22 03:06:04.316709 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:04.316685    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-76xkf"]
Jul 22 03:06:04.318420 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:04.318382    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-76xkf"]
Jul 22 03:06:06.183116 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:06.183074    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeca5aee-48e9-4e84-8f04-e2467c22b7d5" path="/var/lib/kubelet/pods/aeca5aee-48e9-4e84-8f04-e2467c22b7d5/volumes"
Jul 22 03:06:19.752462 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:19.752424    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789bcfb6b8-9449t"]
Jul 22 03:06:27.340312 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.340271    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhtmn"]
Jul 22 03:06:27.340734 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.340609    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeca5aee-48e9-4e84-8f04-e2467c22b7d5" containerName="authorino"
Jul 22 03:06:27.340734 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.340622    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeca5aee-48e9-4e84-8f04-e2467c22b7d5" containerName="authorino"
Jul 22 03:06:27.340734 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.340685    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeca5aee-48e9-4e84-8f04-e2467c22b7d5" containerName="authorino"
Jul 22 03:06:27.344891 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.344872    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zhtmn"
Jul 22 03:06:27.352772 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.352746    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhtmn"]
Jul 22 03:06:27.517767 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.517735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqpg9\" (UniqueName: \"kubernetes.io/projected/2d939eb8-2c71-445e-977d-25025e30a98d-kube-api-access-rqpg9\") pod \"authorino-5d4b67c446-zhtmn\" (UID: \"2d939eb8-2c71-445e-977d-25025e30a98d\") " pod="kuadrant-system/authorino-5d4b67c446-zhtmn"
Jul 22 03:06:27.535913 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.535883    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhtmn"]
Jul 22 03:06:27.536149 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:06:27.536130    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rqpg9], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-zhtmn" podUID="2d939eb8-2c71-445e-977d-25025e30a98d"
Jul 22 03:06:27.567135 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.567095    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-npjh4"]
Jul 22 03:06:27.570335 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.570318    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-npjh4"
Jul 22 03:06:27.572975 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.572950    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 22 03:06:27.581312 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.581286    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-npjh4"]
Jul 22 03:06:27.618356 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.618276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqpg9\" (UniqueName: \"kubernetes.io/projected/2d939eb8-2c71-445e-977d-25025e30a98d-kube-api-access-rqpg9\") pod \"authorino-5d4b67c446-zhtmn\" (UID: \"2d939eb8-2c71-445e-977d-25025e30a98d\") " pod="kuadrant-system/authorino-5d4b67c446-zhtmn"
Jul 22 03:06:27.621811 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.621768    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-npjh4"]
Jul 22 03:06:27.622031 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:06:27.622011    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-t7x4m tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-t7x4m tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-npjh4" podUID="d2ec6136-7327-4814-b80d-c30374801283"
Jul 22 03:06:27.627068 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.627034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqpg9\" (UniqueName: \"kubernetes.io/projected/2d939eb8-2c71-445e-977d-25025e30a98d-kube-api-access-rqpg9\") pod \"authorino-5d4b67c446-zhtmn\" (UID: \"2d939eb8-2c71-445e-977d-25025e30a98d\") " pod="kuadrant-system/authorino-5d4b67c446-zhtmn"
Jul 22 03:06:27.656674 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.656645    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d964f9c68-5h7c5"]
Jul 22 03:06:27.659891 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.659874    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d964f9c68-5h7c5"
Jul 22 03:06:27.669489 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.669463    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d964f9c68-5h7c5"]
Jul 22 03:06:27.719022 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.718981    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2ec6136-7327-4814-b80d-c30374801283-tls-cert\") pod \"authorino-76877994-npjh4\" (UID: \"d2ec6136-7327-4814-b80d-c30374801283\") " pod="kuadrant-system/authorino-76877994-npjh4"
Jul 22 03:06:27.719191 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.719071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7x4m\" (UniqueName: \"kubernetes.io/projected/d2ec6136-7327-4814-b80d-c30374801283-kube-api-access-t7x4m\") pod \"authorino-76877994-npjh4\" (UID: \"d2ec6136-7327-4814-b80d-c30374801283\") " pod="kuadrant-system/authorino-76877994-npjh4"
Jul 22 03:06:27.820391 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.820350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7x4m\" (UniqueName: \"kubernetes.io/projected/d2ec6136-7327-4814-b80d-c30374801283-kube-api-access-t7x4m\") pod \"authorino-76877994-npjh4\" (UID: \"d2ec6136-7327-4814-b80d-c30374801283\") " pod="kuadrant-system/authorino-76877994-npjh4"
Jul 22 03:06:27.820391 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.820388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c4lt\" (UniqueName: \"kubernetes.io/projected/fb63874c-d6c9-4671-92b3-b12ccb400284-kube-api-access-9c4lt\") pod \"authorino-d964f9c68-5h7c5\" (UID: \"fb63874c-d6c9-4671-92b3-b12ccb400284\") " pod="kuadrant-system/authorino-d964f9c68-5h7c5"
Jul 22 03:06:27.820693 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.820453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb63874c-d6c9-4671-92b3-b12ccb400284-tls-cert\") pod \"authorino-d964f9c68-5h7c5\" (UID: \"fb63874c-d6c9-4671-92b3-b12ccb400284\") " pod="kuadrant-system/authorino-d964f9c68-5h7c5"
Jul 22 03:06:27.820693 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.820563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2ec6136-7327-4814-b80d-c30374801283-tls-cert\") pod \"authorino-76877994-npjh4\" (UID: \"d2ec6136-7327-4814-b80d-c30374801283\") " pod="kuadrant-system/authorino-76877994-npjh4"
Jul 22 03:06:27.823052 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.823032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2ec6136-7327-4814-b80d-c30374801283-tls-cert\") pod \"authorino-76877994-npjh4\" (UID: \"d2ec6136-7327-4814-b80d-c30374801283\") " pod="kuadrant-system/authorino-76877994-npjh4"
Jul 22 03:06:27.829673 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.829652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7x4m\" (UniqueName: \"kubernetes.io/projected/d2ec6136-7327-4814-b80d-c30374801283-kube-api-access-t7x4m\") pod \"authorino-76877994-npjh4\" (UID: \"d2ec6136-7327-4814-b80d-c30374801283\") " pod="kuadrant-system/authorino-76877994-npjh4"
Jul 22 03:06:27.921583 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.921545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c4lt\" (UniqueName: \"kubernetes.io/projected/fb63874c-d6c9-4671-92b3-b12ccb400284-kube-api-access-9c4lt\") pod \"authorino-d964f9c68-5h7c5\" (UID: \"fb63874c-d6c9-4671-92b3-b12ccb400284\") " pod="kuadrant-system/authorino-d964f9c68-5h7c5"
Jul 22 03:06:27.921752 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.921598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb63874c-d6c9-4671-92b3-b12ccb400284-tls-cert\") pod \"authorino-d964f9c68-5h7c5\" (UID: \"fb63874c-d6c9-4671-92b3-b12ccb400284\") " pod="kuadrant-system/authorino-d964f9c68-5h7c5"
Jul 22 03:06:27.923978 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.923954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb63874c-d6c9-4671-92b3-b12ccb400284-tls-cert\") pod \"authorino-d964f9c68-5h7c5\" (UID: \"fb63874c-d6c9-4671-92b3-b12ccb400284\") " pod="kuadrant-system/authorino-d964f9c68-5h7c5"
Jul 22 03:06:27.929669 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.929643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c4lt\" (UniqueName: \"kubernetes.io/projected/fb63874c-d6c9-4671-92b3-b12ccb400284-kube-api-access-9c4lt\") pod \"authorino-d964f9c68-5h7c5\" (UID: \"fb63874c-d6c9-4671-92b3-b12ccb400284\") " pod="kuadrant-system/authorino-d964f9c68-5h7c5"
Jul 22 03:06:27.969560 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:27.969521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d964f9c68-5h7c5"
Jul 22 03:06:28.102103 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.102067    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d964f9c68-5h7c5"]
Jul 22 03:06:28.104977 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:06:28.104944    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb63874c_d6c9_4671_92b3_b12ccb400284.slice/crio-db74d1dbefd905b0c1cf0786b35d79f2221c2f2021b21960632612fe89c3ff62 WatchSource:0}: Error finding container db74d1dbefd905b0c1cf0786b35d79f2221c2f2021b21960632612fe89c3ff62: Status 404 returned error can't find the container with id db74d1dbefd905b0c1cf0786b35d79f2221c2f2021b21960632612fe89c3ff62
Jul 22 03:06:28.410470 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.410430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d964f9c68-5h7c5" event={"ID":"fb63874c-d6c9-4671-92b3-b12ccb400284","Type":"ContainerStarted","Data":"db74d1dbefd905b0c1cf0786b35d79f2221c2f2021b21960632612fe89c3ff62"}
Jul 22 03:06:28.410470 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.410475    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-npjh4"
Jul 22 03:06:28.410901 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.410476    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zhtmn"
Jul 22 03:06:28.418568 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.418548    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-npjh4"
Jul 22 03:06:28.420663 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.420647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zhtmn"
Jul 22 03:06:28.527187 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.527152    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7x4m\" (UniqueName: \"kubernetes.io/projected/d2ec6136-7327-4814-b80d-c30374801283-kube-api-access-t7x4m\") pod \"d2ec6136-7327-4814-b80d-c30374801283\" (UID: \"d2ec6136-7327-4814-b80d-c30374801283\") "
Jul 22 03:06:28.527362 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.527203    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqpg9\" (UniqueName: \"kubernetes.io/projected/2d939eb8-2c71-445e-977d-25025e30a98d-kube-api-access-rqpg9\") pod \"2d939eb8-2c71-445e-977d-25025e30a98d\" (UID: \"2d939eb8-2c71-445e-977d-25025e30a98d\") "
Jul 22 03:06:28.527362 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.527231    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2ec6136-7327-4814-b80d-c30374801283-tls-cert\") pod \"d2ec6136-7327-4814-b80d-c30374801283\" (UID: \"d2ec6136-7327-4814-b80d-c30374801283\") "
Jul 22 03:06:28.529411 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.529367    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d939eb8-2c71-445e-977d-25025e30a98d-kube-api-access-rqpg9" (OuterVolumeSpecName: "kube-api-access-rqpg9") pod "2d939eb8-2c71-445e-977d-25025e30a98d" (UID: "2d939eb8-2c71-445e-977d-25025e30a98d"). InnerVolumeSpecName "kube-api-access-rqpg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:06:28.529535 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.529372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ec6136-7327-4814-b80d-c30374801283-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d2ec6136-7327-4814-b80d-c30374801283" (UID: "d2ec6136-7327-4814-b80d-c30374801283"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:06:28.529535 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.529439    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ec6136-7327-4814-b80d-c30374801283-kube-api-access-t7x4m" (OuterVolumeSpecName: "kube-api-access-t7x4m") pod "d2ec6136-7327-4814-b80d-c30374801283" (UID: "d2ec6136-7327-4814-b80d-c30374801283"). InnerVolumeSpecName "kube-api-access-t7x4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:06:28.628674 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.628638    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7x4m\" (UniqueName: \"kubernetes.io/projected/d2ec6136-7327-4814-b80d-c30374801283-kube-api-access-t7x4m\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:28.628674 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.628667    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqpg9\" (UniqueName: \"kubernetes.io/projected/2d939eb8-2c71-445e-977d-25025e30a98d-kube-api-access-rqpg9\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:28.628674 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:28.628676    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2ec6136-7327-4814-b80d-c30374801283-tls-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:29.416042 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.415998    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d964f9c68-5h7c5" event={"ID":"fb63874c-d6c9-4671-92b3-b12ccb400284","Type":"ContainerStarted","Data":"b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856"}
Jul 22 03:06:29.416481 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.416100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-npjh4"
Jul 22 03:06:29.416481 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.416211    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zhtmn"
Jul 22 03:06:29.451975 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.448363    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d964f9c68-5h7c5" podStartSLOduration=1.8671685679999999 podStartE2EDuration="2.448336436s" totalImagesPullingTime="581.167868ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:06:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:06:29.446485008 +0000 UTC m=+503.332613148" watchObservedRunningTime="2026-07-22 03:06:29.448336436 +0000 UTC m=+503.334464580"
Jul 22 03:06:29.497458 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.497369    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2zqpm"]
Jul 22 03:06:29.497651 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.497623    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2zqpm" podUID="45fa4c88-733e-4d3e-9127-de8924822944" containerName="authorino" containerID="cri-o://3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3" gracePeriod=30
Jul 22 03:06:29.509623 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.509591    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-npjh4"]
Jul 22 03:06:29.517335 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.517304    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-npjh4"]
Jul 22 03:06:29.544746 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.544710    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhtmn"]
Jul 22 03:06:29.548013 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.547984    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zhtmn"]
Jul 22 03:06:29.743018 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.742990    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2zqpm"
Jul 22 03:06:29.839335 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.839301    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srj9p\" (UniqueName: \"kubernetes.io/projected/45fa4c88-733e-4d3e-9127-de8924822944-kube-api-access-srj9p\") pod \"45fa4c88-733e-4d3e-9127-de8924822944\" (UID: \"45fa4c88-733e-4d3e-9127-de8924822944\") "
Jul 22 03:06:29.841416 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.841371    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45fa4c88-733e-4d3e-9127-de8924822944-kube-api-access-srj9p" (OuterVolumeSpecName: "kube-api-access-srj9p") pod "45fa4c88-733e-4d3e-9127-de8924822944" (UID: "45fa4c88-733e-4d3e-9127-de8924822944"). InnerVolumeSpecName "kube-api-access-srj9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:06:29.940594 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:29.940499    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srj9p\" (UniqueName: \"kubernetes.io/projected/45fa4c88-733e-4d3e-9127-de8924822944-kube-api-access-srj9p\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:30.183409 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.183364    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d939eb8-2c71-445e-977d-25025e30a98d" path="/var/lib/kubelet/pods/2d939eb8-2c71-445e-977d-25025e30a98d/volumes"
Jul 22 03:06:30.183667 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.183654    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2ec6136-7327-4814-b80d-c30374801283" path="/var/lib/kubelet/pods/d2ec6136-7327-4814-b80d-c30374801283/volumes"
Jul 22 03:06:30.420918 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.420879    2576 generic.go:356] "Generic (PLEG): container finished" podID="45fa4c88-733e-4d3e-9127-de8924822944" containerID="3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3" exitCode=0
Jul 22 03:06:30.420918 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.420920    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2zqpm"
Jul 22 03:06:30.421448 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.420964    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2zqpm" event={"ID":"45fa4c88-733e-4d3e-9127-de8924822944","Type":"ContainerDied","Data":"3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3"}
Jul 22 03:06:30.421448 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.421006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2zqpm" event={"ID":"45fa4c88-733e-4d3e-9127-de8924822944","Type":"ContainerDied","Data":"4119eee0f27e75ea63f523b8b53ee8da0afe083cea759498d5fe179137367079"}
Jul 22 03:06:30.421448 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.421024    2576 scope.go:117] "RemoveContainer" containerID="3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3"
Jul 22 03:06:30.429318 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.429302    2576 scope.go:117] "RemoveContainer" containerID="3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3"
Jul 22 03:06:30.429605 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:06:30.429585    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3\": container with ID starting with 3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3 not found: ID does not exist" containerID="3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3"
Jul 22 03:06:30.429699 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.429611    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3"} err="failed to get container status \"3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3\": rpc error: code = NotFound desc = could not find container \"3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3\": container with ID starting with 3e556f827bec05f83316b2a357ef0140076470415e65a82b59ab2b4c450c16e3 not found: ID does not exist"
Jul 22 03:06:30.437114 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.437090    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2zqpm"]
Jul 22 03:06:30.442141 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:30.442091    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2zqpm"]
Jul 22 03:06:32.183294 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:32.183262    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45fa4c88-733e-4d3e-9127-de8924822944" path="/var/lib/kubelet/pods/45fa4c88-733e-4d3e-9127-de8924822944/volumes"
Jul 22 03:06:44.774574 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:44.774515    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-789bcfb6b8-9449t" podUID="3258ab6b-01dd-4ef4-a13a-4a85828222a2" containerName="console" containerID="cri-o://b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875" gracePeriod=15
Jul 22 03:06:45.014715 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.014688    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:06:45.068786 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.068691    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-trusted-ca-bundle\") pod \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") "
Jul 22 03:06:45.068786 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.068729    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-serving-cert\") pod \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") "
Jul 22 03:06:45.068786 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.068786    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-oauth-serving-cert\") pod \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") "
Jul 22 03:06:45.069029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.068809    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-service-ca\") pod \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") "
Jul 22 03:06:45.069029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.068855    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgssm\" (UniqueName: \"kubernetes.io/projected/3258ab6b-01dd-4ef4-a13a-4a85828222a2-kube-api-access-rgssm\") pod \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") "
Jul 22 03:06:45.069029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.068920    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-oauth-config\") pod \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") "
Jul 22 03:06:45.069029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.068952    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-config\") pod \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\" (UID: \"3258ab6b-01dd-4ef4-a13a-4a85828222a2\") "
Jul 22 03:06:45.069216 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.069197    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3258ab6b-01dd-4ef4-a13a-4a85828222a2" (UID: "3258ab6b-01dd-4ef4-a13a-4a85828222a2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:06:45.069325 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.069295    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-service-ca" (OuterVolumeSpecName: "service-ca") pod "3258ab6b-01dd-4ef4-a13a-4a85828222a2" (UID: "3258ab6b-01dd-4ef4-a13a-4a85828222a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:06:45.069433 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.069238    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3258ab6b-01dd-4ef4-a13a-4a85828222a2" (UID: "3258ab6b-01dd-4ef4-a13a-4a85828222a2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:06:45.069497 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.069451    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-config" (OuterVolumeSpecName: "console-config") pod "3258ab6b-01dd-4ef4-a13a-4a85828222a2" (UID: "3258ab6b-01dd-4ef4-a13a-4a85828222a2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:06:45.071108 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.071081    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3258ab6b-01dd-4ef4-a13a-4a85828222a2" (UID: "3258ab6b-01dd-4ef4-a13a-4a85828222a2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:06:45.071230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.071201    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3258ab6b-01dd-4ef4-a13a-4a85828222a2" (UID: "3258ab6b-01dd-4ef4-a13a-4a85828222a2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:06:45.071279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.071240    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3258ab6b-01dd-4ef4-a13a-4a85828222a2-kube-api-access-rgssm" (OuterVolumeSpecName: "kube-api-access-rgssm") pod "3258ab6b-01dd-4ef4-a13a-4a85828222a2" (UID: "3258ab6b-01dd-4ef4-a13a-4a85828222a2"). InnerVolumeSpecName "kube-api-access-rgssm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:06:45.170099 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.170060    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-oauth-config\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:45.170099 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.170096    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-config\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:45.170099 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.170107    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-trusted-ca-bundle\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:45.170352 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.170116    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3258ab6b-01dd-4ef4-a13a-4a85828222a2-console-serving-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:45.170352 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.170125    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-oauth-serving-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:45.170352 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.170134    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3258ab6b-01dd-4ef4-a13a-4a85828222a2-service-ca\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:45.170352 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.170142    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgssm\" (UniqueName: \"kubernetes.io/projected/3258ab6b-01dd-4ef4-a13a-4a85828222a2-kube-api-access-rgssm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:06:45.483624 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.483587    2576 generic.go:356] "Generic (PLEG): container finished" podID="3258ab6b-01dd-4ef4-a13a-4a85828222a2" containerID="b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875" exitCode=0
Jul 22 03:06:45.483804 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.483642    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789bcfb6b8-9449t"
Jul 22 03:06:45.483804 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.483681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789bcfb6b8-9449t" event={"ID":"3258ab6b-01dd-4ef4-a13a-4a85828222a2","Type":"ContainerDied","Data":"b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875"}
Jul 22 03:06:45.483804 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.483736    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789bcfb6b8-9449t" event={"ID":"3258ab6b-01dd-4ef4-a13a-4a85828222a2","Type":"ContainerDied","Data":"27a4b98d7abdef6ba01df3c95e26013c03d80bc7f24ffcfde2d74f00e2c9430b"}
Jul 22 03:06:45.483804 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.483757    2576 scope.go:117] "RemoveContainer" containerID="b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875"
Jul 22 03:06:45.492382 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.492361    2576 scope.go:117] "RemoveContainer" containerID="b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875"
Jul 22 03:06:45.492666 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:06:45.492648    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875\": container with ID starting with b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875 not found: ID does not exist" containerID="b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875"
Jul 22 03:06:45.492736 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.492674    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875"} err="failed to get container status \"b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875\": rpc error: code = NotFound desc = could not find container \"b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875\": container with ID starting with b880199306e1a2b371239b561650e94699b11b670894ac3585060b508948e875 not found: ID does not exist"
Jul 22 03:06:45.506107 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.506075    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789bcfb6b8-9449t"]
Jul 22 03:06:45.511041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:45.511017    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789bcfb6b8-9449t"]
Jul 22 03:06:46.182640 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:06:46.182605    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3258ab6b-01dd-4ef4-a13a-4a85828222a2" path="/var/lib/kubelet/pods/3258ab6b-01dd-4ef4-a13a-4a85828222a2/volumes"
Jul 22 03:07:29.118161 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.118129    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"]
Jul 22 03:07:29.118606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.118428    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3258ab6b-01dd-4ef4-a13a-4a85828222a2" containerName="console"
Jul 22 03:07:29.118606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.118440    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3258ab6b-01dd-4ef4-a13a-4a85828222a2" containerName="console"
Jul 22 03:07:29.118606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.118454    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45fa4c88-733e-4d3e-9127-de8924822944" containerName="authorino"
Jul 22 03:07:29.118606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.118459    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45fa4c88-733e-4d3e-9127-de8924822944" containerName="authorino"
Jul 22 03:07:29.118606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.118508    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="45fa4c88-733e-4d3e-9127-de8924822944" containerName="authorino"
Jul 22 03:07:29.118606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.118516    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3258ab6b-01dd-4ef4-a13a-4a85828222a2" containerName="console"
Jul 22 03:07:29.122614 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.122595    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.126122 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.126096    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 03:07:29.126278 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.126172    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hkxsv\""
Jul 22 03:07:29.126278 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.126096    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 22 03:07:29.126278 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.126221    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 03:07:29.131895 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.131869    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"]
Jul 22 03:07:29.240021 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.239975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.240021 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.240026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0ef08df-96a7-4454-b9da-b5c08c185412-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.240282 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.240096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.240282 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.240126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.240282 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.240163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7fp5\" (UniqueName: \"kubernetes.io/projected/d0ef08df-96a7-4454-b9da-b5c08c185412-kube-api-access-j7fp5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.240282 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.240198    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.341346 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.341302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.341346 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.341354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7fp5\" (UniqueName: \"kubernetes.io/projected/d0ef08df-96a7-4454-b9da-b5c08c185412-kube-api-access-j7fp5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.341633 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.341376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.341633 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.341543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.341633 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.341582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0ef08df-96a7-4454-b9da-b5c08c185412-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.341803 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.341640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.341803 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.341719    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.341888 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.341807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.341923 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.341899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.343830 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.343800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0ef08df-96a7-4454-b9da-b5c08c185412-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.344046 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.344028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0ef08df-96a7-4454-b9da-b5c08c185412-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.357709 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.357682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7fp5\" (UniqueName: \"kubernetes.io/projected/d0ef08df-96a7-4454-b9da-b5c08c185412-kube-api-access-j7fp5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m\" (UID: \"d0ef08df-96a7-4454-b9da-b5c08c185412\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.432849 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.432812    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:29.576811 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.576772    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"]
Jul 22 03:07:29.661890 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:29.661853    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m" event={"ID":"d0ef08df-96a7-4454-b9da-b5c08c185412","Type":"ContainerStarted","Data":"0eb2b47fa84ff8988b02b27163119dc75c6e69e5832010433caf325248d2fc52"}
Jul 22 03:07:31.674241 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:31.674206    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m" event={"ID":"d0ef08df-96a7-4454-b9da-b5c08c185412","Type":"ContainerStarted","Data":"e9f22370d136b09b96fbcd0e3df02d6d1a3678d1c7d61b8b7422223e75869321"}
Jul 22 03:07:31.695114 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:31.695059    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m" podStartSLOduration=1.455856429 podStartE2EDuration="2.695040658s" totalImagesPullingTime="1.239184229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:31.693583383 +0000 UTC m=+565.579711561" watchObservedRunningTime="2026-07-22 03:07:31.695040658 +0000 UTC m=+565.581168798"
Jul 22 03:07:39.433831 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:39.433787    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:39.434321 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:39.433857    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:39.446220 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:39.446194    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:07:39.723657 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:07:39.723561    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m"
Jul 22 03:08:01.914223 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:01.914191    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"]
Jul 22 03:08:01.917673 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:01.917654    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:01.920643 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:01.920615    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 22 03:08:01.928365 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:01.928341    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"]
Jul 22 03:08:02.014684 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.014646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.014684 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.014687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7d2b9c3-9514-48bc-bde6-5bd746029c16-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.014910 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.014761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.014910 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.014810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.015049 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.014868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5zg2\" (UniqueName: \"kubernetes.io/projected/f7d2b9c3-9514-48bc-bde6-5bd746029c16-kube-api-access-d5zg2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.015096 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.015083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.115575 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.115533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.115768 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.115593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5zg2\" (UniqueName: \"kubernetes.io/projected/f7d2b9c3-9514-48bc-bde6-5bd746029c16-kube-api-access-d5zg2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.115768 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.115623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.115768 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.115733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.115895 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.115786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7d2b9c3-9514-48bc-bde6-5bd746029c16-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.115895 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.115846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.116059 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.116038    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.116151 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.116113    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.116193 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.116150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.117888 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.117868    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7d2b9c3-9514-48bc-bde6-5bd746029c16-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.118246 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.118229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7d2b9c3-9514-48bc-bde6-5bd746029c16-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.124957 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.124934    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5zg2\" (UniqueName: \"kubernetes.io/projected/f7d2b9c3-9514-48bc-bde6-5bd746029c16-kube-api-access-d5zg2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pvgz6\" (UID: \"f7d2b9c3-9514-48bc-bde6-5bd746029c16\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.227272 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.227180    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:02.362230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.362157    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"]
Jul 22 03:08:02.364971 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:08:02.364942    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d2b9c3_9514_48bc_bde6_5bd746029c16.slice/crio-5b0fa9c1dc53d0eed55729689df7e4ae5e1e6deb52a639d9f6a79ac6b7e9ce5a WatchSource:0}: Error finding container 5b0fa9c1dc53d0eed55729689df7e4ae5e1e6deb52a639d9f6a79ac6b7e9ce5a: Status 404 returned error can't find the container with id 5b0fa9c1dc53d0eed55729689df7e4ae5e1e6deb52a639d9f6a79ac6b7e9ce5a
Jul 22 03:08:02.808057 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.807966    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6" event={"ID":"f7d2b9c3-9514-48bc-bde6-5bd746029c16","Type":"ContainerStarted","Data":"9e3f1a881a21bc13d8a44a9a80d1ff3d34284f8c82d42ea8d6afde4049ac4d62"}
Jul 22 03:08:02.808057 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.808017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6" event={"ID":"f7d2b9c3-9514-48bc-bde6-5bd746029c16","Type":"ContainerStarted","Data":"5b0fa9c1dc53d0eed55729689df7e4ae5e1e6deb52a639d9f6a79ac6b7e9ce5a"}
Jul 22 03:08:02.828231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:02.828180    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6" podStartSLOduration=1.646641563 podStartE2EDuration="1.828160819s" totalImagesPullingTime="181.519256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:02.826615011 +0000 UTC m=+596.712743150" watchObservedRunningTime="2026-07-22 03:08:02.828160819 +0000 UTC m=+596.714288986"
Jul 22 03:08:12.228354 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:12.228315    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:12.230575 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:12.228390    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:12.241131 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:12.241105    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:08:12.862795 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:08:12.862765    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pvgz6"
Jul 22 03:09:37.098783 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.098742    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85fbf4d885-dxt5l"]
Jul 22 03:09:37.102627 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.102596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85fbf4d885-dxt5l"
Jul 22 03:09:37.113079 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.113053    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85fbf4d885-dxt5l"]
Jul 22 03:09:37.150132 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.150088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de7b5d21-5301-4960-9540-8e811df85e02-tls-cert\") pod \"authorino-85fbf4d885-dxt5l\" (UID: \"de7b5d21-5301-4960-9540-8e811df85e02\") " pod="kuadrant-system/authorino-85fbf4d885-dxt5l"
Jul 22 03:09:37.150315 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.150171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czlhm\" (UniqueName: \"kubernetes.io/projected/de7b5d21-5301-4960-9540-8e811df85e02-kube-api-access-czlhm\") pod \"authorino-85fbf4d885-dxt5l\" (UID: \"de7b5d21-5301-4960-9540-8e811df85e02\") " pod="kuadrant-system/authorino-85fbf4d885-dxt5l"
Jul 22 03:09:37.251455 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.251417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czlhm\" (UniqueName: \"kubernetes.io/projected/de7b5d21-5301-4960-9540-8e811df85e02-kube-api-access-czlhm\") pod \"authorino-85fbf4d885-dxt5l\" (UID: \"de7b5d21-5301-4960-9540-8e811df85e02\") " pod="kuadrant-system/authorino-85fbf4d885-dxt5l"
Jul 22 03:09:37.251674 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.251489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de7b5d21-5301-4960-9540-8e811df85e02-tls-cert\") pod \"authorino-85fbf4d885-dxt5l\" (UID: \"de7b5d21-5301-4960-9540-8e811df85e02\") " pod="kuadrant-system/authorino-85fbf4d885-dxt5l"
Jul 22 03:09:37.253934 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.253909    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de7b5d21-5301-4960-9540-8e811df85e02-tls-cert\") pod \"authorino-85fbf4d885-dxt5l\" (UID: \"de7b5d21-5301-4960-9540-8e811df85e02\") " pod="kuadrant-system/authorino-85fbf4d885-dxt5l"
Jul 22 03:09:37.261172 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.261136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czlhm\" (UniqueName: \"kubernetes.io/projected/de7b5d21-5301-4960-9540-8e811df85e02-kube-api-access-czlhm\") pod \"authorino-85fbf4d885-dxt5l\" (UID: \"de7b5d21-5301-4960-9540-8e811df85e02\") " pod="kuadrant-system/authorino-85fbf4d885-dxt5l"
Jul 22 03:09:37.414051 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.414006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85fbf4d885-dxt5l"
Jul 22 03:09:37.559854 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.559813    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85fbf4d885-dxt5l"]
Jul 22 03:09:37.562488 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:09:37.562459    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde7b5d21_5301_4960_9540_8e811df85e02.slice/crio-f59543d46624e191f94bca2db48fcd4a960585feeedc0699e3b693726b4c8d7e WatchSource:0}: Error finding container f59543d46624e191f94bca2db48fcd4a960585feeedc0699e3b693726b4c8d7e: Status 404 returned error can't find the container with id f59543d46624e191f94bca2db48fcd4a960585feeedc0699e3b693726b4c8d7e
Jul 22 03:09:37.564144 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:37.564123    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:09:38.200626 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.200591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85fbf4d885-dxt5l" event={"ID":"de7b5d21-5301-4960-9540-8e811df85e02","Type":"ContainerStarted","Data":"31320ca1333f6403ffe2170c39cb6c41fa2a899bc6c8406912e5ccb44fa92b97"}
Jul 22 03:09:38.200996 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.200632    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85fbf4d885-dxt5l" event={"ID":"de7b5d21-5301-4960-9540-8e811df85e02","Type":"ContainerStarted","Data":"f59543d46624e191f94bca2db48fcd4a960585feeedc0699e3b693726b4c8d7e"}
Jul 22 03:09:38.219171 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.219097    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85fbf4d885-dxt5l" podStartSLOduration=0.691802651 podStartE2EDuration="1.219074969s" totalImagesPullingTime="527.272318ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:09:38.216657421 +0000 UTC m=+692.102785562" watchObservedRunningTime="2026-07-22 03:09:38.219074969 +0000 UTC m=+692.105203110"
Jul 22 03:09:38.247573 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.247500    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d964f9c68-5h7c5"]
Jul 22 03:09:38.247754 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.247722    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-d964f9c68-5h7c5" podUID="fb63874c-d6c9-4671-92b3-b12ccb400284" containerName="authorino" containerID="cri-o://b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856" gracePeriod=30
Jul 22 03:09:38.516342 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.516299    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d964f9c68-5h7c5"
Jul 22 03:09:38.564285 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.564253    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb63874c-d6c9-4671-92b3-b12ccb400284-tls-cert\") pod \"fb63874c-d6c9-4671-92b3-b12ccb400284\" (UID: \"fb63874c-d6c9-4671-92b3-b12ccb400284\") "
Jul 22 03:09:38.564489 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.564316    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c4lt\" (UniqueName: \"kubernetes.io/projected/fb63874c-d6c9-4671-92b3-b12ccb400284-kube-api-access-9c4lt\") pod \"fb63874c-d6c9-4671-92b3-b12ccb400284\" (UID: \"fb63874c-d6c9-4671-92b3-b12ccb400284\") "
Jul 22 03:09:38.566543 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.566497    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb63874c-d6c9-4671-92b3-b12ccb400284-kube-api-access-9c4lt" (OuterVolumeSpecName: "kube-api-access-9c4lt") pod "fb63874c-d6c9-4671-92b3-b12ccb400284" (UID: "fb63874c-d6c9-4671-92b3-b12ccb400284"). InnerVolumeSpecName "kube-api-access-9c4lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:09:38.574019 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.573992    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb63874c-d6c9-4671-92b3-b12ccb400284-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fb63874c-d6c9-4671-92b3-b12ccb400284" (UID: "fb63874c-d6c9-4671-92b3-b12ccb400284"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:09:38.665791 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.665755    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb63874c-d6c9-4671-92b3-b12ccb400284-tls-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:09:38.665791 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:38.665786    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c4lt\" (UniqueName: \"kubernetes.io/projected/fb63874c-d6c9-4671-92b3-b12ccb400284-kube-api-access-9c4lt\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:09:39.205915 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:39.205877    2576 generic.go:356] "Generic (PLEG): container finished" podID="fb63874c-d6c9-4671-92b3-b12ccb400284" containerID="b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856" exitCode=0
Jul 22 03:09:39.205915 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:39.205913    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d964f9c68-5h7c5"
Jul 22 03:09:39.206447 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:39.205947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d964f9c68-5h7c5" event={"ID":"fb63874c-d6c9-4671-92b3-b12ccb400284","Type":"ContainerDied","Data":"b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856"}
Jul 22 03:09:39.206447 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:39.205990    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d964f9c68-5h7c5" event={"ID":"fb63874c-d6c9-4671-92b3-b12ccb400284","Type":"ContainerDied","Data":"db74d1dbefd905b0c1cf0786b35d79f2221c2f2021b21960632612fe89c3ff62"}
Jul 22 03:09:39.206447 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:39.206013    2576 scope.go:117] "RemoveContainer" containerID="b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856"
Jul 22 03:09:39.215966 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:39.215944    2576 scope.go:117] "RemoveContainer" containerID="b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856"
Jul 22 03:09:39.216259 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:09:39.216242    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856\": container with ID starting with b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856 not found: ID does not exist" containerID="b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856"
Jul 22 03:09:39.216320 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:39.216273    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856"} err="failed to get container status \"b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856\": rpc error: code = NotFound desc = could not find container \"b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856\": container with ID starting with b07401be8c8ac9478b33a76c34c55db0569984b8da1645535773220dfb8aa856 not found: ID does not exist"
Jul 22 03:09:39.227144 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:39.227117    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d964f9c68-5h7c5"]
Jul 22 03:09:39.232414 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:39.232376    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d964f9c68-5h7c5"]
Jul 22 03:09:40.184456 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:09:40.184391    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb63874c-d6c9-4671-92b3-b12ccb400284" path="/var/lib/kubelet/pods/fb63874c-d6c9-4671-92b3-b12ccb400284/volumes"
Jul 22 03:15:00.150367 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.150328    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p"]
Jul 22 03:15:00.152370 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.150773    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb63874c-d6c9-4671-92b3-b12ccb400284" containerName="authorino"
Jul 22 03:15:00.152370 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.150787    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb63874c-d6c9-4671-92b3-b12ccb400284" containerName="authorino"
Jul 22 03:15:00.152370 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.150850    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb63874c-d6c9-4671-92b3-b12ccb400284" containerName="authorino"
Jul 22 03:15:00.153592 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.153576    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p"
Jul 22 03:15:00.156294 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.156272    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cw8l4\""
Jul 22 03:15:00.162919 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.162899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p"
Jul 22 03:15:00.185325 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.185293    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p"]
Jul 22 03:15:00.309179 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.309154    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p"]
Jul 22 03:15:00.311738 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:15:00.311706    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8b6432_5d12_4021_8401_ac30e0b568cc.slice/crio-ac3f4b0f49cd1c4ea08b1784a6c79abbcf5c5c3eee455778e2f25e341ee68a69 WatchSource:0}: Error finding container ac3f4b0f49cd1c4ea08b1784a6c79abbcf5c5c3eee455778e2f25e341ee68a69: Status 404 returned error can't find the container with id ac3f4b0f49cd1c4ea08b1784a6c79abbcf5c5c3eee455778e2f25e341ee68a69
Jul 22 03:15:00.313631 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.313610    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:15:00.550900 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:00.550818    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p" event={"ID":"1e8b6432-5d12-4021-8401-ac30e0b568cc","Type":"ContainerStarted","Data":"ac3f4b0f49cd1c4ea08b1784a6c79abbcf5c5c3eee455778e2f25e341ee68a69"}
Jul 22 03:15:03.566340 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:03.566301    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p" event={"ID":"1e8b6432-5d12-4021-8401-ac30e0b568cc","Type":"ContainerStarted","Data":"56063efb5b034e24b1a73d14ab2c360390b901b9ae57401025a97398d1cc4132"}
Jul 22 03:15:03.590903 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:03.590848    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p" podStartSLOduration=1.151632332 podStartE2EDuration="3.590833552s" totalImagesPullingTime="2.43920122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:15:03.589447554 +0000 UTC m=+1017.475575693" watchObservedRunningTime="2026-07-22 03:15:03.590833552 +0000 UTC m=+1017.476961693"
Jul 22 03:15:04.572906 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:04.572867    2576 generic.go:356] "Generic (PLEG): container finished" podID="1e8b6432-5d12-4021-8401-ac30e0b568cc" containerID="56063efb5b034e24b1a73d14ab2c360390b901b9ae57401025a97398d1cc4132" exitCode=0
Jul 22 03:15:04.573360 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:04.572920    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p" event={"ID":"1e8b6432-5d12-4021-8401-ac30e0b568cc","Type":"ContainerDied","Data":"56063efb5b034e24b1a73d14ab2c360390b901b9ae57401025a97398d1cc4132"}
Jul 22 03:15:05.730665 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:05.730639    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p"
Jul 22 03:15:06.590470 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:06.590366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p" event={"ID":"1e8b6432-5d12-4021-8401-ac30e0b568cc","Type":"ContainerDied","Data":"ac3f4b0f49cd1c4ea08b1784a6c79abbcf5c5c3eee455778e2f25e341ee68a69"}
Jul 22 03:15:06.590470 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:06.590447    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-fn47p"
Jul 22 03:15:06.590470 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:15:06.590468    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac3f4b0f49cd1c4ea08b1784a6c79abbcf5c5c3eee455778e2f25e341ee68a69"
Jul 22 03:20:16.203589 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.203553    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"]
Jul 22 03:20:16.206047 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.203835    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8b6432-5d12-4021-8401-ac30e0b568cc" containerName="cleanup"
Jul 22 03:20:16.206047 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.203846    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8b6432-5d12-4021-8401-ac30e0b568cc" containerName="cleanup"
Jul 22 03:20:16.206047 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.203911    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e8b6432-5d12-4021-8401-ac30e0b568cc" containerName="cleanup"
Jul 22 03:20:16.206838 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.206820    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.215762 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.215739    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-e1cbf087-kserve-self-signed-certs\""
Jul 22 03:20:16.229691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.229654    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"]
Jul 22 03:20:16.277218 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.277174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-dshm\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.277218 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.277223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-home\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.277517 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.277289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cec1088-7189-44c7-a06f-eae44288bb80-tls-certs\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.277517 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.277351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp64r\" (UniqueName: \"kubernetes.io/projected/2cec1088-7189-44c7-a06f-eae44288bb80-kube-api-access-wp64r\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.277517 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.277394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-tmp-dir\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.277517 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.277437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-model-cache\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.378284 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.378250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cec1088-7189-44c7-a06f-eae44288bb80-tls-certs\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.378490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.378302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp64r\" (UniqueName: \"kubernetes.io/projected/2cec1088-7189-44c7-a06f-eae44288bb80-kube-api-access-wp64r\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.378490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.378331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-tmp-dir\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.378490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.378362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-model-cache\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.378490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.378456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-dshm\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.378490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.378487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-home\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.378887 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.378857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-tmp-dir\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.379020 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.378888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-model-cache\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.379020 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.378978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-home\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.380755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.380737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-dshm\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.380924 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.380908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cec1088-7189-44c7-a06f-eae44288bb80-tls-certs\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.396928 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.396903    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp64r\" (UniqueName: \"kubernetes.io/projected/2cec1088-7189-44c7-a06f-eae44288bb80-kube-api-access-wp64r\") pod \"e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") " pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.515967 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.515881    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:16.653725 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.653701    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"]
Jul 22 03:20:16.656224 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:20:16.656199    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cec1088_7189_44c7_a06f_eae44288bb80.slice/crio-12d2c08d8fd301aec045302ed3ff8f44ceaf39e22d18bf7bbef3f5e79097ec63 WatchSource:0}: Error finding container 12d2c08d8fd301aec045302ed3ff8f44ceaf39e22d18bf7bbef3f5e79097ec63: Status 404 returned error can't find the container with id 12d2c08d8fd301aec045302ed3ff8f44ceaf39e22d18bf7bbef3f5e79097ec63
Jul 22 03:20:16.901944 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.901908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4" event={"ID":"2cec1088-7189-44c7-a06f-eae44288bb80","Type":"ContainerStarted","Data":"3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898"}
Jul 22 03:20:16.901944 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:16.901948    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4" event={"ID":"2cec1088-7189-44c7-a06f-eae44288bb80","Type":"ContainerStarted","Data":"12d2c08d8fd301aec045302ed3ff8f44ceaf39e22d18bf7bbef3f5e79097ec63"}
Jul 22 03:20:23.898298 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.898232    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4" podStartSLOduration=7.898211016 podStartE2EDuration="7.898211016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:20:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:20:16.921785269 +0000 UTC m=+1330.807913441" watchObservedRunningTime="2026-07-22 03:20:23.898211016 +0000 UTC m=+1337.784339155"
Jul 22 03:20:23.899612 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.899591    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"]
Jul 22 03:20:23.903300 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.903281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:23.905836 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.905804    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-e1cbf087-kserve-self-signed-certs\""
Jul 22 03:20:23.910722 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.910695    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"]
Jul 22 03:20:23.946756 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.946717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-model-cache\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:23.946937 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.946781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-home\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:23.946937 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.946808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fk8c\" (UniqueName: \"kubernetes.io/projected/053d9c53-a222-42f9-b373-5b133b8ad204-kube-api-access-4fk8c\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:23.946937 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.946833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-dshm\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:23.946937 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.946892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053d9c53-a222-42f9-b373-5b133b8ad204-tls-certs\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:23.946937 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:23.946916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-tmp-dir\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.048145 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.048104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-model-cache\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.048356 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.048164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-home\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.048356 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.048182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fk8c\" (UniqueName: \"kubernetes.io/projected/053d9c53-a222-42f9-b373-5b133b8ad204-kube-api-access-4fk8c\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.048356 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.048205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-dshm\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.048356 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.048252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053d9c53-a222-42f9-b373-5b133b8ad204-tls-certs\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.048623 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.048432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-tmp-dir\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.048623 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.048594    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-model-cache\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.048729 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.048694    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-home\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.048828 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.048803    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-tmp-dir\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.050617 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.050597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-dshm\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.050730 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.050713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053d9c53-a222-42f9-b373-5b133b8ad204-tls-certs\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.058336 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.058314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fk8c\" (UniqueName: \"kubernetes.io/projected/053d9c53-a222-42f9-b373-5b133b8ad204-kube-api-access-4fk8c\") pod \"e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") " pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.214802 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.214713    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:24.347424 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.347375    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"]
Jul 22 03:20:24.351261 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:20:24.351233    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod053d9c53_a222_42f9_b373_5b133b8ad204.slice/crio-f3a86e6a6cf3dbca76ded11e818b1b40c1a29c0c9abb9b79d461230bd3c2d99e WatchSource:0}: Error finding container f3a86e6a6cf3dbca76ded11e818b1b40c1a29c0c9abb9b79d461230bd3c2d99e: Status 404 returned error can't find the container with id f3a86e6a6cf3dbca76ded11e818b1b40c1a29c0c9abb9b79d461230bd3c2d99e
Jul 22 03:20:24.936757 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.936715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh" event={"ID":"053d9c53-a222-42f9-b373-5b133b8ad204","Type":"ContainerStarted","Data":"59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290"}
Jul 22 03:20:24.936757 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.936760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh" event={"ID":"053d9c53-a222-42f9-b373-5b133b8ad204","Type":"ContainerStarted","Data":"f3a86e6a6cf3dbca76ded11e818b1b40c1a29c0c9abb9b79d461230bd3c2d99e"}
Jul 22 03:20:24.952756 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:24.952698    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh" podStartSLOduration=1.952682021 podStartE2EDuration="1.952682021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:20:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:20:24.95191029 +0000 UTC m=+1338.838038431" watchObservedRunningTime="2026-07-22 03:20:24.952682021 +0000 UTC m=+1338.838810161"
Jul 22 03:20:26.516496 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:26.516411    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:26.516496 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:26.516463    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:26.529473 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:26.529444    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:26.956918 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:26.956876    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:20:34.214929 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:34.214836    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:34.214929 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:34.214895    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:34.227305 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:34.227270    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:34.990496 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:34.990466    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:20:54.505190 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:54.505153    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"]
Jul 22 03:20:56.069528 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:20:56.069495    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"]
Jul 22 03:21:09.524967 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.524919    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4" podUID="2cec1088-7189-44c7-a06f-eae44288bb80" containerName="main" containerID="cri-o://3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898" gracePeriod=45
Jul 22 03:21:09.773794 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.773767    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:21:09.845422 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.845310    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cec1088-7189-44c7-a06f-eae44288bb80-tls-certs\") pod \"2cec1088-7189-44c7-a06f-eae44288bb80\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") "
Jul 22 03:21:09.845422 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.845361    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-dshm\") pod \"2cec1088-7189-44c7-a06f-eae44288bb80\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") "
Jul 22 03:21:09.845661 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.845434    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-model-cache\") pod \"2cec1088-7189-44c7-a06f-eae44288bb80\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") "
Jul 22 03:21:09.845661 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.845564    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-home\") pod \"2cec1088-7189-44c7-a06f-eae44288bb80\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") "
Jul 22 03:21:09.845661 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.845630    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-tmp-dir\") pod \"2cec1088-7189-44c7-a06f-eae44288bb80\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") "
Jul 22 03:21:09.845661 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.845652    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp64r\" (UniqueName: \"kubernetes.io/projected/2cec1088-7189-44c7-a06f-eae44288bb80-kube-api-access-wp64r\") pod \"2cec1088-7189-44c7-a06f-eae44288bb80\" (UID: \"2cec1088-7189-44c7-a06f-eae44288bb80\") "
Jul 22 03:21:09.845866 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.845733    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-home" (OuterVolumeSpecName: "home") pod "2cec1088-7189-44c7-a06f-eae44288bb80" (UID: "2cec1088-7189-44c7-a06f-eae44288bb80"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:09.845866 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.845753    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-model-cache" (OuterVolumeSpecName: "model-cache") pod "2cec1088-7189-44c7-a06f-eae44288bb80" (UID: "2cec1088-7189-44c7-a06f-eae44288bb80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:09.845943 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.845872    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2cec1088-7189-44c7-a06f-eae44288bb80" (UID: "2cec1088-7189-44c7-a06f-eae44288bb80"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:09.846001 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.845986    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:09.846040 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.846005    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:09.846040 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.846023    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:09.847642 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.847617    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-dshm" (OuterVolumeSpecName: "dshm") pod "2cec1088-7189-44c7-a06f-eae44288bb80" (UID: "2cec1088-7189-44c7-a06f-eae44288bb80"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:09.847642 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.847625    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cec1088-7189-44c7-a06f-eae44288bb80-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2cec1088-7189-44c7-a06f-eae44288bb80" (UID: "2cec1088-7189-44c7-a06f-eae44288bb80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:21:09.847785 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.847661    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cec1088-7189-44c7-a06f-eae44288bb80-kube-api-access-wp64r" (OuterVolumeSpecName: "kube-api-access-wp64r") pod "2cec1088-7189-44c7-a06f-eae44288bb80" (UID: "2cec1088-7189-44c7-a06f-eae44288bb80"). InnerVolumeSpecName "kube-api-access-wp64r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:21:09.947476 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.947431    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp64r\" (UniqueName: \"kubernetes.io/projected/2cec1088-7189-44c7-a06f-eae44288bb80-kube-api-access-wp64r\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:09.947476 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.947469    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cec1088-7189-44c7-a06f-eae44288bb80-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:09.947476 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:09.947483    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cec1088-7189-44c7-a06f-eae44288bb80-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:10.140059 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:10.139972    2576 generic.go:356] "Generic (PLEG): container finished" podID="2cec1088-7189-44c7-a06f-eae44288bb80" containerID="3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898" exitCode=0
Jul 22 03:21:10.140059 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:10.140005    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"
Jul 22 03:21:10.140059 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:10.140049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4" event={"ID":"2cec1088-7189-44c7-a06f-eae44288bb80","Type":"ContainerDied","Data":"3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898"}
Jul 22 03:21:10.140299 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:10.140089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4" event={"ID":"2cec1088-7189-44c7-a06f-eae44288bb80","Type":"ContainerDied","Data":"12d2c08d8fd301aec045302ed3ff8f44ceaf39e22d18bf7bbef3f5e79097ec63"}
Jul 22 03:21:10.140299 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:10.140109    2576 scope.go:117] "RemoveContainer" containerID="3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898"
Jul 22 03:21:10.148698 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:10.148681    2576 scope.go:117] "RemoveContainer" containerID="3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898"
Jul 22 03:21:10.148952 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:21:10.148930    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898\": container with ID starting with 3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898 not found: ID does not exist" containerID="3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898"
Jul 22 03:21:10.148998 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:10.148961    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898"} err="failed to get container status \"3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898\": rpc error: code = NotFound desc = could not find container \"3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898\": container with ID starting with 3ee4a4850151104e8e51aae62e283a67e240548e7c80c1826631de7f54fdf898 not found: ID does not exist"
Jul 22 03:21:10.161383 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:10.161350    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"]
Jul 22 03:21:10.165248 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:10.165222    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-e1cbf087-kserve-5f4bb4b94c-gqtz4"]
Jul 22 03:21:10.183742 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:10.183713    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cec1088-7189-44c7-a06f-eae44288bb80" path="/var/lib/kubelet/pods/2cec1088-7189-44c7-a06f-eae44288bb80/volumes"
Jul 22 03:21:11.091301 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.091253    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh" podUID="053d9c53-a222-42f9-b373-5b133b8ad204" containerName="main" containerID="cri-o://59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290" gracePeriod=45
Jul 22 03:21:11.358214 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.358187    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:21:11.459427 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459363    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-tmp-dir\") pod \"053d9c53-a222-42f9-b373-5b133b8ad204\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") "
Jul 22 03:21:11.459622 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459470    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-dshm\") pod \"053d9c53-a222-42f9-b373-5b133b8ad204\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") "
Jul 22 03:21:11.459622 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459496    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-model-cache\") pod \"053d9c53-a222-42f9-b373-5b133b8ad204\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") "
Jul 22 03:21:11.459622 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459533    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-home\") pod \"053d9c53-a222-42f9-b373-5b133b8ad204\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") "
Jul 22 03:21:11.459622 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459578    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053d9c53-a222-42f9-b373-5b133b8ad204-tls-certs\") pod \"053d9c53-a222-42f9-b373-5b133b8ad204\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") "
Jul 22 03:21:11.459622 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459609    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fk8c\" (UniqueName: \"kubernetes.io/projected/053d9c53-a222-42f9-b373-5b133b8ad204-kube-api-access-4fk8c\") pod \"053d9c53-a222-42f9-b373-5b133b8ad204\" (UID: \"053d9c53-a222-42f9-b373-5b133b8ad204\") "
Jul 22 03:21:11.459884 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459684    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "053d9c53-a222-42f9-b373-5b133b8ad204" (UID: "053d9c53-a222-42f9-b373-5b133b8ad204"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:11.459884 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459819    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-home" (OuterVolumeSpecName: "home") pod "053d9c53-a222-42f9-b373-5b133b8ad204" (UID: "053d9c53-a222-42f9-b373-5b133b8ad204"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:11.459884 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459832    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-model-cache" (OuterVolumeSpecName: "model-cache") pod "053d9c53-a222-42f9-b373-5b133b8ad204" (UID: "053d9c53-a222-42f9-b373-5b133b8ad204"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:11.460022 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459921    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:11.460022 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459934    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:11.460022 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.459978    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:11.461588 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.461566    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-dshm" (OuterVolumeSpecName: "dshm") pod "053d9c53-a222-42f9-b373-5b133b8ad204" (UID: "053d9c53-a222-42f9-b373-5b133b8ad204"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:11.461729 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.461705    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053d9c53-a222-42f9-b373-5b133b8ad204-kube-api-access-4fk8c" (OuterVolumeSpecName: "kube-api-access-4fk8c") pod "053d9c53-a222-42f9-b373-5b133b8ad204" (UID: "053d9c53-a222-42f9-b373-5b133b8ad204"). InnerVolumeSpecName "kube-api-access-4fk8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:21:11.461767 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.461722    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/053d9c53-a222-42f9-b373-5b133b8ad204-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "053d9c53-a222-42f9-b373-5b133b8ad204" (UID: "053d9c53-a222-42f9-b373-5b133b8ad204"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:21:11.560663 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.560622    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/053d9c53-a222-42f9-b373-5b133b8ad204-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:11.560663 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.560658    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/053d9c53-a222-42f9-b373-5b133b8ad204-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:11.560663 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:11.560670    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fk8c\" (UniqueName: \"kubernetes.io/projected/053d9c53-a222-42f9-b373-5b133b8ad204-kube-api-access-4fk8c\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:21:12.151883 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:12.151849    2576 generic.go:356] "Generic (PLEG): container finished" podID="053d9c53-a222-42f9-b373-5b133b8ad204" containerID="59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290" exitCode=0
Jul 22 03:21:12.152377 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:12.151896    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"
Jul 22 03:21:12.152377 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:12.151943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh" event={"ID":"053d9c53-a222-42f9-b373-5b133b8ad204","Type":"ContainerDied","Data":"59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290"}
Jul 22 03:21:12.152377 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:12.151990    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh" event={"ID":"053d9c53-a222-42f9-b373-5b133b8ad204","Type":"ContainerDied","Data":"f3a86e6a6cf3dbca76ded11e818b1b40c1a29c0c9abb9b79d461230bd3c2d99e"}
Jul 22 03:21:12.152377 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:12.152015    2576 scope.go:117] "RemoveContainer" containerID="59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290"
Jul 22 03:21:12.161014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:12.160995    2576 scope.go:117] "RemoveContainer" containerID="59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290"
Jul 22 03:21:12.161280 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:21:12.161259    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290\": container with ID starting with 59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290 not found: ID does not exist" containerID="59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290"
Jul 22 03:21:12.161344 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:12.161290    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290"} err="failed to get container status \"59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290\": rpc error: code = NotFound desc = could not find container \"59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290\": container with ID starting with 59afdfdc2ef2b78c071572367b8d092dc9c7bb4a15bebd5e948ce9c49a457290 not found: ID does not exist"
Jul 22 03:21:12.175024 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:12.174998    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"]
Jul 22 03:21:12.187237 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:12.187212    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-e1cbf087-kserve-66bf6f9bc9-p7hvh"]
Jul 22 03:21:14.183411 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:21:14.183364    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="053d9c53-a222-42f9-b373-5b133b8ad204" path="/var/lib/kubelet/pods/053d9c53-a222-42f9-b373-5b133b8ad204/volumes"
Jul 22 03:24:42.755167 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.755132    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"]
Jul 22 03:24:42.755688 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.755457    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053d9c53-a222-42f9-b373-5b133b8ad204" containerName="main"
Jul 22 03:24:42.755688 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.755469    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="053d9c53-a222-42f9-b373-5b133b8ad204" containerName="main"
Jul 22 03:24:42.755688 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.755478    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cec1088-7189-44c7-a06f-eae44288bb80" containerName="main"
Jul 22 03:24:42.755688 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.755484    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cec1088-7189-44c7-a06f-eae44288bb80" containerName="main"
Jul 22 03:24:42.755688 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.755531    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="053d9c53-a222-42f9-b373-5b133b8ad204" containerName="main"
Jul 22 03:24:42.755688 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.755540    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cec1088-7189-44c7-a06f-eae44288bb80" containerName="main"
Jul 22 03:24:42.758425 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.758387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.761111 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.761089    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0c81ed29-openshift-default-dockercfg-c7wkx\""
Jul 22 03:24:42.783287 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.783251    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"]
Jul 22 03:24:42.864988 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.864949    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-credential-socket\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.864988 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.864988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-envoy\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.865228 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.865052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-socket\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.865228 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.865073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-data\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.865228 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.865099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ckl2\" (UniqueName: \"kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-kube-api-access-5ckl2\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.865228 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.865136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-podinfo\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.865228 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.865178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istiod-ca-cert\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.865428 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.865237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-certs\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.865428 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.865254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-token\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.966608 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.966568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-envoy\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.966807 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.966619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-socket\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.966807 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.966730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-data\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.966807 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.966768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ckl2\" (UniqueName: \"kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-kube-api-access-5ckl2\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.966807 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.966808    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-podinfo\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.967029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.966826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istiod-ca-cert\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.967029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.966896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-certs\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.967029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.966927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-token\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.967029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.966951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-socket\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.967289 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.967034    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-credential-socket\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.967289 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.967094    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-data\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.967420 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.967321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-certs\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.967544 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.967522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-credential-socket\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.967633 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.967618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istiod-ca-cert\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.969009 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.968984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-envoy\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.969323 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.969305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-podinfo\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.974872 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.974849    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-token\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:42.974989 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:42.974920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ckl2\" (UniqueName: \"kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-kube-api-access-5ckl2\") pod \"e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") " pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:43.068587 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:43.068503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:43.208156 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:43.208081    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"]
Jul 22 03:24:43.211479 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:24:43.211449    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ed78a9_bda4_4fb3_b263_f8a3a270c215.slice/crio-f123ee0ad394d925a99d8dc4b201134398a469df6d81704c9a13acd1698525f1 WatchSource:0}: Error finding container f123ee0ad394d925a99d8dc4b201134398a469df6d81704c9a13acd1698525f1: Status 404 returned error can't find the container with id f123ee0ad394d925a99d8dc4b201134398a469df6d81704c9a13acd1698525f1
Jul 22 03:24:43.214161 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:43.214126    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:24:43.214241 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:43.214198    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:24:43.214241 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:43.214227    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:24:44.049536 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:44.049500    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" event={"ID":"09ed78a9-bda4-4fb3-b263-f8a3a270c215","Type":"ContainerStarted","Data":"e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687"}
Jul 22 03:24:44.049939 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:44.049551    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" event={"ID":"09ed78a9-bda4-4fb3-b263-f8a3a270c215","Type":"ContainerStarted","Data":"f123ee0ad394d925a99d8dc4b201134398a469df6d81704c9a13acd1698525f1"}
Jul 22 03:24:44.068779 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:44.068754    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:44.070947 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:44.070899    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" podStartSLOduration=2.070883967 podStartE2EDuration="2.070883967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:24:44.06920829 +0000 UTC m=+1597.955336454" watchObservedRunningTime="2026-07-22 03:24:44.070883967 +0000 UTC m=+1597.957012107"
Jul 22 03:24:44.073962 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:44.073939    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:45.053298 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:45.053260    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:45.054323 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:45.054302    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:24:59.117128 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:59.117097    2576 generic.go:356] "Generic (PLEG): container finished" podID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerID="e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687" exitCode=0
Jul 22 03:24:59.117511 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:59.117166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" event={"ID":"09ed78a9-bda4-4fb3-b263-f8a3a270c215","Type":"ContainerDied","Data":"e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687"}
Jul 22 03:24:59.117590 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:59.117574    2576 scope.go:117] "RemoveContainer" containerID="e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687"
Jul 22 03:24:59.118524 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:59.118494    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:24:59.118597 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:59.118584    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:24:59.118633 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:24:59.118620    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:25:00.054285 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:00.054231    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:25:00.125112 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:00.125077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" event={"ID":"09ed78a9-bda4-4fb3-b263-f8a3a270c215","Type":"ContainerStarted","Data":"ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc"}
Jul 22 03:25:01.069469 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:01.069428    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:25:01.070714 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:01.070682    2576 patch_prober.go:28] interesting pod/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 22 03:25:01.070845 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:01.070738    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 22 03:25:02.069655 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:02.069615    2576 patch_prober.go:28] interesting pod/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 22 03:25:02.070059 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:02.069672    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 22 03:25:03.069887 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:03.069849    2576 patch_prober.go:28] interesting pod/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 22 03:25:03.070290 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:03.069905    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 22 03:25:04.073080 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:04.073047    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:25:04.073586 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:04.073442    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:25:04.074169 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:04.074144    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:25:26.366961 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:26.366927    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"]
Jul 22 03:25:26.367648 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:26.367163    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerName="istio-proxy" containerID="cri-o://ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc" gracePeriod=30
Jul 22 03:25:27.460053 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.460016    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"]
Jul 22 03:25:27.463274 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.463258    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.465626 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.465603    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-321cbb2c-gw-openshift-default-dockercfg-ppkcf\""
Jul 22 03:25:27.475144 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.475120    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"]
Jul 22 03:25:27.572355 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.572319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xstm2\" (UniqueName: \"kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-kube-api-access-xstm2\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.572561 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.572365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-podinfo\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.572561 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.572463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-socket\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.572561 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.572517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-token\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.572561 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.572541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-certs\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.572744 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.572565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-data\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.572744 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.572590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-credential-socket\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.572744 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.572656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-envoy\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.572744 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.572679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istiod-ca-cert\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.673761 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.673727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstm2\" (UniqueName: \"kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-kube-api-access-xstm2\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.673939 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.673771    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-podinfo\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.673939 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.673897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-socket\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.673949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-token\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.673975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-certs\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.674005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-data\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674121 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.674028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-credential-socket\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674121 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.674095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-envoy\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674211 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.674132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istiod-ca-cert\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674439 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.674349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-socket\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674439 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.674417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-certs\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674625 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.674523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-credential-socket\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674625 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.674577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-data\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.674904 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.674884    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istiod-ca-cert\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.676210 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.676189    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-envoy\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.676417 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.676385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-podinfo\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.681480 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.681457    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-token\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.681624 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.681606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xstm2\" (UniqueName: \"kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-kube-api-access-xstm2\") pod \"e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") " pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.773248 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.773160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:27.907333 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.907300    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"]
Jul 22 03:25:27.910534 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:25:27.910489    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c9b8cb_79ca_492b_85b5_ca77e6caa280.slice/crio-b3a6171f1ae65e0e6a283ccc89e40a64f091383965e1be553e57748631c52fd0 WatchSource:0}: Error finding container b3a6171f1ae65e0e6a283ccc89e40a64f091383965e1be553e57748631c52fd0: Status 404 returned error can't find the container with id b3a6171f1ae65e0e6a283ccc89e40a64f091383965e1be553e57748631c52fd0
Jul 22 03:25:27.912672 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.912628    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:25:27.912794 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.912707    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:25:27.912794 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:27.912744    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:25:28.246810 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:28.246774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" event={"ID":"f8c9b8cb-79ca-492b-85b5-ca77e6caa280","Type":"ContainerStarted","Data":"c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4"}
Jul 22 03:25:28.246993 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:28.246826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" event={"ID":"f8c9b8cb-79ca-492b-85b5-ca77e6caa280","Type":"ContainerStarted","Data":"b3a6171f1ae65e0e6a283ccc89e40a64f091383965e1be553e57748631c52fd0"}
Jul 22 03:25:28.267381 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:28.267329    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" podStartSLOduration=1.267309942 podStartE2EDuration="1.267309942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:25:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:25:28.266377451 +0000 UTC m=+1642.152505627" watchObservedRunningTime="2026-07-22 03:25:28.267309942 +0000 UTC m=+1642.153438085"
Jul 22 03:25:28.773564 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:28.773531    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:28.778633 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:28.778604    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:29.251318 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:29.251278    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:29.252357 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:29.252334    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:31.615221 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.615195    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:25:31.711052 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711018    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-data\") pod \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") "
Jul 22 03:25:31.711261 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711069    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istiod-ca-cert\") pod \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") "
Jul 22 03:25:31.711261 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711085    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-certs\") pod \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") "
Jul 22 03:25:31.711261 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711116    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-socket\") pod \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") "
Jul 22 03:25:31.711261 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711137    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ckl2\" (UniqueName: \"kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-kube-api-access-5ckl2\") pod \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") "
Jul 22 03:25:31.711261 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711159    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-credential-socket\") pod \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") "
Jul 22 03:25:31.711261 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711188    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-envoy\") pod \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") "
Jul 22 03:25:31.711261 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711237    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-token\") pod \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") "
Jul 22 03:25:31.711645 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711269    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-podinfo\") pod \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\" (UID: \"09ed78a9-bda4-4fb3-b263-f8a3a270c215\") "
Jul 22 03:25:31.711645 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711516    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09ed78a9-bda4-4fb3-b263-f8a3a270c215" (UID: "09ed78a9-bda4-4fb3-b263-f8a3a270c215"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:25:31.711821 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711772    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09ed78a9-bda4-4fb3-b263-f8a3a270c215" (UID: "09ed78a9-bda4-4fb3-b263-f8a3a270c215"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:25:31.711968 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711784    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09ed78a9-bda4-4fb3-b263-f8a3a270c215" (UID: "09ed78a9-bda4-4fb3-b263-f8a3a270c215"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:25:31.711968 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711846    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09ed78a9-bda4-4fb3-b263-f8a3a270c215" (UID: "09ed78a9-bda4-4fb3-b263-f8a3a270c215"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:25:31.711968 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.711951    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-data" (OuterVolumeSpecName: "istio-data") pod "09ed78a9-bda4-4fb3-b263-f8a3a270c215" (UID: "09ed78a9-bda4-4fb3-b263-f8a3a270c215"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:25:31.713693 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.713666    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-kube-api-access-5ckl2" (OuterVolumeSpecName: "kube-api-access-5ckl2") pod "09ed78a9-bda4-4fb3-b263-f8a3a270c215" (UID: "09ed78a9-bda4-4fb3-b263-f8a3a270c215"). InnerVolumeSpecName "kube-api-access-5ckl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:25:31.713784 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.713694    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09ed78a9-bda4-4fb3-b263-f8a3a270c215" (UID: "09ed78a9-bda4-4fb3-b263-f8a3a270c215"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:25:31.713919 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.713904    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09ed78a9-bda4-4fb3-b263-f8a3a270c215" (UID: "09ed78a9-bda4-4fb3-b263-f8a3a270c215"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:25:31.713983 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.713961    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-token" (OuterVolumeSpecName: "istio-token") pod "09ed78a9-bda4-4fb3-b263-f8a3a270c215" (UID: "09ed78a9-bda4-4fb3-b263-f8a3a270c215"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:25:31.812750 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.812713    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:25:31.812750 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.812744    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ckl2\" (UniqueName: \"kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-kube-api-access-5ckl2\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:25:31.812750 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.812754    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:25:31.812982 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.812763    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:25:31.812982 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.812772    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:25:31.812982 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.812779    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:25:31.812982 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.812786    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:25:31.812982 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.812794    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ed78a9-bda4-4fb3-b263-f8a3a270c215-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:25:31.812982 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:31.812802    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ed78a9-bda4-4fb3-b263-f8a3a270c215-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:25:32.267337 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.267306    2576 generic.go:356] "Generic (PLEG): container finished" podID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerID="ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc" exitCode=0
Jul 22 03:25:32.267521 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.267357    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"
Jul 22 03:25:32.267521 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.267409    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" event={"ID":"09ed78a9-bda4-4fb3-b263-f8a3a270c215","Type":"ContainerDied","Data":"ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc"}
Jul 22 03:25:32.267521 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.267468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8" event={"ID":"09ed78a9-bda4-4fb3-b263-f8a3a270c215","Type":"ContainerDied","Data":"f123ee0ad394d925a99d8dc4b201134398a469df6d81704c9a13acd1698525f1"}
Jul 22 03:25:32.267521 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.267492    2576 scope.go:117] "RemoveContainer" containerID="ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc"
Jul 22 03:25:32.279076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.279049    2576 scope.go:117] "RemoveContainer" containerID="e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687"
Jul 22 03:25:32.286091 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.286063    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"]
Jul 22 03:25:32.287286 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.287268    2576 scope.go:117] "RemoveContainer" containerID="ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc"
Jul 22 03:25:32.287601 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:25:32.287579    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc\": container with ID starting with ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc not found: ID does not exist" containerID="ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc"
Jul 22 03:25:32.287672 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.287612    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc"} err="failed to get container status \"ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc\": rpc error: code = NotFound desc = could not find container \"ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc\": container with ID starting with ffa015222d77822f354fb50bcc91057ff022bb012976669f539a8b5c3ad9b0cc not found: ID does not exist"
Jul 22 03:25:32.287672 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.287633    2576 scope.go:117] "RemoveContainer" containerID="e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687"
Jul 22 03:25:32.287926 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:25:32.287904    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687\": container with ID starting with e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687 not found: ID does not exist" containerID="e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687"
Jul 22 03:25:32.287984 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.287931    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687"} err="failed to get container status \"e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687\": rpc error: code = NotFound desc = could not find container \"e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687\": container with ID starting with e63f995d1d75b713c047ee86c6c5af19a4f078e121568994bbaf1ca6ed1d1687 not found: ID does not exist"
Jul 22 03:25:32.292993 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:32.292971    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0c81ed29-openshift-default-846cf8b8c5-9mqb8"]
Jul 22 03:25:34.183126 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:34.183090    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" path="/var/lib/kubelet/pods/09ed78a9-bda4-4fb3-b263-f8a3a270c215/volumes"
Jul 22 03:25:44.585171 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:44.583942    2576 patch_prober.go:28] interesting pod/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": read tcp 10.133.0.2:39594->10.133.0.35:15021: read: connection reset by peer" start-of-body=
Jul 22 03:25:44.585171 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:44.584007    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": read tcp 10.133.0.2:39594->10.133.0.35:15021: read: connection reset by peer"
Jul 22 03:25:45.330742 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:45.330706    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerID="c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4" exitCode=0
Jul 22 03:25:45.330917 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:45.330750    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" event={"ID":"f8c9b8cb-79ca-492b-85b5-ca77e6caa280","Type":"ContainerDied","Data":"c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4"}
Jul 22 03:25:45.331109 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:45.331096    2576 scope.go:117] "RemoveContainer" containerID="c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4"
Jul 22 03:25:45.332039 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:45.332014    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:25:45.332093 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:45.332078    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:25:45.332127 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:45.332110    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:25:46.340941 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:46.340898    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" event={"ID":"f8c9b8cb-79ca-492b-85b5-ca77e6caa280","Type":"ContainerStarted","Data":"e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d"}
Jul 22 03:25:46.774297 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:46.774254    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:46.774653 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:46.774627    2576 patch_prober.go:28] interesting pod/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 22 03:25:46.774700 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:46.774685    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 22 03:25:47.773698 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:47.773656    2576 patch_prober.go:28] interesting pod/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 22 03:25:47.774112 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:47.773722    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 22 03:25:48.773866 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:48.773824    2576 patch_prober.go:28] interesting pod/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 22 03:25:48.774270 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:48.773888    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 22 03:25:49.774218 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:49.774180    2576 patch_prober.go:28] interesting pod/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 22 03:25:49.774664 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:49.774238    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 22 03:25:50.777591 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:50.777561    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:50.777982 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:50.777922    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:25:50.778537 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:25:50.778515    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:26:10.089338 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:10.089304    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"]
Jul 22 03:26:10.089772 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:10.089652    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy" containerID="cri-o://e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d" gracePeriod=30
Jul 22 03:26:10.913334 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:10.913303    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"]
Jul 22 03:26:10.913642 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:10.913628    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerName="istio-proxy"
Jul 22 03:26:10.913687 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:10.913643    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerName="istio-proxy"
Jul 22 03:26:10.913721 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:10.913708    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerName="istio-proxy"
Jul 22 03:26:10.913721 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:10.913717    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerName="istio-proxy"
Jul 22 03:26:10.917700 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:10.917681    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:10.920595 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:10.920574    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-67a1aa21-openshift-default-dockercfg-wkv9r\""
Jul 22 03:26:10.929354 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:10.929329    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"]
Jul 22 03:26:11.060184 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.060128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-podinfo\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.060184 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.060190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-token\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.060486 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.060237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-data\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.060486 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.060273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5mt5\" (UniqueName: \"kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-kube-api-access-t5mt5\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.060486 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.060311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-envoy\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.060486 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.060331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-certs\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.060486 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.060355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istiod-ca-cert\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.060486 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.060437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-socket\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.060486 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.060468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-credential-socket\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.161734 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.161679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5mt5\" (UniqueName: \"kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-kube-api-access-t5mt5\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.161734 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.161743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-envoy\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162296 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.161768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-certs\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162296 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.161793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istiod-ca-cert\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162296 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.161816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-socket\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162296 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.161831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-credential-socket\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162296 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.161867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-podinfo\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162296 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.161899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-token\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162296 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.161939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-data\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162647 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.162368    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-data\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162647 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.162368    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-certs\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162647 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.162444    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-socket\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162647 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.162623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-credential-socket\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.162781 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.162717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istiod-ca-cert\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.164117 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.164064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-envoy\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.164412 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.164379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-podinfo\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.173715 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.173685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-token\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.173999 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.173977    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5mt5\" (UniqueName: \"kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-kube-api-access-t5mt5\") pod \"e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") " pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.228138 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.228098    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:11.363366 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.363326    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"]
Jul 22 03:26:11.366490 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:26:11.366462    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8980423_6ca8_408d_bf4c_48b927fe8ca1.slice/crio-4852c938caeae7417062f196040c96ad0185ae978e6901ccfc9474b6cef319ca WatchSource:0}: Error finding container 4852c938caeae7417062f196040c96ad0185ae978e6901ccfc9474b6cef319ca: Status 404 returned error can't find the container with id 4852c938caeae7417062f196040c96ad0185ae978e6901ccfc9474b6cef319ca
Jul 22 03:26:11.368650 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.368619    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:26:11.368726 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.368689    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:26:11.368726 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.368719    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:26:11.456933 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.456899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" event={"ID":"c8980423-6ca8-408d-bf4c-48b927fe8ca1","Type":"ContainerStarted","Data":"8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698"}
Jul 22 03:26:11.457326 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.456959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" event={"ID":"c8980423-6ca8-408d-bf4c-48b927fe8ca1","Type":"ContainerStarted","Data":"4852c938caeae7417062f196040c96ad0185ae978e6901ccfc9474b6cef319ca"}
Jul 22 03:26:11.481236 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:11.481169    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" podStartSLOduration=1.481149396 podStartE2EDuration="1.481149396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:26:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:26:11.479875211 +0000 UTC m=+1685.366003361" watchObservedRunningTime="2026-07-22 03:26:11.481149396 +0000 UTC m=+1685.367277537"
Jul 22 03:26:12.228376 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:12.228340    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:12.233811 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:12.233786    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:12.462141 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:12.462105    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:12.463096 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:12.463075    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:15.340388 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.340362    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:26:15.475307 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.475273    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerID="e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d" exitCode=0
Jul 22 03:26:15.475520 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.475325    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"
Jul 22 03:26:15.475520 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.475364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" event={"ID":"f8c9b8cb-79ca-492b-85b5-ca77e6caa280","Type":"ContainerDied","Data":"e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d"}
Jul 22 03:26:15.475520 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.475447    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4" event={"ID":"f8c9b8cb-79ca-492b-85b5-ca77e6caa280","Type":"ContainerDied","Data":"b3a6171f1ae65e0e6a283ccc89e40a64f091383965e1be553e57748631c52fd0"}
Jul 22 03:26:15.475520 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.475474    2576 scope.go:117] "RemoveContainer" containerID="e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d"
Jul 22 03:26:15.485253 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.485224    2576 scope.go:117] "RemoveContainer" containerID="c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4"
Jul 22 03:26:15.493102 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.493084    2576 scope.go:117] "RemoveContainer" containerID="e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d"
Jul 22 03:26:15.493389 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:26:15.493359    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d\": container with ID starting with e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d not found: ID does not exist" containerID="e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d"
Jul 22 03:26:15.493538 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.493390    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d"} err="failed to get container status \"e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d\": rpc error: code = NotFound desc = could not find container \"e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d\": container with ID starting with e7924a532fdea3b62bdf4c0802a59da00cd87278b32c40c57a0ad93052002b2d not found: ID does not exist"
Jul 22 03:26:15.493629 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.493544    2576 scope.go:117] "RemoveContainer" containerID="c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4"
Jul 22 03:26:15.493806 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:26:15.493788    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4\": container with ID starting with c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4 not found: ID does not exist" containerID="c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4"
Jul 22 03:26:15.493864 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.493815    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4"} err="failed to get container status \"c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4\": rpc error: code = NotFound desc = could not find container \"c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4\": container with ID starting with c1814040c81030391fea0b4b3f529f66135eb6eacefbde33a0e8c2475417a7e4 not found: ID does not exist"
Jul 22 03:26:15.500118 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500099    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-socket\") pod \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") "
Jul 22 03:26:15.500169 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500126    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-certs\") pod \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") "
Jul 22 03:26:15.500169 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500141    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-credential-socket\") pod \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") "
Jul 22 03:26:15.500243 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500169    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xstm2\" (UniqueName: \"kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-kube-api-access-xstm2\") pod \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") "
Jul 22 03:26:15.500243 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500221    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-envoy\") pod \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") "
Jul 22 03:26:15.500336 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500255    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-podinfo\") pod \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") "
Jul 22 03:26:15.500336 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500289    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-data\") pod \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") "
Jul 22 03:26:15.500458 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500418    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f8c9b8cb-79ca-492b-85b5-ca77e6caa280" (UID: "f8c9b8cb-79ca-492b-85b5-ca77e6caa280"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:26:15.500458 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500439    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istiod-ca-cert\") pod \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") "
Jul 22 03:26:15.500458 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500446    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f8c9b8cb-79ca-492b-85b5-ca77e6caa280" (UID: "f8c9b8cb-79ca-492b-85b5-ca77e6caa280"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:26:15.500615 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500465    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f8c9b8cb-79ca-492b-85b5-ca77e6caa280" (UID: "f8c9b8cb-79ca-492b-85b5-ca77e6caa280"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:26:15.500615 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500547    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-token\") pod \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\" (UID: \"f8c9b8cb-79ca-492b-85b5-ca77e6caa280\") "
Jul 22 03:26:15.500741 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500715    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f8c9b8cb-79ca-492b-85b5-ca77e6caa280" (UID: "f8c9b8cb-79ca-492b-85b5-ca77e6caa280"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:26:15.500895 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500876    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:26:15.500895 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500897    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:26:15.501041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500911    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:26:15.501041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.500923    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:26:15.501243 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.501220    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-data" (OuterVolumeSpecName: "istio-data") pod "f8c9b8cb-79ca-492b-85b5-ca77e6caa280" (UID: "f8c9b8cb-79ca-492b-85b5-ca77e6caa280"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:26:15.502485 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.502454    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f8c9b8cb-79ca-492b-85b5-ca77e6caa280" (UID: "f8c9b8cb-79ca-492b-85b5-ca77e6caa280"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:26:15.502622 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.502604    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-token" (OuterVolumeSpecName: "istio-token") pod "f8c9b8cb-79ca-492b-85b5-ca77e6caa280" (UID: "f8c9b8cb-79ca-492b-85b5-ca77e6caa280"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:26:15.502787 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.502766    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-kube-api-access-xstm2" (OuterVolumeSpecName: "kube-api-access-xstm2") pod "f8c9b8cb-79ca-492b-85b5-ca77e6caa280" (UID: "f8c9b8cb-79ca-492b-85b5-ca77e6caa280"). InnerVolumeSpecName "kube-api-access-xstm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:26:15.502862 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.502841    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f8c9b8cb-79ca-492b-85b5-ca77e6caa280" (UID: "f8c9b8cb-79ca-492b-85b5-ca77e6caa280"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:26:15.601755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.601713    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:26:15.601755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.601749    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:26:15.601755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.601758    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:26:15.601755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.601767    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:26:15.602017 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.601775    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xstm2\" (UniqueName: \"kubernetes.io/projected/f8c9b8cb-79ca-492b-85b5-ca77e6caa280-kube-api-access-xstm2\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:26:15.797093 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.797056    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"]
Jul 22 03:26:15.801709 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:15.801683    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-321cbb2c-gw-openshift-default-6885f9d48c-jzkt4"]
Jul 22 03:26:16.183532 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:16.183497    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" path="/var/lib/kubelet/pods/f8c9b8cb-79ca-492b-85b5-ca77e6caa280/volumes"
Jul 22 03:26:27.484887 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:27.483801    2576 patch_prober.go:28] interesting pod/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:45828->10.133.0.36:15021: read: connection reset by peer" start-of-body=
Jul 22 03:26:27.484887 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:27.483883    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:45828->10.133.0.36:15021: read: connection reset by peer"
Jul 22 03:26:27.529838 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:27.529805    2576 generic.go:356] "Generic (PLEG): container finished" podID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerID="8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698" exitCode=0
Jul 22 03:26:27.529997 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:27.529874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" event={"ID":"c8980423-6ca8-408d-bf4c-48b927fe8ca1","Type":"ContainerDied","Data":"8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698"}
Jul 22 03:26:27.530278 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:27.530265    2576 scope.go:117] "RemoveContainer" containerID="8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698"
Jul 22 03:26:27.531330 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:27.531299    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:26:27.531471 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:27.531387    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:26:27.531471 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:27.531461    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:26:28.538549 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:28.538448    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" event={"ID":"c8980423-6ca8-408d-bf4c-48b927fe8ca1","Type":"ContainerStarted","Data":"58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64"}
Jul 22 03:26:29.228418 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:29.228356    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:29.228759 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:29.228737    2576 patch_prober.go:28] interesting pod/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 22 03:26:29.228842 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:29.228782    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 22 03:26:30.228974 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:30.228940    2576 patch_prober.go:28] interesting pod/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 22 03:26:30.229498 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:30.228997    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 22 03:26:31.228587 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:31.228548    2576 patch_prober.go:28] interesting pod/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 22 03:26:31.228788 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:31.228610    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 22 03:26:32.228527 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:32.228484    2576 patch_prober.go:28] interesting pod/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 22 03:26:32.229032 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:32.228566    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 22 03:26:33.232248 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:33.232218    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:33.232653 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:33.232579    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:33.233347 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:33.233322    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:26:55.216041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:55.216001    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"]
Jul 22 03:26:55.216535 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:55.216207    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy" containerID="cri-o://58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64" gracePeriod=30
Jul 22 03:26:56.126165 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.126124    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"]
Jul 22 03:26:56.126497 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.126483    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy"
Jul 22 03:26:56.126545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.126499    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy"
Jul 22 03:26:56.126545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.126509    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerName="istio-proxy"
Jul 22 03:26:56.126545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.126515    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ed78a9-bda4-4fb3-b263-f8a3a270c215" containerName="istio-proxy"
Jul 22 03:26:56.126545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.126522    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy"
Jul 22 03:26:56.126545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.126528    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy"
Jul 22 03:26:56.126694 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.126572    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy"
Jul 22 03:26:56.129502 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.129486    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.132347 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.132324    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7df930d3-openshift-default-dockercfg-cj5gl\""
Jul 22 03:26:56.152684 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.152656    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"]
Jul 22 03:26:56.258684 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.258646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmrff\" (UniqueName: \"kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-kube-api-access-dmrff\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.259072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.258711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-certs\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.259072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.258764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-socket\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.259072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.258787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-podinfo\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.259072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.258824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-token\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.259072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.258863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d655c5-044c-4eba-af7e-7aca306f632d-istiod-ca-cert\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.259072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.258888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-envoy\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.259072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.258903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-data\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.259072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.258929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-credential-socket\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.359642 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.359599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-token\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.359843 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.359650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d655c5-044c-4eba-af7e-7aca306f632d-istiod-ca-cert\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.359843 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.359678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-envoy\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.359843 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.359700    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-data\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.359843 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.359730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-credential-socket\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.359843 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.359781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmrff\" (UniqueName: \"kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-kube-api-access-dmrff\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.359843 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.359835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-certs\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.360151 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.359878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-socket\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.360151 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.359905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-podinfo\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.360255 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.360190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-data\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.360345 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.360318    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-credential-socket\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.360487 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.360358    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-socket\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.360487 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.360369    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-certs\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.360624 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.360604    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d655c5-044c-4eba-af7e-7aca306f632d-istiod-ca-cert\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.361986 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.361963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-envoy\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.362432 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.362411    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-podinfo\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.379691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.379625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-token\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.379691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.379669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmrff\" (UniqueName: \"kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-kube-api-access-dmrff\") pod \"e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") " pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.439836 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.439795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:56.591182 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.591156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"]
Jul 22 03:26:56.592771 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:26:56.592745    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d655c5_044c_4eba_af7e_7aca306f632d.slice/crio-bba0fcd71fa96cd9d1315ff23702117cabbd45d5d47020dfe01695dd48478536 WatchSource:0}: Error finding container bba0fcd71fa96cd9d1315ff23702117cabbd45d5d47020dfe01695dd48478536: Status 404 returned error can't find the container with id bba0fcd71fa96cd9d1315ff23702117cabbd45d5d47020dfe01695dd48478536
Jul 22 03:26:56.594821 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.594791    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:26:56.594893 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.594854    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:26:56.594893 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.594880    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:26:56.669410 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.669360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" event={"ID":"c0d655c5-044c-4eba-af7e-7aca306f632d","Type":"ContainerStarted","Data":"ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33"}
Jul 22 03:26:56.669550 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.669444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" event={"ID":"c0d655c5-044c-4eba-af7e-7aca306f632d","Type":"ContainerStarted","Data":"bba0fcd71fa96cd9d1315ff23702117cabbd45d5d47020dfe01695dd48478536"}
Jul 22 03:26:56.696468 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:56.696391    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" podStartSLOduration=0.696373571 podStartE2EDuration="696.373571ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:26:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:26:56.695420185 +0000 UTC m=+1730.581548326" watchObservedRunningTime="2026-07-22 03:26:56.696373571 +0000 UTC m=+1730.582501711"
Jul 22 03:26:57.440222 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:57.440185    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:57.445202 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:57.445177    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:57.674341 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:57.674304    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:26:57.675230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:26:57.675210    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:27:00.467497 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.467473    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:27:00.600755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.600653    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-socket\") pod \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") "
Jul 22 03:27:00.600755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.600708    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-podinfo\") pod \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") "
Jul 22 03:27:00.600755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.600738    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-credential-socket\") pod \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") "
Jul 22 03:27:00.601041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.600788    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5mt5\" (UniqueName: \"kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-kube-api-access-t5mt5\") pod \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") "
Jul 22 03:27:00.601041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.600830    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-certs\") pod \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") "
Jul 22 03:27:00.601041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.600880    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-token\") pod \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") "
Jul 22 03:27:00.601041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.600900    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-envoy\") pod \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") "
Jul 22 03:27:00.601041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.600928    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-data\") pod \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") "
Jul 22 03:27:00.601041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.600964    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istiod-ca-cert\") pod \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\" (UID: \"c8980423-6ca8-408d-bf4c-48b927fe8ca1\") "
Jul 22 03:27:00.601041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.600991    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8980423-6ca8-408d-bf4c-48b927fe8ca1" (UID: "c8980423-6ca8-408d-bf4c-48b927fe8ca1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:27:00.601349 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.601053    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8980423-6ca8-408d-bf4c-48b927fe8ca1" (UID: "c8980423-6ca8-408d-bf4c-48b927fe8ca1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:27:00.601349 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.601211    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8980423-6ca8-408d-bf4c-48b927fe8ca1" (UID: "c8980423-6ca8-408d-bf4c-48b927fe8ca1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:27:00.601349 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.601278    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:00.601349 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.601295    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:00.601349 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.601308    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:00.601634 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.601393    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8980423-6ca8-408d-bf4c-48b927fe8ca1" (UID: "c8980423-6ca8-408d-bf4c-48b927fe8ca1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:27:00.601766 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.601748    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8980423-6ca8-408d-bf4c-48b927fe8ca1" (UID: "c8980423-6ca8-408d-bf4c-48b927fe8ca1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:27:00.603245 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.603223    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8980423-6ca8-408d-bf4c-48b927fe8ca1" (UID: "c8980423-6ca8-408d-bf4c-48b927fe8ca1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:27:00.603245 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.603227    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-kube-api-access-t5mt5" (OuterVolumeSpecName: "kube-api-access-t5mt5") pod "c8980423-6ca8-408d-bf4c-48b927fe8ca1" (UID: "c8980423-6ca8-408d-bf4c-48b927fe8ca1"). InnerVolumeSpecName "kube-api-access-t5mt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:27:00.603541 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.603522    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8980423-6ca8-408d-bf4c-48b927fe8ca1" (UID: "c8980423-6ca8-408d-bf4c-48b927fe8ca1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:27:00.603541 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.603523    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8980423-6ca8-408d-bf4c-48b927fe8ca1" (UID: "c8980423-6ca8-408d-bf4c-48b927fe8ca1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:27:00.693449 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.693408    2576 generic.go:356] "Generic (PLEG): container finished" podID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerID="58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64" exitCode=0
Jul 22 03:27:00.693615 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.693474    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"
Jul 22 03:27:00.693615 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.693488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" event={"ID":"c8980423-6ca8-408d-bf4c-48b927fe8ca1","Type":"ContainerDied","Data":"58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64"}
Jul 22 03:27:00.693615 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.693562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2" event={"ID":"c8980423-6ca8-408d-bf4c-48b927fe8ca1","Type":"ContainerDied","Data":"4852c938caeae7417062f196040c96ad0185ae978e6901ccfc9474b6cef319ca"}
Jul 22 03:27:00.693615 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.693583    2576 scope.go:117] "RemoveContainer" containerID="58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64"
Jul 22 03:27:00.701836 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.701812    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:00.701836 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.701832    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:00.702058 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.701841    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5mt5\" (UniqueName: \"kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-kube-api-access-t5mt5\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:00.702058 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.701852    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:00.702058 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.701860    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:00.702058 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.701867    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8980423-6ca8-408d-bf4c-48b927fe8ca1-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:00.702642 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.702626    2576 scope.go:117] "RemoveContainer" containerID="8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698"
Jul 22 03:27:00.710337 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.710318    2576 scope.go:117] "RemoveContainer" containerID="58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64"
Jul 22 03:27:00.710625 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:27:00.710604    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64\": container with ID starting with 58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64 not found: ID does not exist" containerID="58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64"
Jul 22 03:27:00.710685 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.710633    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64"} err="failed to get container status \"58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64\": rpc error: code = NotFound desc = could not find container \"58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64\": container with ID starting with 58dae291f884581fd5844b8c740660eb143dd29b0d62c1276651e7187762ae64 not found: ID does not exist"
Jul 22 03:27:00.710685 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.710650    2576 scope.go:117] "RemoveContainer" containerID="8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698"
Jul 22 03:27:00.710874 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:27:00.710856    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698\": container with ID starting with 8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698 not found: ID does not exist" containerID="8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698"
Jul 22 03:27:00.710915 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.710879    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698"} err="failed to get container status \"8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698\": rpc error: code = NotFound desc = could not find container \"8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698\": container with ID starting with 8d10b0dda334647c3f4a907af69c8c6fe81fbaef8891cab36265cd226f733698 not found: ID does not exist"
Jul 22 03:27:00.715357 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.715335    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"]
Jul 22 03:27:00.719589 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:00.719564    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-67a1aa21-openshift-default-994dbdb75-v5zr2"]
Jul 22 03:27:02.183683 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:02.183646    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" path="/var/lib/kubelet/pods/c8980423-6ca8-408d-bf4c-48b927fe8ca1/volumes"
Jul 22 03:27:12.675806 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:12.675765    2576 patch_prober.go:28] interesting pod/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 22 03:27:12.676221 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:12.675823    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 22 03:27:12.750161 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:12.750126    2576 generic.go:356] "Generic (PLEG): container finished" podID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerID="ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33" exitCode=0
Jul 22 03:27:12.750329 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:12.750200    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" event={"ID":"c0d655c5-044c-4eba-af7e-7aca306f632d","Type":"ContainerDied","Data":"ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33"}
Jul 22 03:27:12.750659 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:12.750644    2576 scope.go:117] "RemoveContainer" containerID="ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33"
Jul 22 03:27:12.751722 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:12.751692    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:27:12.751792 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:12.751777    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:27:12.751830 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:12.751814    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:27:13.758532 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:13.758494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" event={"ID":"c0d655c5-044c-4eba-af7e-7aca306f632d","Type":"ContainerStarted","Data":"598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c"}
Jul 22 03:27:14.441138 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:14.441046    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:27:14.441494 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:14.441468    2576 patch_prober.go:28] interesting pod/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 22 03:27:14.441697 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:14.441671    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 22 03:27:15.440671 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:15.440624    2576 patch_prober.go:28] interesting pod/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 22 03:27:15.441277 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:15.441240    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 22 03:27:16.440943 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:16.440903    2576 patch_prober.go:28] interesting pod/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 22 03:27:16.441754 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:16.441719    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 22 03:27:17.440893 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:17.440849    2576 patch_prober.go:28] interesting pod/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 22 03:27:17.441667 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:17.441219    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 22 03:27:18.444893 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:18.444856    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:27:18.445388 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:18.445135    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:27:18.445924 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:18.445908    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:27:38.375992 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:38.375953    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"]
Jul 22 03:27:38.376534 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:38.376173    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy" containerID="cri-o://598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c" gracePeriod=30
Jul 22 03:27:43.624942 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.624915    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:27:43.780014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.779984    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d655c5-044c-4eba-af7e-7aca306f632d-istiod-ca-cert\") pod \"c0d655c5-044c-4eba-af7e-7aca306f632d\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") "
Jul 22 03:27:43.780201 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780052    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-socket\") pod \"c0d655c5-044c-4eba-af7e-7aca306f632d\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") "
Jul 22 03:27:43.780201 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780075    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-data\") pod \"c0d655c5-044c-4eba-af7e-7aca306f632d\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") "
Jul 22 03:27:43.780201 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780099    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-credential-socket\") pod \"c0d655c5-044c-4eba-af7e-7aca306f632d\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") "
Jul 22 03:27:43.780201 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780119    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-podinfo\") pod \"c0d655c5-044c-4eba-af7e-7aca306f632d\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") "
Jul 22 03:27:43.780201 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780135    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-token\") pod \"c0d655c5-044c-4eba-af7e-7aca306f632d\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") "
Jul 22 03:27:43.780201 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780176    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmrff\" (UniqueName: \"kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-kube-api-access-dmrff\") pod \"c0d655c5-044c-4eba-af7e-7aca306f632d\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") "
Jul 22 03:27:43.780541 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780218    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-envoy\") pod \"c0d655c5-044c-4eba-af7e-7aca306f632d\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") "
Jul 22 03:27:43.780541 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780286    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-certs\") pod \"c0d655c5-044c-4eba-af7e-7aca306f632d\" (UID: \"c0d655c5-044c-4eba-af7e-7aca306f632d\") "
Jul 22 03:27:43.780541 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780428    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d655c5-044c-4eba-af7e-7aca306f632d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0d655c5-044c-4eba-af7e-7aca306f632d" (UID: "c0d655c5-044c-4eba-af7e-7aca306f632d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:27:43.780541 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780414    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0d655c5-044c-4eba-af7e-7aca306f632d" (UID: "c0d655c5-044c-4eba-af7e-7aca306f632d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:27:43.780541 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780471    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0d655c5-044c-4eba-af7e-7aca306f632d" (UID: "c0d655c5-044c-4eba-af7e-7aca306f632d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:27:43.780778 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780585    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d655c5-044c-4eba-af7e-7aca306f632d-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:43.780778 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780603    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:43.780778 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780616    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:43.780778 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.780625    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0d655c5-044c-4eba-af7e-7aca306f632d" (UID: "c0d655c5-044c-4eba-af7e-7aca306f632d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:27:43.781069 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.781042    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0d655c5-044c-4eba-af7e-7aca306f632d" (UID: "c0d655c5-044c-4eba-af7e-7aca306f632d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:27:43.782566 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.782534    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0d655c5-044c-4eba-af7e-7aca306f632d" (UID: "c0d655c5-044c-4eba-af7e-7aca306f632d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:27:43.782566 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.782563    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0d655c5-044c-4eba-af7e-7aca306f632d" (UID: "c0d655c5-044c-4eba-af7e-7aca306f632d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:27:43.782712 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.782578    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0d655c5-044c-4eba-af7e-7aca306f632d" (UID: "c0d655c5-044c-4eba-af7e-7aca306f632d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:27:43.782712 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.782668    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-kube-api-access-dmrff" (OuterVolumeSpecName: "kube-api-access-dmrff") pod "c0d655c5-044c-4eba-af7e-7aca306f632d" (UID: "c0d655c5-044c-4eba-af7e-7aca306f632d"). InnerVolumeSpecName "kube-api-access-dmrff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:27:43.881536 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.881503    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:43.881536 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.881532    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:43.881536 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.881544    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:43.881783 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.881557    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmrff\" (UniqueName: \"kubernetes.io/projected/c0d655c5-044c-4eba-af7e-7aca306f632d-kube-api-access-dmrff\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:43.881783 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.881572    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:43.881783 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.881584    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d655c5-044c-4eba-af7e-7aca306f632d-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:27:43.886329 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.886299    2576 generic.go:356] "Generic (PLEG): container finished" podID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerID="598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c" exitCode=0
Jul 22 03:27:43.886523 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.886344    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"
Jul 22 03:27:43.886523 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.886382    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" event={"ID":"c0d655c5-044c-4eba-af7e-7aca306f632d","Type":"ContainerDied","Data":"598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c"}
Jul 22 03:27:43.886523 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.886454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw" event={"ID":"c0d655c5-044c-4eba-af7e-7aca306f632d","Type":"ContainerDied","Data":"bba0fcd71fa96cd9d1315ff23702117cabbd45d5d47020dfe01695dd48478536"}
Jul 22 03:27:43.886523 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.886478    2576 scope.go:117] "RemoveContainer" containerID="598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c"
Jul 22 03:27:43.895520 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.895504    2576 scope.go:117] "RemoveContainer" containerID="ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33"
Jul 22 03:27:43.903536 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.903501    2576 scope.go:117] "RemoveContainer" containerID="598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c"
Jul 22 03:27:43.903827 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:27:43.903808    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c\": container with ID starting with 598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c not found: ID does not exist" containerID="598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c"
Jul 22 03:27:43.903876 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.903836    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c"} err="failed to get container status \"598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c\": rpc error: code = NotFound desc = could not find container \"598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c\": container with ID starting with 598fdd6676da1720d4ee57d41dfcbd1857fe710ef63b354d3ce271b2d73e1e3c not found: ID does not exist"
Jul 22 03:27:43.903876 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.903854    2576 scope.go:117] "RemoveContainer" containerID="ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33"
Jul 22 03:27:43.904134 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:27:43.904116    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33\": container with ID starting with ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33 not found: ID does not exist" containerID="ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33"
Jul 22 03:27:43.904195 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.904144    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33"} err="failed to get container status \"ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33\": rpc error: code = NotFound desc = could not find container \"ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33\": container with ID starting with ce531afedaf1907faee82c60305f323f2a7ff9246cc4de15d55b387587cbae33 not found: ID does not exist"
Jul 22 03:27:43.916348 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.916314    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"]
Jul 22 03:27:43.932009 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:43.931984    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7df930d3-openshift-default-7fdf8747c9-lkhvw"]
Jul 22 03:27:44.187446 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:27:44.187410    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" path="/var/lib/kubelet/pods/c0d655c5-044c-4eba-af7e-7aca306f632d/volumes"
Jul 22 03:29:23.700361 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700324    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"]
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700666    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700679    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700690    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700695    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700706    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700712    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700724    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700730    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700777    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c9b8cb-79ca-492b-85b5-ca77e6caa280" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700785    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700791    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy"
Jul 22 03:29:23.701003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.700798    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d655c5-044c-4eba-af7e-7aca306f632d" containerName="istio-proxy"
Jul 22 03:29:23.703690 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.703668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.706580 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.706552    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fe15ed44-openshift-default-dockercfg-xh54z\""
Jul 22 03:29:23.756101 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.756063    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"]
Jul 22 03:29:23.856031 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.855978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-socket\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.856031 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.856018    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-credential-socket\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.856304 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.856048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istiod-ca-cert\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.856304 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.856117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-envoy\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.856304 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.856182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-podinfo\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.856304 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.856221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-certs\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.856304 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.856249    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-data\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.856304 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.856278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pc62\" (UniqueName: \"kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-kube-api-access-5pc62\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.856665 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.856314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-token\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.956980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-envoy\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.957024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-podinfo\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.957044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-certs\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.957078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-data\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957438 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.957117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pc62\" (UniqueName: \"kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-kube-api-access-5pc62\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957438 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.957154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-token\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957438 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.957233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-socket\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957438 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.957261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-credential-socket\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957438 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.957299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istiod-ca-cert\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957698 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.957570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-certs\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.957822 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.957801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-data\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.958240 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.958092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-socket\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.958240 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.958125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istiod-ca-cert\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.958240 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.958189    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-credential-socket\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.959616 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.959583    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-envoy\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.959866 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.959849    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-podinfo\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.966214 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.966192    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pc62\" (UniqueName: \"kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-kube-api-access-5pc62\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:23.966307 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:23.966275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-token\") pod \"e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") " pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:24.014674 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:24.014634    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:24.174118 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:24.174089    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"]
Jul 22 03:29:24.177472 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:29:24.177432    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb4ffb5_3a59_4062_b0a4_22cf51f5721b.slice/crio-9274b1e08ad73c29e2e350f20cff672245693e68af5b5fef31f3e1fcf88b7214 WatchSource:0}: Error finding container 9274b1e08ad73c29e2e350f20cff672245693e68af5b5fef31f3e1fcf88b7214: Status 404 returned error can't find the container with id 9274b1e08ad73c29e2e350f20cff672245693e68af5b5fef31f3e1fcf88b7214
Jul 22 03:29:24.180162 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:24.180121    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:29:24.180285 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:24.180214    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:29:24.180285 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:24.180253    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:29:24.305203 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:24.305161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" event={"ID":"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b","Type":"ContainerStarted","Data":"102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1"}
Jul 22 03:29:24.305388 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:24.305241    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" event={"ID":"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b","Type":"ContainerStarted","Data":"9274b1e08ad73c29e2e350f20cff672245693e68af5b5fef31f3e1fcf88b7214"}
Jul 22 03:29:24.341817 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:24.341750    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" podStartSLOduration=1.341730327 podStartE2EDuration="1.341730327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:29:24.340495614 +0000 UTC m=+1878.226623753" watchObservedRunningTime="2026-07-22 03:29:24.341730327 +0000 UTC m=+1878.227858469"
Jul 22 03:29:25.014830 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:25.014792    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:25.019977 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:25.019947    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:25.310749 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:25.310645    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:25.311768 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:25.311740    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:41.351621 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:41.351572    2576 patch_prober.go:28] interesting pod/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 22 03:29:41.352018 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:41.351648    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 22 03:29:43.388259 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:43.388225    2576 generic.go:356] "Generic (PLEG): container finished" podID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerID="102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1" exitCode=0
Jul 22 03:29:43.388715 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:43.388293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" event={"ID":"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b","Type":"ContainerDied","Data":"102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1"}
Jul 22 03:29:43.388715 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:43.388699    2576 scope.go:117] "RemoveContainer" containerID="102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1"
Jul 22 03:29:43.392322 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:43.392283    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:29:43.392475 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:43.392381    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:29:43.392530 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:43.392501    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:29:44.394687 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:44.394646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" event={"ID":"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b","Type":"ContainerStarted","Data":"3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599"}
Jul 22 03:29:45.015154 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:45.015113    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:45.015386 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:45.015365    2576 patch_prober.go:28] interesting pod/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 22 03:29:45.015466 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:45.015445    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 22 03:29:46.015164 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:46.015128    2576 patch_prober.go:28] interesting pod/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 22 03:29:46.015594 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:46.015187    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 22 03:29:47.015604 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:47.015561    2576 patch_prober.go:28] interesting pod/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 22 03:29:47.016065 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:47.015622    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 22 03:29:48.015788 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:48.015749    2576 patch_prober.go:28] interesting pod/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 22 03:29:48.016259 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:48.015806    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 22 03:29:49.018509 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:49.018477    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:49.018949 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:49.018743    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:29:49.019432 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:29:49.019417    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:30:00.915779 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:00.915745    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"]
Jul 22 03:30:00.916298 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:00.915968    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy" containerID="cri-o://3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599" gracePeriod=30
Jul 22 03:30:04.021952 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:04.021910    2576 patch_prober.go:28] interesting pod/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 22 03:30:04.022344 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:04.021974    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 03:30:06.168241 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.168214    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:30:06.339523 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.339433    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-data\") pod \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") "
Jul 22 03:30:06.339523 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.339492    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-podinfo\") pod \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") "
Jul 22 03:30:06.339523 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.339510    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pc62\" (UniqueName: \"kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-kube-api-access-5pc62\") pod \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") "
Jul 22 03:30:06.339804 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.339537    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istiod-ca-cert\") pod \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") "
Jul 22 03:30:06.339804 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.339574    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-token\") pod \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") "
Jul 22 03:30:06.339804 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.339602    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-certs\") pod \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") "
Jul 22 03:30:06.339804 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.339694    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-envoy\") pod \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") "
Jul 22 03:30:06.340224 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.340198    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-socket\") pod \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") "
Jul 22 03:30:06.340311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.340242    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" (UID: "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:30:06.340311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.340258    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-credential-socket\") pod \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\" (UID: \"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b\") "
Jul 22 03:30:06.340311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.340278    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" (UID: "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:30:06.340500 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.340365    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-data" (OuterVolumeSpecName: "istio-data") pod "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" (UID: "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:30:06.340586 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.340531    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" (UID: "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:30:06.340861 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.340823    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" (UID: "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:30:06.342494 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.341175    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:30:06.342494 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.341205    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:30:06.342494 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.341219    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:30:06.342494 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.341232    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:30:06.342494 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.341245    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:30:06.342829 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.342619    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-kube-api-access-5pc62" (OuterVolumeSpecName: "kube-api-access-5pc62") pod "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" (UID: "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b"). InnerVolumeSpecName "kube-api-access-5pc62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:30:06.343063 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.343024    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" (UID: "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:30:06.347269 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.343265    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-token" (OuterVolumeSpecName: "istio-token") pod "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" (UID: "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:30:06.347269 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.343509    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" (UID: "2fb4ffb5-3a59-4062-b0a4-22cf51f5721b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:30:06.441875 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.441837    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:30:06.441875 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.441869    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pc62\" (UniqueName: \"kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-kube-api-access-5pc62\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:30:06.441875 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.441879    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:30:06.442114 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.441888    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:30:06.487604 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.487571    2576 generic.go:356] "Generic (PLEG): container finished" podID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerID="3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599" exitCode=0
Jul 22 03:30:06.487807 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.487650    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"
Jul 22 03:30:06.487807 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.487657    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" event={"ID":"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b","Type":"ContainerDied","Data":"3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599"}
Jul 22 03:30:06.487807 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.487746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr" event={"ID":"2fb4ffb5-3a59-4062-b0a4-22cf51f5721b","Type":"ContainerDied","Data":"9274b1e08ad73c29e2e350f20cff672245693e68af5b5fef31f3e1fcf88b7214"}
Jul 22 03:30:06.487807 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.487771    2576 scope.go:117] "RemoveContainer" containerID="3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599"
Jul 22 03:30:06.496965 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.496804    2576 scope.go:117] "RemoveContainer" containerID="102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1"
Jul 22 03:30:06.505237 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.505218    2576 scope.go:117] "RemoveContainer" containerID="3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599"
Jul 22 03:30:06.505525 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:30:06.505507    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599\": container with ID starting with 3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599 not found: ID does not exist" containerID="3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599"
Jul 22 03:30:06.505591 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.505534    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599"} err="failed to get container status \"3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599\": rpc error: code = NotFound desc = could not find container \"3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599\": container with ID starting with 3e148b27a7555eba483bed2526ca94b59732613ee96e51af60551ac882751599 not found: ID does not exist"
Jul 22 03:30:06.505591 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.505552    2576 scope.go:117] "RemoveContainer" containerID="102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1"
Jul 22 03:30:06.505808 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:30:06.505789    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1\": container with ID starting with 102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1 not found: ID does not exist" containerID="102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1"
Jul 22 03:30:06.505858 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.505814    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1"} err="failed to get container status \"102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1\": rpc error: code = NotFound desc = could not find container \"102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1\": container with ID starting with 102d054256a30a2dfba849b4aeaa92d93a9390f94429e29ec6fe1f618f2e01c1 not found: ID does not exist"
Jul 22 03:30:06.510918 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.510886    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"]
Jul 22 03:30:06.513214 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:06.513194    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fe15ed44-openshift-default-68f4969567-c5rfr"]
Jul 22 03:30:08.184841 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:08.184810    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" path="/var/lib/kubelet/pods/2fb4ffb5-3a59-4062-b0a4-22cf51f5721b/volumes"
Jul 22 03:30:21.638778 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.638741    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"]
Jul 22 03:30:21.639163 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.639030    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy"
Jul 22 03:30:21.639163 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.639042    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy"
Jul 22 03:30:21.639163 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.639056    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy"
Jul 22 03:30:21.639163 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.639061    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy"
Jul 22 03:30:21.639163 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.639117    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy"
Jul 22 03:30:21.639163 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.639124    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fb4ffb5-3a59-4062-b0a4-22cf51f5721b" containerName="istio-proxy"
Jul 22 03:30:21.639163 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.639131    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8980423-6ca8-408d-bf4c-48b927fe8ca1" containerName="istio-proxy"
Jul 22 03:30:21.642077 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.642054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.644460 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.644438    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-017b0f74-openshift-default-dockercfg-5n2rx\""
Jul 22 03:30:21.653231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.653207    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"]
Jul 22 03:30:21.670597 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.670566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-data\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.670756 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.670604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f79766f-cfc1-47b1-9a13-82ff37371362-istiod-ca-cert\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.670756 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.670630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-credential-socket\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.670756 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.670696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-socket\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.670890 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.670762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-certs\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.670890 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.670789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-token\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.670890 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.670813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-podinfo\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.670890 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.670835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srg8h\" (UniqueName: \"kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-kube-api-access-srg8h\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.671056 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.670896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-envoy\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772123 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-data\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772123 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f79766f-cfc1-47b1-9a13-82ff37371362-istiod-ca-cert\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772381 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-credential-socket\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772381 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-socket\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772381 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-certs\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772381 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-token\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772381 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-podinfo\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772381 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srg8h\" (UniqueName: \"kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-kube-api-access-srg8h\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772381 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-envoy\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772795 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772610    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-credential-socket\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772795 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-socket\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772904 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-data\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.772904 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.772842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-certs\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.773026 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.773008    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f79766f-cfc1-47b1-9a13-82ff37371362-istiod-ca-cert\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.774625 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.774594    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-envoy\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.774895 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.774878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-podinfo\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.780162 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.780135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srg8h\" (UniqueName: \"kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-kube-api-access-srg8h\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.780245 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.780184    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-token\") pod \"e2e-mt-017b0f74-openshift-default-78567bf775-95r64\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") " pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:21.951825 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:21.951784    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:22.085947 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:22.085913    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"]
Jul 22 03:30:22.089235 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:30:22.089205    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f79766f_cfc1_47b1_9a13_82ff37371362.slice/crio-1dd259f92e092fed99ff6a2247d0add6649da4f6279364cbf7ffddb90914db34 WatchSource:0}: Error finding container 1dd259f92e092fed99ff6a2247d0add6649da4f6279364cbf7ffddb90914db34: Status 404 returned error can't find the container with id 1dd259f92e092fed99ff6a2247d0add6649da4f6279364cbf7ffddb90914db34
Jul 22 03:30:22.091973 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:22.091937    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:30:22.092090 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:22.092017    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:30:22.092090 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:22.092063    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:30:22.556372 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:22.556341    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" event={"ID":"0f79766f-cfc1-47b1-9a13-82ff37371362","Type":"ContainerStarted","Data":"9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507"}
Jul 22 03:30:22.556580 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:22.556390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" event={"ID":"0f79766f-cfc1-47b1-9a13-82ff37371362","Type":"ContainerStarted","Data":"1dd259f92e092fed99ff6a2247d0add6649da4f6279364cbf7ffddb90914db34"}
Jul 22 03:30:22.577125 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:22.577071    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" podStartSLOduration=1.5770552009999999 podStartE2EDuration="1.577055201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:30:22.576033972 +0000 UTC m=+1936.462162112" watchObservedRunningTime="2026-07-22 03:30:22.577055201 +0000 UTC m=+1936.463183341"
Jul 22 03:30:22.952691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:22.952654    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:23.957734 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:23.957698    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:24.565470 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:24.565429    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:24.566451 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:24.566424    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:36.096120 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.096078    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"]
Jul 22 03:30:36.100586 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.100560    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.102904 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.102876    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-017b0f74\"/\"kube-root-ca.crt\""
Jul 22 03:30:36.103018 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.102991    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-017b0f74\"/\"openshift-service-ca.crt\""
Jul 22 03:30:36.103790 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.103766    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-017b0f74\"/\"default-dockercfg-lfbml\""
Jul 22 03:30:36.103790 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.103780    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-017b0f74\"/\"e2e-lifecycle-model-017b0f74-kserve-self-signed-certs\""
Jul 22 03:30:36.108275 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.108254    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"]
Jul 22 03:30:36.189308 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.189224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-home\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.189308 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.189262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-tmp-dir\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.189308 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.189284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-model-cache\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.189563 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.189388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-dshm\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.189563 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.189445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmg5v\" (UniqueName: \"kubernetes.io/projected/5a0dea39-1ad2-4a7f-9171-36851d42535d-kube-api-access-tmg5v\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.189636 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.189559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a0dea39-1ad2-4a7f-9171-36851d42535d-tls-certs\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.290606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.290557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-dshm\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.290809 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.290689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmg5v\" (UniqueName: \"kubernetes.io/projected/5a0dea39-1ad2-4a7f-9171-36851d42535d-kube-api-access-tmg5v\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.290809 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.290743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a0dea39-1ad2-4a7f-9171-36851d42535d-tls-certs\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.290809 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.290774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-home\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.290809 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.290805    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-tmp-dir\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.291037 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.290834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-model-cache\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.291226 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.291202    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-home\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.291309 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.291228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-tmp-dir\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.291309 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.291249    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-model-cache\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.293069 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.293040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-dshm\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.293222 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.293205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a0dea39-1ad2-4a7f-9171-36851d42535d-tls-certs\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.299801 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.299773    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmg5v\" (UniqueName: \"kubernetes.io/projected/5a0dea39-1ad2-4a7f-9171-36851d42535d-kube-api-access-tmg5v\") pod \"e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") " pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.410544 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.410506    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:36.559460 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.559432    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"]
Jul 22 03:30:36.561899 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:30:36.561865    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a0dea39_1ad2_4a7f_9171_36851d42535d.slice/crio-a095d4da28f2e96bd3fddbffea51c39dca101c351acd24f8f1a653131e9e73dc WatchSource:0}: Error finding container a095d4da28f2e96bd3fddbffea51c39dca101c351acd24f8f1a653131e9e73dc: Status 404 returned error can't find the container with id a095d4da28f2e96bd3fddbffea51c39dca101c351acd24f8f1a653131e9e73dc
Jul 22 03:30:36.617003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:36.616971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn" event={"ID":"5a0dea39-1ad2-4a7f-9171-36851d42535d","Type":"ContainerStarted","Data":"a095d4da28f2e96bd3fddbffea51c39dca101c351acd24f8f1a653131e9e73dc"}
Jul 22 03:30:37.623269 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:37.623227    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn" event={"ID":"5a0dea39-1ad2-4a7f-9171-36851d42535d","Type":"ContainerStarted","Data":"e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d"}
Jul 22 03:30:37.641718 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:37.641656    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn" podStartSLOduration=1.641634689 podStartE2EDuration="1.641634689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:30:37.641290132 +0000 UTC m=+1951.527418287" watchObservedRunningTime="2026-07-22 03:30:37.641634689 +0000 UTC m=+1951.527762829"
Jul 22 03:30:38.631274 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:38.631179    2576 generic.go:356] "Generic (PLEG): container finished" podID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerID="9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507" exitCode=0
Jul 22 03:30:38.631274 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:38.631251    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" event={"ID":"0f79766f-cfc1-47b1-9a13-82ff37371362","Type":"ContainerDied","Data":"9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507"}
Jul 22 03:30:38.631751 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:38.631694    2576 scope.go:117] "RemoveContainer" containerID="9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507"
Jul 22 03:30:38.632832 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:38.632802    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:30:38.632909 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:38.632884    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:30:38.632958 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:38.632941    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:30:39.565711 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:39.565666    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:39.640679 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:39.640622    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" event={"ID":"0f79766f-cfc1-47b1-9a13-82ff37371362","Type":"ContainerStarted","Data":"80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066"}
Jul 22 03:30:39.954197 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:39.954148    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:39.954450 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:39.954373    2576 patch_prober.go:28] interesting pod/e2e-mt-017b0f74-openshift-default-78567bf775-95r64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 22 03:30:39.954538 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:39.954447    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 22 03:30:40.952942 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:40.952899    2576 patch_prober.go:28] interesting pod/e2e-mt-017b0f74-openshift-default-78567bf775-95r64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 22 03:30:40.953594 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:40.953559    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 22 03:30:41.952524 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:41.952476    2576 patch_prober.go:28] interesting pod/e2e-mt-017b0f74-openshift-default-78567bf775-95r64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 22 03:30:41.952759 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:41.952551    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 22 03:30:42.952564 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:42.952526    2576 patch_prober.go:28] interesting pod/e2e-mt-017b0f74-openshift-default-78567bf775-95r64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 22 03:30:42.953175 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:42.953141    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 22 03:30:43.956039 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:43.956003    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:43.956496 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:43.956253    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:43.956924 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:43.956903    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:30:46.410871 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:46.410838    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:46.411386 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:46.411130    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:46.423199 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:46.423177    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:30:46.686149 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:30:46.686063    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:31:35.235986 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:35.235930    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"]
Jul 22 03:31:50.259151 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.259104    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn" podUID="5a0dea39-1ad2-4a7f-9171-36851d42535d" containerName="main" containerID="cri-o://e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d" gracePeriod=45
Jul 22 03:31:50.502107 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.502079    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:31:50.638432 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.638332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a0dea39-1ad2-4a7f-9171-36851d42535d-tls-certs\") pod \"5a0dea39-1ad2-4a7f-9171-36851d42535d\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") "
Jul 22 03:31:50.638432 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.638388    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-home\") pod \"5a0dea39-1ad2-4a7f-9171-36851d42535d\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") "
Jul 22 03:31:50.638691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.638462    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-dshm\") pod \"5a0dea39-1ad2-4a7f-9171-36851d42535d\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") "
Jul 22 03:31:50.638691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.638484    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-tmp-dir\") pod \"5a0dea39-1ad2-4a7f-9171-36851d42535d\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") "
Jul 22 03:31:50.638691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.638502    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-model-cache\") pod \"5a0dea39-1ad2-4a7f-9171-36851d42535d\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") "
Jul 22 03:31:50.638691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.638547    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmg5v\" (UniqueName: \"kubernetes.io/projected/5a0dea39-1ad2-4a7f-9171-36851d42535d-kube-api-access-tmg5v\") pod \"5a0dea39-1ad2-4a7f-9171-36851d42535d\" (UID: \"5a0dea39-1ad2-4a7f-9171-36851d42535d\") "
Jul 22 03:31:50.638878 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.638759    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-home" (OuterVolumeSpecName: "home") pod "5a0dea39-1ad2-4a7f-9171-36851d42535d" (UID: "5a0dea39-1ad2-4a7f-9171-36851d42535d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:31:50.638878 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.638794    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a0dea39-1ad2-4a7f-9171-36851d42535d" (UID: "5a0dea39-1ad2-4a7f-9171-36851d42535d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:31:50.638878 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.638826    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a0dea39-1ad2-4a7f-9171-36851d42535d" (UID: "5a0dea39-1ad2-4a7f-9171-36851d42535d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:31:50.640704 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.640677    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-dshm" (OuterVolumeSpecName: "dshm") pod "5a0dea39-1ad2-4a7f-9171-36851d42535d" (UID: "5a0dea39-1ad2-4a7f-9171-36851d42535d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:31:50.640825 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.640732    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a0dea39-1ad2-4a7f-9171-36851d42535d-kube-api-access-tmg5v" (OuterVolumeSpecName: "kube-api-access-tmg5v") pod "5a0dea39-1ad2-4a7f-9171-36851d42535d" (UID: "5a0dea39-1ad2-4a7f-9171-36851d42535d"). InnerVolumeSpecName "kube-api-access-tmg5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:31:50.640825 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.640752    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a0dea39-1ad2-4a7f-9171-36851d42535d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a0dea39-1ad2-4a7f-9171-36851d42535d" (UID: "5a0dea39-1ad2-4a7f-9171-36851d42535d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:31:50.739251 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.739208    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a0dea39-1ad2-4a7f-9171-36851d42535d-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:31:50.739251 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.739246    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:31:50.739251 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.739257    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:31:50.739545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.739268    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:31:50.739545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.739279    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a0dea39-1ad2-4a7f-9171-36851d42535d-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:31:50.739545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.739290    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmg5v\" (UniqueName: \"kubernetes.io/projected/5a0dea39-1ad2-4a7f-9171-36851d42535d-kube-api-access-tmg5v\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:31:50.957491 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.957456    2576 generic.go:356] "Generic (PLEG): container finished" podID="5a0dea39-1ad2-4a7f-9171-36851d42535d" containerID="e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d" exitCode=0
Jul 22 03:31:50.957673 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.957497    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"
Jul 22 03:31:50.957673 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.957545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn" event={"ID":"5a0dea39-1ad2-4a7f-9171-36851d42535d","Type":"ContainerDied","Data":"e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d"}
Jul 22 03:31:50.957673 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.957592    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn" event={"ID":"5a0dea39-1ad2-4a7f-9171-36851d42535d","Type":"ContainerDied","Data":"a095d4da28f2e96bd3fddbffea51c39dca101c351acd24f8f1a653131e9e73dc"}
Jul 22 03:31:50.957673 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.957615    2576 scope.go:117] "RemoveContainer" containerID="e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d"
Jul 22 03:31:50.966513 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.966490    2576 scope.go:117] "RemoveContainer" containerID="e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d"
Jul 22 03:31:50.966777 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:31:50.966757    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d\": container with ID starting with e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d not found: ID does not exist" containerID="e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d"
Jul 22 03:31:50.966836 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.966786    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d"} err="failed to get container status \"e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d\": rpc error: code = NotFound desc = could not find container \"e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d\": container with ID starting with e96a96798376eefb345cb0a44f33f31bec124f55f9306f715005280ce4aae82d not found: ID does not exist"
Jul 22 03:31:50.978334 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.978303    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"]
Jul 22 03:31:50.983515 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:50.983494    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-017b0f74/e2e-lifecycle-model-017b0f74-kserve-6c865cf447-28cmn"]
Jul 22 03:31:52.183153 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:31:52.183118    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a0dea39-1ad2-4a7f-9171-36851d42535d" path="/var/lib/kubelet/pods/5a0dea39-1ad2-4a7f-9171-36851d42535d/volumes"
Jul 22 03:32:18.564732 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:18.564687    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"]
Jul 22 03:32:18.565174 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:18.564960    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy" containerID="cri-o://80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066" gracePeriod=30
Jul 22 03:32:23.821337 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.821311    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:32:23.931973 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.931935    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-credential-socket\") pod \"0f79766f-cfc1-47b1-9a13-82ff37371362\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") "
Jul 22 03:32:23.931973 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.931973    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-socket\") pod \"0f79766f-cfc1-47b1-9a13-82ff37371362\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") "
Jul 22 03:32:23.932231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.932009    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-data\") pod \"0f79766f-cfc1-47b1-9a13-82ff37371362\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") "
Jul 22 03:32:23.932231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.932035    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-envoy\") pod \"0f79766f-cfc1-47b1-9a13-82ff37371362\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") "
Jul 22 03:32:23.932231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.932098    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f79766f-cfc1-47b1-9a13-82ff37371362-istiod-ca-cert\") pod \"0f79766f-cfc1-47b1-9a13-82ff37371362\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") "
Jul 22 03:32:23.932231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.932122    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-podinfo\") pod \"0f79766f-cfc1-47b1-9a13-82ff37371362\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") "
Jul 22 03:32:23.932231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.932145    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srg8h\" (UniqueName: \"kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-kube-api-access-srg8h\") pod \"0f79766f-cfc1-47b1-9a13-82ff37371362\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") "
Jul 22 03:32:23.932231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.932176    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-token\") pod \"0f79766f-cfc1-47b1-9a13-82ff37371362\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") "
Jul 22 03:32:23.932231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.932203    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-certs\") pod \"0f79766f-cfc1-47b1-9a13-82ff37371362\" (UID: \"0f79766f-cfc1-47b1-9a13-82ff37371362\") "
Jul 22 03:32:23.932870 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.932282    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f79766f-cfc1-47b1-9a13-82ff37371362" (UID: "0f79766f-cfc1-47b1-9a13-82ff37371362"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:32:23.933012 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.932875    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f79766f-cfc1-47b1-9a13-82ff37371362-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f79766f-cfc1-47b1-9a13-82ff37371362" (UID: "0f79766f-cfc1-47b1-9a13-82ff37371362"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:32:23.933216 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.933194    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f79766f-cfc1-47b1-9a13-82ff37371362" (UID: "0f79766f-cfc1-47b1-9a13-82ff37371362"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:32:23.933346 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.932266    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f79766f-cfc1-47b1-9a13-82ff37371362" (UID: "0f79766f-cfc1-47b1-9a13-82ff37371362"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:32:23.939421 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.933817    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f79766f-cfc1-47b1-9a13-82ff37371362-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:32:23.939421 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.933846    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:32:23.939421 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.933867    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:32:23.939421 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.933881    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:32:23.939421 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.937104    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f79766f-cfc1-47b1-9a13-82ff37371362" (UID: "0f79766f-cfc1-47b1-9a13-82ff37371362"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:32:23.941097 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.941070    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f79766f-cfc1-47b1-9a13-82ff37371362" (UID: "0f79766f-cfc1-47b1-9a13-82ff37371362"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:32:23.941628 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.941601    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-kube-api-access-srg8h" (OuterVolumeSpecName: "kube-api-access-srg8h") pod "0f79766f-cfc1-47b1-9a13-82ff37371362" (UID: "0f79766f-cfc1-47b1-9a13-82ff37371362"). InnerVolumeSpecName "kube-api-access-srg8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:32:23.941857 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.941833    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f79766f-cfc1-47b1-9a13-82ff37371362" (UID: "0f79766f-cfc1-47b1-9a13-82ff37371362"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:32:23.941911 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:23.941836    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f79766f-cfc1-47b1-9a13-82ff37371362" (UID: "0f79766f-cfc1-47b1-9a13-82ff37371362"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:32:24.035109 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.035065    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:32:24.035109 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.035104    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:32:24.035109 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.035112    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:32:24.035350 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.035122    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srg8h\" (UniqueName: \"kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-kube-api-access-srg8h\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:32:24.035350 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.035132    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f79766f-cfc1-47b1-9a13-82ff37371362-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:32:24.107217 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.107182    2576 generic.go:356] "Generic (PLEG): container finished" podID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerID="80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066" exitCode=0
Jul 22 03:32:24.107392 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.107247    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"
Jul 22 03:32:24.107392 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.107263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" event={"ID":"0f79766f-cfc1-47b1-9a13-82ff37371362","Type":"ContainerDied","Data":"80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066"}
Jul 22 03:32:24.107392 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.107348    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64" event={"ID":"0f79766f-cfc1-47b1-9a13-82ff37371362","Type":"ContainerDied","Data":"1dd259f92e092fed99ff6a2247d0add6649da4f6279364cbf7ffddb90914db34"}
Jul 22 03:32:24.107392 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.107373    2576 scope.go:117] "RemoveContainer" containerID="80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066"
Jul 22 03:32:24.116014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.115997    2576 scope.go:117] "RemoveContainer" containerID="9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507"
Jul 22 03:32:24.123511 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.123491    2576 scope.go:117] "RemoveContainer" containerID="80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066"
Jul 22 03:32:24.123753 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:32:24.123736    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066\": container with ID starting with 80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066 not found: ID does not exist" containerID="80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066"
Jul 22 03:32:24.123800 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.123764    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066"} err="failed to get container status \"80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066\": rpc error: code = NotFound desc = could not find container \"80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066\": container with ID starting with 80a6188c9e78ec3bc95bce9f2aef4d005d24341e5b0d4085fd1c3db3fd5bc066 not found: ID does not exist"
Jul 22 03:32:24.123800 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.123781    2576 scope.go:117] "RemoveContainer" containerID="9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507"
Jul 22 03:32:24.124024 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:32:24.124007    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507\": container with ID starting with 9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507 not found: ID does not exist" containerID="9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507"
Jul 22 03:32:24.124075 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.124033    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507"} err="failed to get container status \"9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507\": rpc error: code = NotFound desc = could not find container \"9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507\": container with ID starting with 9187400aa2323ef4f00e7c01b4307c43e36facc59fdb32affa995f714b3e1507 not found: ID does not exist"
Jul 22 03:32:24.130910 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.130889    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"]
Jul 22 03:32:24.134840 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.134816    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-017b0f74-openshift-default-78567bf775-95r64"]
Jul 22 03:32:24.182740 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:32:24.182668    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" path="/var/lib/kubelet/pods/0f79766f-cfc1-47b1-9a13-82ff37371362/volumes"
Jul 22 03:33:15.046372 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.046335    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"]
Jul 22 03:33:15.046786 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.046702    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0dea39-1ad2-4a7f-9171-36851d42535d" containerName="main"
Jul 22 03:33:15.046786 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.046715    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0dea39-1ad2-4a7f-9171-36851d42535d" containerName="main"
Jul 22 03:33:15.046786 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.046729    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy"
Jul 22 03:33:15.046786 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.046735    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy"
Jul 22 03:33:15.046916 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.046805    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a0dea39-1ad2-4a7f-9171-36851d42535d" containerName="main"
Jul 22 03:33:15.046916 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.046816    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy"
Jul 22 03:33:15.046916 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.046824    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy"
Jul 22 03:33:15.049605 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.049587    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.052023 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.051997    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-fd4878-openshift-default-dockercfg-jfscw\""
Jul 22 03:33:15.060431 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.060385    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"]
Jul 22 03:33:15.080362 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.080328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1107cee3-9f86-40f9-b563-d59335353e38-istio-podinfo\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.080557 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.080383    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-credential-socket\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.080557 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.080432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jsbf\" (UniqueName: \"kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-kube-api-access-9jsbf\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.080557 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.080468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-data\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.080557 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.080510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1107cee3-9f86-40f9-b563-d59335353e38-istiod-ca-cert\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.080557 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.080535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-envoy\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.080870 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.080568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-certs\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.080870 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.080596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-istio-token\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.080870 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.080673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-socket\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.181307 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.181266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-socket\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.181307 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.181310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1107cee3-9f86-40f9-b563-d59335353e38-istio-podinfo\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.181618 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.181339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-credential-socket\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.181618 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.181371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jsbf\" (UniqueName: \"kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-kube-api-access-9jsbf\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.181618 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.181425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-data\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.181618 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.181476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1107cee3-9f86-40f9-b563-d59335353e38-istiod-ca-cert\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.181618 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.181499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-envoy\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.181618 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.181531    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-certs\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.181618 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.181564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-istio-token\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.182031 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.182007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-socket\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.188743 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.182235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-data\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.188743 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.182292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-certs\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.188743 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.182349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-credential-socket\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.188743 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.182622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1107cee3-9f86-40f9-b563-d59335353e38-istiod-ca-cert\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.190449 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.190313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1107cee3-9f86-40f9-b563-d59335353e38-istio-podinfo\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.191243 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.191216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-envoy\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.192745 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.192724    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-istio-token\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.192981 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.192962    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jsbf\" (UniqueName: \"kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-kube-api-access-9jsbf\") pod \"e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") " pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.359951 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.359855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:15.502075 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.502042    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"]
Jul 22 03:33:15.505111 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:33:15.505084    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1107cee3_9f86_40f9_b563_d59335353e38.slice/crio-93953b8115325e86d7f347866d0c314e4541b8fdc8e2a173e3f2499c7b4958b1 WatchSource:0}: Error finding container 93953b8115325e86d7f347866d0c314e4541b8fdc8e2a173e3f2499c7b4958b1: Status 404 returned error can't find the container with id 93953b8115325e86d7f347866d0c314e4541b8fdc8e2a173e3f2499c7b4958b1
Jul 22 03:33:15.507685 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.507645    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:15.507768 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.507731    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:15.507806 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:15.507773    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:16.330682 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:16.330646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" event={"ID":"1107cee3-9f86-40f9-b563-d59335353e38","Type":"ContainerStarted","Data":"b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec"}
Jul 22 03:33:16.331108 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:16.330696    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" event={"ID":"1107cee3-9f86-40f9-b563-d59335353e38","Type":"ContainerStarted","Data":"93953b8115325e86d7f347866d0c314e4541b8fdc8e2a173e3f2499c7b4958b1"}
Jul 22 03:33:16.351465 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:16.351412    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" podStartSLOduration=1.351378887 podStartE2EDuration="1.351378887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:33:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:33:16.349769643 +0000 UTC m=+2110.235897784" watchObservedRunningTime="2026-07-22 03:33:16.351378887 +0000 UTC m=+2110.237507065"
Jul 22 03:33:16.359968 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:16.359943    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:16.365231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:16.365198    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:17.335686 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:17.335659    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:17.336568 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:17.336541    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:23.615821 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.615785    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"]
Jul 22 03:33:23.616197 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.616113    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy"
Jul 22 03:33:23.616197 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.616125    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f79766f-cfc1-47b1-9a13-82ff37371362" containerName="istio-proxy"
Jul 22 03:33:23.619294 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.619274    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.622104 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.622080    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-30704e-openshift-default-dockercfg-jxf2p\""
Jul 22 03:33:23.633530 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.633499    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"]
Jul 22 03:33:23.658044 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.658008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-certs\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.658044 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.658047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istiod-ca-cert\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.658300 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.658107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-envoy\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.658300 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.658167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-data\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.658300 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.658190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-credential-socket\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.658300 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.658216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-token\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.658300 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.658232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x6rb\" (UniqueName: \"kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-kube-api-access-2x6rb\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.658300 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.658294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-socket\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.658691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.658317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-podinfo\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.759622 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.759577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-token\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.759835 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.759629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x6rb\" (UniqueName: \"kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-kube-api-access-2x6rb\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.759835 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.759695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-socket\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.759835 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.759717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-podinfo\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.759835 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.759767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-certs\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.759835 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.759792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istiod-ca-cert\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.760093 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.759866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-envoy\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.760093 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.759896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-data\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.760093 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.759922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-credential-socket\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.760431 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.760382    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-credential-socket\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.760837 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.760806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-certs\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.760984 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.760961    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-socket\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.761057 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.761007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istiod-ca-cert\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.761121 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.761077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-data\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.762839 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.762812    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-envoy\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.763044 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.763027    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-podinfo\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.768433 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.768409    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-token\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.768542 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.768523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x6rb\" (UniqueName: \"kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-kube-api-access-2x6rb\") pod \"e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") " pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:23.930980 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:23.930670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:24.112810 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:24.112774    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"]
Jul 22 03:33:24.116122 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:33:24.116090    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fc9ffc9_a911_4706_add5_3a3085d9c6a4.slice/crio-97b8b24f94563144ac141cac8dc6966ad02eb9eeeaa13f4e2f476fd45bc69cd8 WatchSource:0}: Error finding container 97b8b24f94563144ac141cac8dc6966ad02eb9eeeaa13f4e2f476fd45bc69cd8: Status 404 returned error can't find the container with id 97b8b24f94563144ac141cac8dc6966ad02eb9eeeaa13f4e2f476fd45bc69cd8
Jul 22 03:33:24.118289 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:24.118258    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:24.118363 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:24.118327    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:24.118363 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:24.118353    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:24.368246 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:24.368202    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" event={"ID":"6fc9ffc9-a911-4706-add5-3a3085d9c6a4","Type":"ContainerStarted","Data":"24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6"}
Jul 22 03:33:24.368442 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:24.368260    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" event={"ID":"6fc9ffc9-a911-4706-add5-3a3085d9c6a4","Type":"ContainerStarted","Data":"97b8b24f94563144ac141cac8dc6966ad02eb9eeeaa13f4e2f476fd45bc69cd8"}
Jul 22 03:33:24.390592 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:24.390535    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" podStartSLOduration=1.390517353 podStartE2EDuration="1.390517353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:33:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:33:24.388457394 +0000 UTC m=+2118.274585531" watchObservedRunningTime="2026-07-22 03:33:24.390517353 +0000 UTC m=+2118.276645489"
Jul 22 03:33:24.931096 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:24.931039    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:25.948039 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:25.947999    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:26.378229 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:26.378145    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:26.379295 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:26.379272    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:31.402200 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:31.402165    2576 generic.go:356] "Generic (PLEG): container finished" podID="1107cee3-9f86-40f9-b563-d59335353e38" containerID="b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec" exitCode=0
Jul 22 03:33:31.402675 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:31.402240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" event={"ID":"1107cee3-9f86-40f9-b563-d59335353e38","Type":"ContainerDied","Data":"b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec"}
Jul 22 03:33:31.402725 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:31.402693    2576 scope.go:117] "RemoveContainer" containerID="b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec"
Jul 22 03:33:31.403706 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:31.403678    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:31.403772 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:31.403749    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:31.403812 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:31.403790    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:32.336598 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:32.336552    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:32.409089 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:32.409056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" event={"ID":"1107cee3-9f86-40f9-b563-d59335353e38","Type":"ContainerStarted","Data":"40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc"}
Jul 22 03:33:33.361794 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:33.361760    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:33.362204 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:33.362177    2576 patch_prober.go:28] interesting pod/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 22 03:33:33.362384 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:33.362359    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 22 03:33:34.361258 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:34.361206    2576 patch_prober.go:28] interesting pod/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 22 03:33:34.361810 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:34.361283    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 22 03:33:35.361048 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:35.361004    2576 patch_prober.go:28] interesting pod/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 22 03:33:35.361458 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:35.361352    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 22 03:33:36.361098 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:36.361048    2576 patch_prober.go:28] interesting pod/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 22 03:33:36.361295 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:36.361125    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 22 03:33:37.366111 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.366081    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:37.366624 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.366505    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:37.367510 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.367485    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:33:37.440276 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.440241    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"]
Jul 22 03:33:37.443934 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.443904    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.447141 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.447115    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fd4878\"/\"openshift-service-ca.crt\""
Jul 22 03:33:37.447479 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.447447    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fd4878\"/\"test-model-fd4878-kserve-self-signed-certs\""
Jul 22 03:33:37.447710 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.447695    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fd4878\"/\"kube-root-ca.crt\""
Jul 22 03:33:37.448543 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.448524    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fd4878\"/\"default-dockercfg-gt7lc\""
Jul 22 03:33:37.459128 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.459038    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"]
Jul 22 03:33:37.595051 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.595006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-model-cache\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.595243 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.595118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-dshm\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.595243 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.595146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6qvp\" (UniqueName: \"kubernetes.io/projected/545a4f51-55ab-4c87-b93b-3a0fb3471cac-kube-api-access-b6qvp\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.595333 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.595259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tmp-dir\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.595333 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.595298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tls-certs\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.595422 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.595342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-home\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.696342 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.696292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tmp-dir\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.696342 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.696348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tls-certs\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.696611 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.696390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-home\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.696611 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.696465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-model-cache\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.696611 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.696558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-dshm\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.696611 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.696586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qvp\" (UniqueName: \"kubernetes.io/projected/545a4f51-55ab-4c87-b93b-3a0fb3471cac-kube-api-access-b6qvp\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.696844 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.696779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tmp-dir\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.696902 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.696862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-home\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.697015 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.696994    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-model-cache\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.698816 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.698796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-dshm\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.699428 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.699388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tls-certs\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.704898 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.704875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6qvp\" (UniqueName: \"kubernetes.io/projected/545a4f51-55ab-4c87-b93b-3a0fb3471cac-kube-api-access-b6qvp\") pod \"test-model-fd4878-kserve-f597976f9-phsnn\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") " pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.757126 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.757086    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:37.903382 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:37.903344    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"]
Jul 22 03:33:37.907195 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:33:37.907165    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod545a4f51_55ab_4c87_b93b_3a0fb3471cac.slice/crio-f2f3a71e0b3664883d8b3e320fc84d48768da50ae844857c7d550f385848921c WatchSource:0}: Error finding container f2f3a71e0b3664883d8b3e320fc84d48768da50ae844857c7d550f385848921c: Status 404 returned error can't find the container with id f2f3a71e0b3664883d8b3e320fc84d48768da50ae844857c7d550f385848921c
Jul 22 03:33:38.438713 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:38.438673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn" event={"ID":"545a4f51-55ab-4c87-b93b-3a0fb3471cac","Type":"ContainerStarted","Data":"c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4"}
Jul 22 03:33:38.439158 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:38.438722    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn" event={"ID":"545a4f51-55ab-4c87-b93b-3a0fb3471cac","Type":"ContainerStarted","Data":"f2f3a71e0b3664883d8b3e320fc84d48768da50ae844857c7d550f385848921c"}
Jul 22 03:33:38.464483 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:38.464421    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn" podStartSLOduration=1.464386025 podStartE2EDuration="1.464386025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:33:38.463986942 +0000 UTC m=+2132.350115081" watchObservedRunningTime="2026-07-22 03:33:38.464386025 +0000 UTC m=+2132.350514165"
Jul 22 03:33:39.444692 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:39.444657    2576 generic.go:356] "Generic (PLEG): container finished" podID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerID="24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6" exitCode=0
Jul 22 03:33:39.445211 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:39.444733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" event={"ID":"6fc9ffc9-a911-4706-add5-3a3085d9c6a4","Type":"ContainerDied","Data":"24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6"}
Jul 22 03:33:39.445289 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:39.445209    2576 scope.go:117] "RemoveContainer" containerID="24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6"
Jul 22 03:33:39.446192 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:39.446165    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:39.446291 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:39.446233    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:39.446291 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:39.446263    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:33:40.455440 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:40.455375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" event={"ID":"6fc9ffc9-a911-4706-add5-3a3085d9c6a4","Type":"ContainerStarted","Data":"4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1"}
Jul 22 03:33:40.932592 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:40.932552    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:40.932823 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:40.932791    2576 patch_prober.go:28] interesting pod/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 03:33:40.932917 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:40.932855    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 03:33:41.378876 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:41.378785    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:41.931318 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:41.931275    2576 patch_prober.go:28] interesting pod/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 03:33:41.931886 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:41.931351    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 03:33:42.931599 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:42.931556    2576 patch_prober.go:28] interesting pod/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 03:33:42.932134 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:42.931628    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 03:33:43.932124 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:43.932086    2576 patch_prober.go:28] interesting pod/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 22 03:33:43.932727 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:43.932693    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 22 03:33:44.935085 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:44.935055    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:44.936347 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:44.936325    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:33:47.757501 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:47.757448    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:47.758010 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:47.757533    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:47.770544 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:47.770515    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:33:48.502142 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:33:48.502110    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:34:08.287107 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.287027    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"]
Jul 22 03:34:08.291513 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.291495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.294415 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.294379    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-30704e\"/\"default-dockercfg-fd8t2\""
Jul 22 03:34:08.294723 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.294702    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-30704e\"/\"openshift-service-ca.crt\""
Jul 22 03:34:08.295292 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.295271    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-30704e\"/\"kube-root-ca.crt\""
Jul 22 03:34:08.297193 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.297176    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-30704e\"/\"test-model-30704e-kserve-self-signed-certs\""
Jul 22 03:34:08.301609 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.301586    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"]
Jul 22 03:34:08.376014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.375975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-tmp-dir\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.376207 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.376029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-dshm\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.376207 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.376079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e1469f-ba42-414f-ae09-860c254a0900-tls-certs\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.376207 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.376136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-home\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.376207 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.376157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-model-cache\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.376207 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.376175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps5pc\" (UniqueName: \"kubernetes.io/projected/70e1469f-ba42-414f-ae09-860c254a0900-kube-api-access-ps5pc\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.477612 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.477574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-dshm\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.477612 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.477618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e1469f-ba42-414f-ae09-860c254a0900-tls-certs\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.477902 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.477671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-home\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.477902 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.477693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-model-cache\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.477902 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.477709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps5pc\" (UniqueName: \"kubernetes.io/projected/70e1469f-ba42-414f-ae09-860c254a0900-kube-api-access-ps5pc\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.477902 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.477749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-tmp-dir\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.478116 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.478080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-home\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.478160 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.478127    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-tmp-dir\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.478160 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.478145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-model-cache\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.479973 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.479951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-dshm\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.480157 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.480139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e1469f-ba42-414f-ae09-860c254a0900-tls-certs\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.486029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.486004    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps5pc\" (UniqueName: \"kubernetes.io/projected/70e1469f-ba42-414f-ae09-860c254a0900-kube-api-access-ps5pc\") pod \"test-model-30704e-kserve-54fbc998bc-j4626\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") " pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.601116 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.601032    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:08.738502 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:08.738475    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"]
Jul 22 03:34:08.740013 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:34:08.739983    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70e1469f_ba42_414f_ae09_860c254a0900.slice/crio-0616953032a604a313311679961153d52b97526ec43ae159e17ec6dd4bc39dc2 WatchSource:0}: Error finding container 0616953032a604a313311679961153d52b97526ec43ae159e17ec6dd4bc39dc2: Status 404 returned error can't find the container with id 0616953032a604a313311679961153d52b97526ec43ae159e17ec6dd4bc39dc2
Jul 22 03:34:09.583297 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:09.583259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626" event={"ID":"70e1469f-ba42-414f-ae09-860c254a0900","Type":"ContainerStarted","Data":"612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7"}
Jul 22 03:34:09.583297 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:09.583302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626" event={"ID":"70e1469f-ba42-414f-ae09-860c254a0900","Type":"ContainerStarted","Data":"0616953032a604a313311679961153d52b97526ec43ae159e17ec6dd4bc39dc2"}
Jul 22 03:34:09.602747 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:09.602696    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626" podStartSLOduration=1.6026778400000001 podStartE2EDuration="1.60267784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:09.601375649 +0000 UTC m=+2163.487503790" watchObservedRunningTime="2026-07-22 03:34:09.60267784 +0000 UTC m=+2163.488805980"
Jul 22 03:34:18.601305 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:18.601275    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:18.601824 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:18.601545    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:18.614012 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:18.613989    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:18.635893 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:18.635865    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:34:50.937366 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:50.937329    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"]
Jul 22 03:34:51.876858 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:34:51.876820    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"]
Jul 22 03:35:05.957332 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:05.957274    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn" podUID="545a4f51-55ab-4c87-b93b-3a0fb3471cac" containerName="main" containerID="cri-o://c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4" gracePeriod=45
Jul 22 03:35:06.208443 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.208367    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:35:06.307856 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.307813    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6qvp\" (UniqueName: \"kubernetes.io/projected/545a4f51-55ab-4c87-b93b-3a0fb3471cac-kube-api-access-b6qvp\") pod \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") "
Jul 22 03:35:06.307856 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.307862    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-dshm\") pod \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") "
Jul 22 03:35:06.308124 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.307913    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tls-certs\") pod \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") "
Jul 22 03:35:06.308124 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.307938    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-home\") pod \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") "
Jul 22 03:35:06.308124 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.308006    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-model-cache\") pod \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") "
Jul 22 03:35:06.308124 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.308034    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tmp-dir\") pod \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\" (UID: \"545a4f51-55ab-4c87-b93b-3a0fb3471cac\") "
Jul 22 03:35:06.308308 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.308267    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-home" (OuterVolumeSpecName: "home") pod "545a4f51-55ab-4c87-b93b-3a0fb3471cac" (UID: "545a4f51-55ab-4c87-b93b-3a0fb3471cac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:06.308365 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.308297    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-model-cache" (OuterVolumeSpecName: "model-cache") pod "545a4f51-55ab-4c87-b93b-3a0fb3471cac" (UID: "545a4f51-55ab-4c87-b93b-3a0fb3471cac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:06.308441 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.308387    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "545a4f51-55ab-4c87-b93b-3a0fb3471cac" (UID: "545a4f51-55ab-4c87-b93b-3a0fb3471cac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:06.308489 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.308451    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:06.308489 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.308471    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:06.310217 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.310194    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-dshm" (OuterVolumeSpecName: "dshm") pod "545a4f51-55ab-4c87-b93b-3a0fb3471cac" (UID: "545a4f51-55ab-4c87-b93b-3a0fb3471cac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:06.310217 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.310200    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "545a4f51-55ab-4c87-b93b-3a0fb3471cac" (UID: "545a4f51-55ab-4c87-b93b-3a0fb3471cac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:35:06.310307 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.310243    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/545a4f51-55ab-4c87-b93b-3a0fb3471cac-kube-api-access-b6qvp" (OuterVolumeSpecName: "kube-api-access-b6qvp") pod "545a4f51-55ab-4c87-b93b-3a0fb3471cac" (UID: "545a4f51-55ab-4c87-b93b-3a0fb3471cac"). InnerVolumeSpecName "kube-api-access-b6qvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:35:06.409528 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.409487    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6qvp\" (UniqueName: \"kubernetes.io/projected/545a4f51-55ab-4c87-b93b-3a0fb3471cac-kube-api-access-b6qvp\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:06.409528 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.409522    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:06.409528 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.409532    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:06.409528 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.409542    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/545a4f51-55ab-4c87-b93b-3a0fb3471cac-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:06.834872 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.834833    2576 generic.go:356] "Generic (PLEG): container finished" podID="545a4f51-55ab-4c87-b93b-3a0fb3471cac" containerID="c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4" exitCode=0
Jul 22 03:35:06.835050 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.834885    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"
Jul 22 03:35:06.835050 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.834919    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn" event={"ID":"545a4f51-55ab-4c87-b93b-3a0fb3471cac","Type":"ContainerDied","Data":"c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4"}
Jul 22 03:35:06.835050 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.834964    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn" event={"ID":"545a4f51-55ab-4c87-b93b-3a0fb3471cac","Type":"ContainerDied","Data":"f2f3a71e0b3664883d8b3e320fc84d48768da50ae844857c7d550f385848921c"}
Jul 22 03:35:06.835050 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.834984    2576 scope.go:117] "RemoveContainer" containerID="c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4"
Jul 22 03:35:06.843954 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.843935    2576 scope.go:117] "RemoveContainer" containerID="c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4"
Jul 22 03:35:06.844212 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:35:06.844193    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4\": container with ID starting with c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4 not found: ID does not exist" containerID="c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4"
Jul 22 03:35:06.844266 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.844222    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4"} err="failed to get container status \"c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4\": rpc error: code = NotFound desc = could not find container \"c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4\": container with ID starting with c5b073eea0f488905ea93d7e1d4c96a84576ddec1499be6cfb1cd78186bc98e4 not found: ID does not exist"
Jul 22 03:35:06.859168 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.859144    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"]
Jul 22 03:35:06.862676 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.862642    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-fd4878/test-model-fd4878-kserve-f597976f9-phsnn"]
Jul 22 03:35:06.897334 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:06.897297    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626" podUID="70e1469f-ba42-414f-ae09-860c254a0900" containerName="main" containerID="cri-o://612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7" gracePeriod=45
Jul 22 03:35:07.148852 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.148822    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:35:07.215553 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.215524    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e1469f-ba42-414f-ae09-860c254a0900-tls-certs\") pod \"70e1469f-ba42-414f-ae09-860c254a0900\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") "
Jul 22 03:35:07.215748 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.215611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-dshm\") pod \"70e1469f-ba42-414f-ae09-860c254a0900\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") "
Jul 22 03:35:07.215748 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.215649    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-home\") pod \"70e1469f-ba42-414f-ae09-860c254a0900\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") "
Jul 22 03:35:07.215748 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.215695    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-tmp-dir\") pod \"70e1469f-ba42-414f-ae09-860c254a0900\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") "
Jul 22 03:35:07.215748 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.215738    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-model-cache\") pod \"70e1469f-ba42-414f-ae09-860c254a0900\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") "
Jul 22 03:35:07.215958 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.215773    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps5pc\" (UniqueName: \"kubernetes.io/projected/70e1469f-ba42-414f-ae09-860c254a0900-kube-api-access-ps5pc\") pod \"70e1469f-ba42-414f-ae09-860c254a0900\" (UID: \"70e1469f-ba42-414f-ae09-860c254a0900\") "
Jul 22 03:35:07.216009 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.215956    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70e1469f-ba42-414f-ae09-860c254a0900" (UID: "70e1469f-ba42-414f-ae09-860c254a0900"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:07.216009 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.215973    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-home" (OuterVolumeSpecName: "home") pod "70e1469f-ba42-414f-ae09-860c254a0900" (UID: "70e1469f-ba42-414f-ae09-860c254a0900"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:07.216009 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.215992    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-model-cache" (OuterVolumeSpecName: "model-cache") pod "70e1469f-ba42-414f-ae09-860c254a0900" (UID: "70e1469f-ba42-414f-ae09-860c254a0900"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:07.216163 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.216131    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:07.216163 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.216151    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:07.216259 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.216168    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:07.217858 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.217834    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-dshm" (OuterVolumeSpecName: "dshm") pod "70e1469f-ba42-414f-ae09-860c254a0900" (UID: "70e1469f-ba42-414f-ae09-860c254a0900"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:07.217858 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.217841    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70e1469f-ba42-414f-ae09-860c254a0900-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70e1469f-ba42-414f-ae09-860c254a0900" (UID: "70e1469f-ba42-414f-ae09-860c254a0900"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:35:07.218002 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.217881    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70e1469f-ba42-414f-ae09-860c254a0900-kube-api-access-ps5pc" (OuterVolumeSpecName: "kube-api-access-ps5pc") pod "70e1469f-ba42-414f-ae09-860c254a0900" (UID: "70e1469f-ba42-414f-ae09-860c254a0900"). InnerVolumeSpecName "kube-api-access-ps5pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:35:07.316697 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.316657    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps5pc\" (UniqueName: \"kubernetes.io/projected/70e1469f-ba42-414f-ae09-860c254a0900-kube-api-access-ps5pc\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:07.316697 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.316693    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e1469f-ba42-414f-ae09-860c254a0900-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:07.316697 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.316705    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70e1469f-ba42-414f-ae09-860c254a0900-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:07.841011 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.840974    2576 generic.go:356] "Generic (PLEG): container finished" podID="70e1469f-ba42-414f-ae09-860c254a0900" containerID="612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7" exitCode=0
Jul 22 03:35:07.841011 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.841012    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626" event={"ID":"70e1469f-ba42-414f-ae09-860c254a0900","Type":"ContainerDied","Data":"612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7"}
Jul 22 03:35:07.841279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.841024    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"
Jul 22 03:35:07.841279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.841037    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626" event={"ID":"70e1469f-ba42-414f-ae09-860c254a0900","Type":"ContainerDied","Data":"0616953032a604a313311679961153d52b97526ec43ae159e17ec6dd4bc39dc2"}
Jul 22 03:35:07.841279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.841052    2576 scope.go:117] "RemoveContainer" containerID="612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7"
Jul 22 03:35:07.849361 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.849342    2576 scope.go:117] "RemoveContainer" containerID="612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7"
Jul 22 03:35:07.849649 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:35:07.849631    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7\": container with ID starting with 612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7 not found: ID does not exist" containerID="612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7"
Jul 22 03:35:07.849707 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.849656    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7"} err="failed to get container status \"612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7\": rpc error: code = NotFound desc = could not find container \"612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7\": container with ID starting with 612d7a103c7f5ea245b3dc8c8ea6d6b2dbb1027919bc533e1f0d501ae8c46cd7 not found: ID does not exist"
Jul 22 03:35:07.861852 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.861822    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"]
Jul 22 03:35:07.866103 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:07.866079    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-30704e/test-model-30704e-kserve-54fbc998bc-j4626"]
Jul 22 03:35:08.183288 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:08.183257    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="545a4f51-55ab-4c87-b93b-3a0fb3471cac" path="/var/lib/kubelet/pods/545a4f51-55ab-4c87-b93b-3a0fb3471cac/volumes"
Jul 22 03:35:08.183691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:08.183677    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70e1469f-ba42-414f-ae09-860c254a0900" path="/var/lib/kubelet/pods/70e1469f-ba42-414f-ae09-860c254a0900/volumes"
Jul 22 03:35:14.018647 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:14.018604    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"]
Jul 22 03:35:14.019098 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:14.018859    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy" containerID="cri-o://40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc" gracePeriod=30
Jul 22 03:35:19.273484 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.273459    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:35:19.428074 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428042    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-socket\") pod \"1107cee3-9f86-40f9-b563-d59335353e38\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") "
Jul 22 03:35:19.428074 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428080    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-certs\") pod \"1107cee3-9f86-40f9-b563-d59335353e38\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") "
Jul 22 03:35:19.428322 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428130    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1107cee3-9f86-40f9-b563-d59335353e38-istio-podinfo\") pod \"1107cee3-9f86-40f9-b563-d59335353e38\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") "
Jul 22 03:35:19.428322 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428150    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-envoy\") pod \"1107cee3-9f86-40f9-b563-d59335353e38\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") "
Jul 22 03:35:19.428322 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428175    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1107cee3-9f86-40f9-b563-d59335353e38-istiod-ca-cert\") pod \"1107cee3-9f86-40f9-b563-d59335353e38\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") "
Jul 22 03:35:19.428322 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428190    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-istio-token\") pod \"1107cee3-9f86-40f9-b563-d59335353e38\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") "
Jul 22 03:35:19.428322 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428237    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-data\") pod \"1107cee3-9f86-40f9-b563-d59335353e38\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") "
Jul 22 03:35:19.428322 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428310    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-credential-socket\") pod \"1107cee3-9f86-40f9-b563-d59335353e38\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") "
Jul 22 03:35:19.428673 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428335    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jsbf\" (UniqueName: \"kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-kube-api-access-9jsbf\") pod \"1107cee3-9f86-40f9-b563-d59335353e38\" (UID: \"1107cee3-9f86-40f9-b563-d59335353e38\") "
Jul 22 03:35:19.428673 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428419    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1107cee3-9f86-40f9-b563-d59335353e38" (UID: "1107cee3-9f86-40f9-b563-d59335353e38"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:19.428673 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428435    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1107cee3-9f86-40f9-b563-d59335353e38" (UID: "1107cee3-9f86-40f9-b563-d59335353e38"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:19.428673 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428593    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1107cee3-9f86-40f9-b563-d59335353e38" (UID: "1107cee3-9f86-40f9-b563-d59335353e38"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:19.428860 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428679    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:19.428860 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428698    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:19.428860 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.428709    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1107cee3-9f86-40f9-b563-d59335353e38-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1107cee3-9f86-40f9-b563-d59335353e38" (UID: "1107cee3-9f86-40f9-b563-d59335353e38"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:35:19.429260 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.429233    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-data" (OuterVolumeSpecName: "istio-data") pod "1107cee3-9f86-40f9-b563-d59335353e38" (UID: "1107cee3-9f86-40f9-b563-d59335353e38"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:19.430412 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.430370    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1107cee3-9f86-40f9-b563-d59335353e38-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1107cee3-9f86-40f9-b563-d59335353e38" (UID: "1107cee3-9f86-40f9-b563-d59335353e38"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:35:19.430535 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.430480    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1107cee3-9f86-40f9-b563-d59335353e38" (UID: "1107cee3-9f86-40f9-b563-d59335353e38"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:19.430604 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.430584    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-istio-token" (OuterVolumeSpecName: "istio-token") pod "1107cee3-9f86-40f9-b563-d59335353e38" (UID: "1107cee3-9f86-40f9-b563-d59335353e38"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:35:19.430645 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.430581    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-kube-api-access-9jsbf" (OuterVolumeSpecName: "kube-api-access-9jsbf") pod "1107cee3-9f86-40f9-b563-d59335353e38" (UID: "1107cee3-9f86-40f9-b563-d59335353e38"). InnerVolumeSpecName "kube-api-access-9jsbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:35:19.529945 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.529909    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:19.529945 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.529940    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:19.529945 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.529951    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jsbf\" (UniqueName: \"kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-kube-api-access-9jsbf\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:19.529945 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.529960    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1107cee3-9f86-40f9-b563-d59335353e38-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:19.530217 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.529969    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1107cee3-9f86-40f9-b563-d59335353e38-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:19.530217 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.529977    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1107cee3-9f86-40f9-b563-d59335353e38-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:19.530217 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.529985    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1107cee3-9f86-40f9-b563-d59335353e38-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:19.894034 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.894000    2576 generic.go:356] "Generic (PLEG): container finished" podID="1107cee3-9f86-40f9-b563-d59335353e38" containerID="40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc" exitCode=0
Jul 22 03:35:19.894229 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.894048    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"
Jul 22 03:35:19.894229 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.894090    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" event={"ID":"1107cee3-9f86-40f9-b563-d59335353e38","Type":"ContainerDied","Data":"40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc"}
Jul 22 03:35:19.894229 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.894156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f" event={"ID":"1107cee3-9f86-40f9-b563-d59335353e38","Type":"ContainerDied","Data":"93953b8115325e86d7f347866d0c314e4541b8fdc8e2a173e3f2499c7b4958b1"}
Jul 22 03:35:19.894229 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.894188    2576 scope.go:117] "RemoveContainer" containerID="40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc"
Jul 22 03:35:19.903083 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.903058    2576 scope.go:117] "RemoveContainer" containerID="b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec"
Jul 22 03:35:19.910782 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.910762    2576 scope.go:117] "RemoveContainer" containerID="40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc"
Jul 22 03:35:19.911039 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:35:19.911020    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc\": container with ID starting with 40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc not found: ID does not exist" containerID="40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc"
Jul 22 03:35:19.911086 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.911049    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc"} err="failed to get container status \"40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc\": rpc error: code = NotFound desc = could not find container \"40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc\": container with ID starting with 40027f29d399a78a400826130adf9e417a4d5a3b1b4e960b95ea75851d8cf4bc not found: ID does not exist"
Jul 22 03:35:19.911086 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.911069    2576 scope.go:117] "RemoveContainer" containerID="b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec"
Jul 22 03:35:19.911285 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:35:19.911269    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec\": container with ID starting with b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec not found: ID does not exist" containerID="b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec"
Jul 22 03:35:19.911350 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.911290    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec"} err="failed to get container status \"b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec\": rpc error: code = NotFound desc = could not find container \"b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec\": container with ID starting with b339576801e3a6430de3d2b295f86a3f1ed3f186d7b0f7638561898ec4d75bec not found: ID does not exist"
Jul 22 03:35:19.918090 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.918066    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"]
Jul 22 03:35:19.922641 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:19.922620    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-fd4878-openshift-default-7cd66b6f7f-wwk5f"]
Jul 22 03:35:20.183353 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:20.183271    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1107cee3-9f86-40f9-b563-d59335353e38" path="/var/lib/kubelet/pods/1107cee3-9f86-40f9-b563-d59335353e38/volumes"
Jul 22 03:35:36.228135 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:36.228098    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"]
Jul 22 03:35:36.228705 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:36.228360    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy" containerID="cri-o://4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1" gracePeriod=30
Jul 22 03:35:37.156421 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.156376    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"]
Jul 22 03:35:37.156806 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.156787    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545a4f51-55ab-4c87-b93b-3a0fb3471cac" containerName="main"
Jul 22 03:35:37.156806 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.156807    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="545a4f51-55ab-4c87-b93b-3a0fb3471cac" containerName="main"
Jul 22 03:35:37.156953 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.156830    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy"
Jul 22 03:35:37.156953 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.156861    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy"
Jul 22 03:35:37.156953 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.156876    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70e1469f-ba42-414f-ae09-860c254a0900" containerName="main"
Jul 22 03:35:37.156953 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.156884    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="70e1469f-ba42-414f-ae09-860c254a0900" containerName="main"
Jul 22 03:35:37.157213 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.156988    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="70e1469f-ba42-414f-ae09-860c254a0900" containerName="main"
Jul 22 03:35:37.157213 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.157000    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="545a4f51-55ab-4c87-b93b-3a0fb3471cac" containerName="main"
Jul 22 03:35:37.157213 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.157012    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy"
Jul 22 03:35:37.157213 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.157019    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy"
Jul 22 03:35:37.161575 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.161551    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.164021 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.163999    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-19cc62-openshift-default-dockercfg-29pxm\""
Jul 22 03:35:37.172029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.172002    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"]
Jul 22 03:35:37.276392 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.276355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-token\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.276851 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.276478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-certs\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.276851 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.276530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39194fd8-b519-450c-8c03-d63dd5bad39b-istiod-ca-cert\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.276851 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.276564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-credential-socket\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.276851 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.276601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzdgs\" (UniqueName: \"kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-kube-api-access-mzdgs\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.276851 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.276627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-envoy\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.276851 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.276652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-podinfo\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.276851 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.276709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-data\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.276851 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.276740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-socket\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377256 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-envoy\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377256 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-podinfo\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377547 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-data\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377547 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-socket\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377547 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-token\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377547 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-certs\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377547 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39194fd8-b519-450c-8c03-d63dd5bad39b-istiod-ca-cert\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377547 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-credential-socket\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377547 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzdgs\" (UniqueName: \"kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-kube-api-access-mzdgs\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377899 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377768    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-data\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377899 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-socket\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.377990 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.377891    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-certs\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.378149 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.378122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-credential-socket\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.378249 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.378205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39194fd8-b519-450c-8c03-d63dd5bad39b-istiod-ca-cert\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.379719 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.379691    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-envoy\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.379952 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.379937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-podinfo\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.385383 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.385362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-token\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.385585 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.385563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzdgs\" (UniqueName: \"kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-kube-api-access-mzdgs\") pod \"e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") " pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.473014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.472924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:37.612610 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.612580    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"]
Jul 22 03:35:37.614770 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:35:37.614740    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39194fd8_b519_450c_8c03_d63dd5bad39b.slice/crio-10204c6101768c4cd3ac10085e738e0ebc0bf6c4949fd1814c3affe23bd04433 WatchSource:0}: Error finding container 10204c6101768c4cd3ac10085e738e0ebc0bf6c4949fd1814c3affe23bd04433: Status 404 returned error can't find the container with id 10204c6101768c4cd3ac10085e738e0ebc0bf6c4949fd1814c3affe23bd04433
Jul 22 03:35:37.617035 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.616999    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:35:37.617123 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.617070    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:35:37.617123 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.617098    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:35:37.977174 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.977140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" event={"ID":"39194fd8-b519-450c-8c03-d63dd5bad39b","Type":"ContainerStarted","Data":"6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f"}
Jul 22 03:35:37.977364 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.977192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" event={"ID":"39194fd8-b519-450c-8c03-d63dd5bad39b","Type":"ContainerStarted","Data":"10204c6101768c4cd3ac10085e738e0ebc0bf6c4949fd1814c3affe23bd04433"}
Jul 22 03:35:37.999087 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:37.999029    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" podStartSLOduration=0.999012284 podStartE2EDuration="999.012284ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:35:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:35:37.997599694 +0000 UTC m=+2251.883727835" watchObservedRunningTime="2026-07-22 03:35:37.999012284 +0000 UTC m=+2251.885140424"
Jul 22 03:35:38.473925 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:38.473890    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:38.478695 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:38.478661    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:38.981220 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:38.981187    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:38.982346 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:38.982324    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:41.483601 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.483577    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:35:41.514049 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.513961    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istiod-ca-cert\") pod \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") "
Jul 22 03:35:41.514049 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514008    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-envoy\") pod \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") "
Jul 22 03:35:41.514279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514046    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x6rb\" (UniqueName: \"kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-kube-api-access-2x6rb\") pod \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") "
Jul 22 03:35:41.514279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514080    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-credential-socket\") pod \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") "
Jul 22 03:35:41.514279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514103    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-podinfo\") pod \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") "
Jul 22 03:35:41.514279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514128    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-token\") pod \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") "
Jul 22 03:35:41.514279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514156    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-data\") pod \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") "
Jul 22 03:35:41.514279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514200    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-socket\") pod \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") "
Jul 22 03:35:41.514279 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514235    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-certs\") pod \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\" (UID: \"6fc9ffc9-a911-4706-add5-3a3085d9c6a4\") "
Jul 22 03:35:41.514637 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514361    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6fc9ffc9-a911-4706-add5-3a3085d9c6a4" (UID: "6fc9ffc9-a911-4706-add5-3a3085d9c6a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:35:41.514637 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514619    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:41.514847 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514824    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6fc9ffc9-a911-4706-add5-3a3085d9c6a4" (UID: "6fc9ffc9-a911-4706-add5-3a3085d9c6a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:41.514924 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.514846    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6fc9ffc9-a911-4706-add5-3a3085d9c6a4" (UID: "6fc9ffc9-a911-4706-add5-3a3085d9c6a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:41.515071 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.515051    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6fc9ffc9-a911-4706-add5-3a3085d9c6a4" (UID: "6fc9ffc9-a911-4706-add5-3a3085d9c6a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:41.515111 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.515089    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "6fc9ffc9-a911-4706-add5-3a3085d9c6a4" (UID: "6fc9ffc9-a911-4706-add5-3a3085d9c6a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:41.516477 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.516451    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "6fc9ffc9-a911-4706-add5-3a3085d9c6a4" (UID: "6fc9ffc9-a911-4706-add5-3a3085d9c6a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:35:41.516654 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.516501    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6fc9ffc9-a911-4706-add5-3a3085d9c6a4" (UID: "6fc9ffc9-a911-4706-add5-3a3085d9c6a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:35:41.516766 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.516711    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-kube-api-access-2x6rb" (OuterVolumeSpecName: "kube-api-access-2x6rb") pod "6fc9ffc9-a911-4706-add5-3a3085d9c6a4" (UID: "6fc9ffc9-a911-4706-add5-3a3085d9c6a4"). InnerVolumeSpecName "kube-api-access-2x6rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:35:41.517043 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.517021    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6fc9ffc9-a911-4706-add5-3a3085d9c6a4" (UID: "6fc9ffc9-a911-4706-add5-3a3085d9c6a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:35:41.615858 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.615811    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:41.615858 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.615852    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x6rb\" (UniqueName: \"kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-kube-api-access-2x6rb\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:41.615858 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.615867    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:41.616117 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.615879    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:41.616117 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.615890    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:41.616117 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.615901    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:41.616117 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.615911    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:41.616117 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.615922    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc9ffc9-a911-4706-add5-3a3085d9c6a4-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:35:41.995029 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.994993    2576 generic.go:356] "Generic (PLEG): container finished" podID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerID="4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1" exitCode=0
Jul 22 03:35:41.995240 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.995036    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" event={"ID":"6fc9ffc9-a911-4706-add5-3a3085d9c6a4","Type":"ContainerDied","Data":"4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1"}
Jul 22 03:35:41.995240 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.995046    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"
Jul 22 03:35:41.995240 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.995078    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf" event={"ID":"6fc9ffc9-a911-4706-add5-3a3085d9c6a4","Type":"ContainerDied","Data":"97b8b24f94563144ac141cac8dc6966ad02eb9eeeaa13f4e2f476fd45bc69cd8"}
Jul 22 03:35:41.995240 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:41.995100    2576 scope.go:117] "RemoveContainer" containerID="4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1"
Jul 22 03:35:42.003945 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:42.003923    2576 scope.go:117] "RemoveContainer" containerID="24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6"
Jul 22 03:35:42.012028 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:42.012008    2576 scope.go:117] "RemoveContainer" containerID="4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1"
Jul 22 03:35:42.012276 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:35:42.012254    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1\": container with ID starting with 4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1 not found: ID does not exist" containerID="4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1"
Jul 22 03:35:42.012348 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:42.012289    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1"} err="failed to get container status \"4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1\": rpc error: code = NotFound desc = could not find container \"4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1\": container with ID starting with 4d70459fa3b3c67125fed45744cbb10c1cf27678b54067d2846d5cb2015b76d1 not found: ID does not exist"
Jul 22 03:35:42.012348 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:42.012313    2576 scope.go:117] "RemoveContainer" containerID="24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6"
Jul 22 03:35:42.012602 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:35:42.012585    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6\": container with ID starting with 24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6 not found: ID does not exist" containerID="24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6"
Jul 22 03:35:42.012650 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:42.012608    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6"} err="failed to get container status \"24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6\": rpc error: code = NotFound desc = could not find container \"24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6\": container with ID starting with 24e2a82c5ac9c103d9dc83e4784bce31f897cee6da5704a711ece377757c11c6 not found: ID does not exist"
Jul 22 03:35:42.018571 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:42.018548    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"]
Jul 22 03:35:42.022655 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:42.022632    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-30704e-openshift-default-55769ccd85-h4pdf"]
Jul 22 03:35:42.183062 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:42.183030    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" path="/var/lib/kubelet/pods/6fc9ffc9-a911-4706-add5-3a3085d9c6a4/volumes"
Jul 22 03:35:45.352934 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.352892    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"]
Jul 22 03:35:45.354016 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.353988    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy"
Jul 22 03:35:45.354187 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.354175    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy"
Jul 22 03:35:45.354314 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.354303    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy"
Jul 22 03:35:45.354429 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.354419    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy"
Jul 22 03:35:45.354556 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.354543    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy"
Jul 22 03:35:45.354679 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.354668    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1107cee3-9f86-40f9-b563-d59335353e38" containerName="istio-proxy"
Jul 22 03:35:45.354883 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.354869    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy"
Jul 22 03:35:45.354995 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.354984    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fc9ffc9-a911-4706-add5-3a3085d9c6a4" containerName="istio-proxy"
Jul 22 03:35:45.364162 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.364134    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.366969 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.366936    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ed08a5-openshift-default-dockercfg-h84vk\""
Jul 22 03:35:45.368392 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.368363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"]
Jul 22 03:35:45.462968 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.462922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d841146-c9c1-4035-bad9-5d094155e072-istio-podinfo\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.462968 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.462977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d841146-c9c1-4035-bad9-5d094155e072-istiod-ca-cert\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.463251 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.463003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-certs\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.463251 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.463116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-credential-socket\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.463251 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.463156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-envoy\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.463251 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.463192    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-data\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.463442 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.463265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-socket\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.463442 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.463294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-istio-token\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.463442 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.463325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhdh7\" (UniqueName: \"kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-kube-api-access-bhdh7\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.564743 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.564701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-socket\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.564743 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.564745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-istio-token\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565015 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.564764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhdh7\" (UniqueName: \"kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-kube-api-access-bhdh7\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565015 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.564812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d841146-c9c1-4035-bad9-5d094155e072-istio-podinfo\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565015 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.564854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d841146-c9c1-4035-bad9-5d094155e072-istiod-ca-cert\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565015 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.564890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-certs\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565015 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.564924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-credential-socket\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565015 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.564945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-envoy\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565015 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.564978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-data\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565430 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.565190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-socket\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565430 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.565264    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-credential-socket\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565430 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.565386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-data\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565563 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.565460    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-certs\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.565769 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.565747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d841146-c9c1-4035-bad9-5d094155e072-istiod-ca-cert\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.567340 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.567312    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-envoy\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.567500 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.567482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d841146-c9c1-4035-bad9-5d094155e072-istio-podinfo\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.573479 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.573457    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-istio-token\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.573700 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.573679    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhdh7\" (UniqueName: \"kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-kube-api-access-bhdh7\") pod \"e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") " pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.676185 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.676153    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:45.839821 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.839736    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"]
Jul 22 03:35:45.860266 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.860220    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:35:45.860414 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.860313    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:35:45.860414 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:45.860357    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:35:46.014728 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:46.014625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" event={"ID":"0d841146-c9c1-4035-bad9-5d094155e072","Type":"ContainerStarted","Data":"a07cc7c7e04a0e6f65e6192d0f670bf498efcdeedbd0366c15efbef4f991d4a9"}
Jul 22 03:35:46.014728 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:46.014694    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" event={"ID":"0d841146-c9c1-4035-bad9-5d094155e072","Type":"ContainerStarted","Data":"c6f854bc2e2f8c8f59a64c0d7dfd6d62a210697da4abcd1c97e1d482d9380b14"}
Jul 22 03:35:46.037002 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:46.036934    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" podStartSLOduration=1.036910995 podStartE2EDuration="1.036910995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:35:46.035701301 +0000 UTC m=+2259.921829443" watchObservedRunningTime="2026-07-22 03:35:46.036910995 +0000 UTC m=+2259.923039136"
Jul 22 03:35:46.677247 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:46.677204    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:46.682319 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:46.682289    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:47.019418 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:47.019323    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:47.020448 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:47.020431    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:35:51.038285 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:51.038191    2576 generic.go:356] "Generic (PLEG): container finished" podID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerID="6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f" exitCode=0
Jul 22 03:35:51.038789 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:51.038275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" event={"ID":"39194fd8-b519-450c-8c03-d63dd5bad39b","Type":"ContainerDied","Data":"6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f"}
Jul 22 03:35:51.038868 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:51.038851    2576 scope.go:117] "RemoveContainer" containerID="6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f"
Jul 22 03:35:51.040000 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:51.039971    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:35:51.040084 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:51.040049    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:35:51.040122 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:51.040090    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:35:52.047535 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:52.047496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" event={"ID":"39194fd8-b519-450c-8c03-d63dd5bad39b","Type":"ContainerStarted","Data":"c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558"}
Jul 22 03:35:52.473995 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:52.473956    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:52.475069 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:52.475033    2576 patch_prober.go:28] interesting pod/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 22 03:35:52.475197 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:52.475091    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 22 03:35:53.473659 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:53.473614    2576 patch_prober.go:28] interesting pod/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 22 03:35:53.474168 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:53.473686    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 22 03:35:53.981106 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:53.981061    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:54.473542 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:54.473494    2576 patch_prober.go:28] interesting pod/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 22 03:35:54.473726 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:54.473569    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 22 03:35:55.474043 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:55.473998    2576 patch_prober.go:28] interesting pod/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 22 03:35:55.474562 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:55.474091    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 22 03:35:56.478156 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:56.478122    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:35:56.479423 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:35:56.479382    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:36:03.060607 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:03.060565    2576 patch_prober.go:28] interesting pod/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 22 03:36:03.061889 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:03.060696    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 22 03:36:04.110146 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:04.110110    2576 generic.go:356] "Generic (PLEG): container finished" podID="0d841146-c9c1-4035-bad9-5d094155e072" containerID="a07cc7c7e04a0e6f65e6192d0f670bf498efcdeedbd0366c15efbef4f991d4a9" exitCode=0
Jul 22 03:36:04.110603 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:04.110169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" event={"ID":"0d841146-c9c1-4035-bad9-5d094155e072","Type":"ContainerDied","Data":"a07cc7c7e04a0e6f65e6192d0f670bf498efcdeedbd0366c15efbef4f991d4a9"}
Jul 22 03:36:04.110603 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:04.110565    2576 scope.go:117] "RemoveContainer" containerID="a07cc7c7e04a0e6f65e6192d0f670bf498efcdeedbd0366c15efbef4f991d4a9"
Jul 22 03:36:04.111626 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:04.111597    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:36:04.111748 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:04.111675    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:36:04.111748 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:04.111718    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:36:05.116863 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:05.116822    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" event={"ID":"0d841146-c9c1-4035-bad9-5d094155e072","Type":"ContainerStarted","Data":"6dc3bfcc4695da63c4904ab2bfaaf36de8e040e8f4960cf302c88dd6d567481c"}
Jul 22 03:36:05.676386 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:05.676345    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:36:05.676649 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:05.676617    2576 patch_prober.go:28] interesting pod/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 03:36:05.676695 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:05.676676    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 03:36:06.676737 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:06.676700    2576 patch_prober.go:28] interesting pod/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 03:36:06.677145 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:06.676791    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 03:36:07.677300 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:07.677265    2576 patch_prober.go:28] interesting pod/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 03:36:07.677727 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:07.677321    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 03:36:08.677321 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:08.677283    2576 patch_prober.go:28] interesting pod/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 22 03:36:08.677787 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:08.677342    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 22 03:36:09.680803 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:09.680768    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:36:09.681191 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:09.681129    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:36:09.681854 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:09.681830    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:36:27.764364 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:27.764329    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"]
Jul 22 03:36:27.764987 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:27.764575    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy" containerID="cri-o://c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558" gracePeriod=30
Jul 22 03:36:33.019519 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.019491    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:36:33.096792 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.096698    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-credential-socket\") pod \"39194fd8-b519-450c-8c03-d63dd5bad39b\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") "
Jul 22 03:36:33.096792 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.096751    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-token\") pod \"39194fd8-b519-450c-8c03-d63dd5bad39b\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") "
Jul 22 03:36:33.096792 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.096780    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-socket\") pod \"39194fd8-b519-450c-8c03-d63dd5bad39b\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") "
Jul 22 03:36:33.097076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.096807    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39194fd8-b519-450c-8c03-d63dd5bad39b-istiod-ca-cert\") pod \"39194fd8-b519-450c-8c03-d63dd5bad39b\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") "
Jul 22 03:36:33.097076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.096837    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-podinfo\") pod \"39194fd8-b519-450c-8c03-d63dd5bad39b\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") "
Jul 22 03:36:33.097076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.096935    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-certs\") pod \"39194fd8-b519-450c-8c03-d63dd5bad39b\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") "
Jul 22 03:36:33.097076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097001    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-envoy\") pod \"39194fd8-b519-450c-8c03-d63dd5bad39b\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") "
Jul 22 03:36:33.097076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097040    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "39194fd8-b519-450c-8c03-d63dd5bad39b" (UID: "39194fd8-b519-450c-8c03-d63dd5bad39b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:36:33.097076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097052    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-data\") pod \"39194fd8-b519-450c-8c03-d63dd5bad39b\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") "
Jul 22 03:36:33.097367 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097146    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzdgs\" (UniqueName: \"kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-kube-api-access-mzdgs\") pod \"39194fd8-b519-450c-8c03-d63dd5bad39b\" (UID: \"39194fd8-b519-450c-8c03-d63dd5bad39b\") "
Jul 22 03:36:33.097367 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097324    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "39194fd8-b519-450c-8c03-d63dd5bad39b" (UID: "39194fd8-b519-450c-8c03-d63dd5bad39b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:36:33.097367 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097349    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39194fd8-b519-450c-8c03-d63dd5bad39b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "39194fd8-b519-450c-8c03-d63dd5bad39b" (UID: "39194fd8-b519-450c-8c03-d63dd5bad39b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:36:33.097574 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097479    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "39194fd8-b519-450c-8c03-d63dd5bad39b" (UID: "39194fd8-b519-450c-8c03-d63dd5bad39b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:36:33.097574 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097563    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:36:33.097679 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097578    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:36:33.097679 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097591    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:36:33.097679 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.097604    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39194fd8-b519-450c-8c03-d63dd5bad39b-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:36:33.098096 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.098071    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-data" (OuterVolumeSpecName: "istio-data") pod "39194fd8-b519-450c-8c03-d63dd5bad39b" (UID: "39194fd8-b519-450c-8c03-d63dd5bad39b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:36:33.099245 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.099224    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "39194fd8-b519-450c-8c03-d63dd5bad39b" (UID: "39194fd8-b519-450c-8c03-d63dd5bad39b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:36:33.099391 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.099368    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-kube-api-access-mzdgs" (OuterVolumeSpecName: "kube-api-access-mzdgs") pod "39194fd8-b519-450c-8c03-d63dd5bad39b" (UID: "39194fd8-b519-450c-8c03-d63dd5bad39b"). InnerVolumeSpecName "kube-api-access-mzdgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:36:33.099555 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.099535    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-token" (OuterVolumeSpecName: "istio-token") pod "39194fd8-b519-450c-8c03-d63dd5bad39b" (UID: "39194fd8-b519-450c-8c03-d63dd5bad39b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:36:33.099606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.099546    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "39194fd8-b519-450c-8c03-d63dd5bad39b" (UID: "39194fd8-b519-450c-8c03-d63dd5bad39b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:36:33.198520 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.198479    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:36:33.198520 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.198511    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:36:33.198520 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.198525    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzdgs\" (UniqueName: \"kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-kube-api-access-mzdgs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:36:33.198771 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.198539    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:36:33.198771 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.198550    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39194fd8-b519-450c-8c03-d63dd5bad39b-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:36:33.238626 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.238590    2576 generic.go:356] "Generic (PLEG): container finished" podID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerID="c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558" exitCode=0
Jul 22 03:36:33.238827 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.238638    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"
Jul 22 03:36:33.238827 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.238680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" event={"ID":"39194fd8-b519-450c-8c03-d63dd5bad39b","Type":"ContainerDied","Data":"c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558"}
Jul 22 03:36:33.238827 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.238747    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt" event={"ID":"39194fd8-b519-450c-8c03-d63dd5bad39b","Type":"ContainerDied","Data":"10204c6101768c4cd3ac10085e738e0ebc0bf6c4949fd1814c3affe23bd04433"}
Jul 22 03:36:33.238827 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.238779    2576 scope.go:117] "RemoveContainer" containerID="c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558"
Jul 22 03:36:33.247974 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.247958    2576 scope.go:117] "RemoveContainer" containerID="6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f"
Jul 22 03:36:33.255286 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.255271    2576 scope.go:117] "RemoveContainer" containerID="c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558"
Jul 22 03:36:33.255574 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:36:33.255555    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558\": container with ID starting with c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558 not found: ID does not exist" containerID="c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558"
Jul 22 03:36:33.255655 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.255582    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558"} err="failed to get container status \"c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558\": rpc error: code = NotFound desc = could not find container \"c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558\": container with ID starting with c3d9109e65ae427a4f787cbee3f25fe293fd56ec1391428db2b7132d25888558 not found: ID does not exist"
Jul 22 03:36:33.255655 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.255601    2576 scope.go:117] "RemoveContainer" containerID="6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f"
Jul 22 03:36:33.255828 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:36:33.255812    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f\": container with ID starting with 6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f not found: ID does not exist" containerID="6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f"
Jul 22 03:36:33.255869 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.255833    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f"} err="failed to get container status \"6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f\": rpc error: code = NotFound desc = could not find container \"6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f\": container with ID starting with 6511de5a6b688a89db95a3da2f48d9d46bcc4c402eb43fd1656d5c94e0e8e96f not found: ID does not exist"
Jul 22 03:36:33.261201 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.261178    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"]
Jul 22 03:36:33.265334 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:33.265314    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-19cc62-openshift-default-dcd667887-nmxtt"]
Jul 22 03:36:34.189528 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:34.189485    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" path="/var/lib/kubelet/pods/39194fd8-b519-450c-8c03-d63dd5bad39b/volumes"
Jul 22 03:36:55.154125 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:55.154088    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"]
Jul 22 03:36:55.154624 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:55.154307    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy" containerID="cri-o://6dc3bfcc4695da63c4904ab2bfaaf36de8e040e8f4960cf302c88dd6d567481c" gracePeriod=30
Jul 22 03:36:56.091017 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.090985    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"]
Jul 22 03:36:56.091297 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.091285    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy"
Jul 22 03:36:56.091340 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.091299    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy"
Jul 22 03:36:56.091379 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.091369    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy"
Jul 22 03:36:56.091435 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.091380    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy"
Jul 22 03:36:56.094541 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.094519    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.096902 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.096885    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c19e4b-openshift-default-dockercfg-gkshr\""
Jul 22 03:36:56.106639 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.106611    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"]
Jul 22 03:36:56.114007 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.113982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-envoy\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.114102 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.114012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-token\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.114102 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.114035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-podinfo\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.114187 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.114131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-credential-socket\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.114187 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.114172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istiod-ca-cert\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.114271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.114196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg5v8\" (UniqueName: \"kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-kube-api-access-sg5v8\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.114271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.114231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-socket\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.114271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.114246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-data\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.114271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.114265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-certs\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.214744 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.214711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-envoy\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.214744 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.214745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-token\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215297 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.214773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-podinfo\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215297 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.214837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-credential-socket\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215297 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.214880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istiod-ca-cert\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215297 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.214908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg5v8\" (UniqueName: \"kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-kube-api-access-sg5v8\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215297 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.214970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-socket\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.215335    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-credential-socket\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.215367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-socket\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.215431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-data\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.215479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-certs\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215606 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.215583    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-data\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215884 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.215727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-certs\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.215884 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.215751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istiod-ca-cert\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.217088 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.217066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-envoy\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.217312 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.217297    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-podinfo\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.223478 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.223454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg5v8\" (UniqueName: \"kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-kube-api-access-sg5v8\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.223564 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.223524    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-token\") pod \"e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") " pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.404776 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.404745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:56.546027 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.546003    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"]
Jul 22 03:36:56.548560 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:36:56.548527    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1d5b0d_908c_431f_bf07_e855e9b4da8c.slice/crio-d8b1722bdce00dbe0d26a10ba97dc3026058c39d7d17b167c26e6ad0cf602d48 WatchSource:0}: Error finding container d8b1722bdce00dbe0d26a10ba97dc3026058c39d7d17b167c26e6ad0cf602d48: Status 404 returned error can't find the container with id d8b1722bdce00dbe0d26a10ba97dc3026058c39d7d17b167c26e6ad0cf602d48
Jul 22 03:36:56.553014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.552981    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:36:56.553109 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.553048    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:36:56.553109 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:56.553079    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:36:57.339833 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:57.339797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" event={"ID":"6c1d5b0d-908c-431f-bf07-e855e9b4da8c","Type":"ContainerStarted","Data":"65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b"}
Jul 22 03:36:57.340246 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:57.339859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" event={"ID":"6c1d5b0d-908c-431f-bf07-e855e9b4da8c","Type":"ContainerStarted","Data":"d8b1722bdce00dbe0d26a10ba97dc3026058c39d7d17b167c26e6ad0cf602d48"}
Jul 22 03:36:57.361413 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:57.361334    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" podStartSLOduration=1.361313291 podStartE2EDuration="1.361313291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:36:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:36:57.361244246 +0000 UTC m=+2331.247372387" watchObservedRunningTime="2026-07-22 03:36:57.361313291 +0000 UTC m=+2331.247441430"
Jul 22 03:36:57.405848 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:57.405808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:57.411352 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:57.411324    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:58.344224 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:58.344147    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:36:58.345151 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:36:58.345125    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:37:00.361362 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.361327    2576 generic.go:356] "Generic (PLEG): container finished" podID="0d841146-c9c1-4035-bad9-5d094155e072" containerID="6dc3bfcc4695da63c4904ab2bfaaf36de8e040e8f4960cf302c88dd6d567481c" exitCode=0
Jul 22 03:37:00.361787 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.361411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" event={"ID":"0d841146-c9c1-4035-bad9-5d094155e072","Type":"ContainerDied","Data":"6dc3bfcc4695da63c4904ab2bfaaf36de8e040e8f4960cf302c88dd6d567481c"}
Jul 22 03:37:00.361787 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.361474    2576 scope.go:117] "RemoveContainer" containerID="a07cc7c7e04a0e6f65e6192d0f670bf498efcdeedbd0366c15efbef4f991d4a9"
Jul 22 03:37:00.413049 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.412978    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:37:00.441479 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441447    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d841146-c9c1-4035-bad9-5d094155e072-istiod-ca-cert\") pod \"0d841146-c9c1-4035-bad9-5d094155e072\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") "
Jul 22 03:37:00.441660 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441512    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-certs\") pod \"0d841146-c9c1-4035-bad9-5d094155e072\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") "
Jul 22 03:37:00.441660 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441564    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-data\") pod \"0d841146-c9c1-4035-bad9-5d094155e072\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") "
Jul 22 03:37:00.441660 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441621    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d841146-c9c1-4035-bad9-5d094155e072-istio-podinfo\") pod \"0d841146-c9c1-4035-bad9-5d094155e072\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") "
Jul 22 03:37:00.441660 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441649    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhdh7\" (UniqueName: \"kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-kube-api-access-bhdh7\") pod \"0d841146-c9c1-4035-bad9-5d094155e072\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") "
Jul 22 03:37:00.441876 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441680    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-envoy\") pod \"0d841146-c9c1-4035-bad9-5d094155e072\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") "
Jul 22 03:37:00.441876 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441703    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-socket\") pod \"0d841146-c9c1-4035-bad9-5d094155e072\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") "
Jul 22 03:37:00.441876 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441744    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-credential-socket\") pod \"0d841146-c9c1-4035-bad9-5d094155e072\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") "
Jul 22 03:37:00.441876 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441771    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-istio-token\") pod \"0d841146-c9c1-4035-bad9-5d094155e072\" (UID: \"0d841146-c9c1-4035-bad9-5d094155e072\") "
Jul 22 03:37:00.441876 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441835    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d841146-c9c1-4035-bad9-5d094155e072" (UID: "0d841146-c9c1-4035-bad9-5d094155e072"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:37:00.442126 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.441954    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d841146-c9c1-4035-bad9-5d094155e072-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d841146-c9c1-4035-bad9-5d094155e072" (UID: "0d841146-c9c1-4035-bad9-5d094155e072"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:37:00.442181 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.442131    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:37:00.442181 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.442151    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d841146-c9c1-4035-bad9-5d094155e072-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:37:00.442671 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.442319    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d841146-c9c1-4035-bad9-5d094155e072" (UID: "0d841146-c9c1-4035-bad9-5d094155e072"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:37:00.442785 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.442692    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d841146-c9c1-4035-bad9-5d094155e072" (UID: "0d841146-c9c1-4035-bad9-5d094155e072"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:37:00.442848 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.442815    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d841146-c9c1-4035-bad9-5d094155e072" (UID: "0d841146-c9c1-4035-bad9-5d094155e072"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:37:00.444437 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.444388    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d841146-c9c1-4035-bad9-5d094155e072" (UID: "0d841146-c9c1-4035-bad9-5d094155e072"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:37:00.444785 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.444751    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-kube-api-access-bhdh7" (OuterVolumeSpecName: "kube-api-access-bhdh7") pod "0d841146-c9c1-4035-bad9-5d094155e072" (UID: "0d841146-c9c1-4035-bad9-5d094155e072"). InnerVolumeSpecName "kube-api-access-bhdh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:37:00.444949 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.444929    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d841146-c9c1-4035-bad9-5d094155e072-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d841146-c9c1-4035-bad9-5d094155e072" (UID: "0d841146-c9c1-4035-bad9-5d094155e072"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:37:00.445771 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.445745    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d841146-c9c1-4035-bad9-5d094155e072" (UID: "0d841146-c9c1-4035-bad9-5d094155e072"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:37:00.542888 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.542837    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:37:00.542888 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.542873    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d841146-c9c1-4035-bad9-5d094155e072-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:37:00.542888 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.542883    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhdh7\" (UniqueName: \"kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-kube-api-access-bhdh7\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:37:00.542888 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.542894    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:37:00.543166 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.542903    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:37:00.543166 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.542916    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d841146-c9c1-4035-bad9-5d094155e072-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:37:00.543166 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:00.542929    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d841146-c9c1-4035-bad9-5d094155e072-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:37:01.366911 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:01.366879    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"
Jul 22 03:37:01.367352 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:01.366886    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s" event={"ID":"0d841146-c9c1-4035-bad9-5d094155e072","Type":"ContainerDied","Data":"c6f854bc2e2f8c8f59a64c0d7dfd6d62a210697da4abcd1c97e1d482d9380b14"}
Jul 22 03:37:01.367352 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:01.367015    2576 scope.go:117] "RemoveContainer" containerID="6dc3bfcc4695da63c4904ab2bfaaf36de8e040e8f4960cf302c88dd6d567481c"
Jul 22 03:37:01.391883 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:01.391852    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"]
Jul 22 03:37:01.393891 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:01.393866    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ed08a5-openshift-default-74dbf7cf47-tg74s"]
Jul 22 03:37:02.183850 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:02.183815    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d841146-c9c1-4035-bad9-5d094155e072" path="/var/lib/kubelet/pods/0d841146-c9c1-4035-bad9-5d094155e072/volumes"
Jul 22 03:37:04.582373 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.582335    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"]
Jul 22 03:37:04.582813 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.582715    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy"
Jul 22 03:37:04.582813 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.582730    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy"
Jul 22 03:37:04.582813 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.582741    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy"
Jul 22 03:37:04.582813 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.582747    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="39194fd8-b519-450c-8c03-d63dd5bad39b" containerName="istio-proxy"
Jul 22 03:37:04.582813 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.582807    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy"
Jul 22 03:37:04.582813 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.582817    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy"
Jul 22 03:37:04.587524 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.587503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.590054 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.590030    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-49462a-openshift-default-dockercfg-rqhfh\""
Jul 22 03:37:04.600458 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.600376    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"]
Jul 22 03:37:04.674730 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.674690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-socket\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.674946 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.674755    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-certs\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.674946 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.674777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-podinfo\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.674946 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.674832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-envoy\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.674946 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.674859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/867d91d6-4d3a-44a3-b85c-191c93d63f42-istiod-ca-cert\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.674946 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.674914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-credential-socket\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.674946 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.674940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-token\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.675236 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.675009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-data\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.675236 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.675040    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxdkr\" (UniqueName: \"kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-kube-api-access-cxdkr\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.775787 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.775752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-certs\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.775787 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.775786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-podinfo\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776067 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.775823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-envoy\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776067 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.775844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/867d91d6-4d3a-44a3-b85c-191c93d63f42-istiod-ca-cert\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776067 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.775969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-credential-socket\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776067 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.776002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-token\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776067 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.776030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-data\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776352 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.776327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-data\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776552 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.776525    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-certs\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776552 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.776450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxdkr\" (UniqueName: \"kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-kube-api-access-cxdkr\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776702 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.776414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-credential-socket\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776762 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.776737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/867d91d6-4d3a-44a3-b85c-191c93d63f42-istiod-ca-cert\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.776849 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.776832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-socket\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.777096 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.777078    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-socket\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.778447 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.778425    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-podinfo\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.778447 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.778436    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-envoy\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.783732 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.783707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-token\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.783842 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.783827    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxdkr\" (UniqueName: \"kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-kube-api-access-cxdkr\") pod \"e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") " pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:04.897984 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:04.897947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:05.040491 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:05.040465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"]
Jul 22 03:37:05.042582 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:37:05.042541    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867d91d6_4d3a_44a3_b85c_191c93d63f42.slice/crio-61018513da9b1fdbf5f9ef19f18eb431be1fffc7bba5ca4c5207e2a3bb844338 WatchSource:0}: Error finding container 61018513da9b1fdbf5f9ef19f18eb431be1fffc7bba5ca4c5207e2a3bb844338: Status 404 returned error can't find the container with id 61018513da9b1fdbf5f9ef19f18eb431be1fffc7bba5ca4c5207e2a3bb844338
Jul 22 03:37:05.044749 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:05.044710    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:37:05.044828 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:05.044793    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:37:05.044866 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:05.044838    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:37:05.388874 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:05.388775    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" event={"ID":"867d91d6-4d3a-44a3-b85c-191c93d63f42","Type":"ContainerStarted","Data":"c3efc951687b3883b2a99e53b5d23ff5c608363e2af79c340b31b8d502fcdbbd"}
Jul 22 03:37:05.388874 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:05.388854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" event={"ID":"867d91d6-4d3a-44a3-b85c-191c93d63f42","Type":"ContainerStarted","Data":"61018513da9b1fdbf5f9ef19f18eb431be1fffc7bba5ca4c5207e2a3bb844338"}
Jul 22 03:37:05.410853 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:05.410796    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" podStartSLOduration=1.410781378 podStartE2EDuration="1.410781378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:37:05.40861456 +0000 UTC m=+2339.294742724" watchObservedRunningTime="2026-07-22 03:37:05.410781378 +0000 UTC m=+2339.296909518"
Jul 22 03:37:05.898376 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:05.898341    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:06.903483 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:06.903453    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:07.398784 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:07.398754    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:07.399713 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:07.399693    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:13.773854 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:13.772767    2576 patch_prober.go:28] interesting pod/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:33574->10.133.0.47:15021: read: connection reset by peer" start-of-body=
Jul 22 03:37:13.773854 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:13.772855    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:33574->10.133.0.47:15021: read: connection reset by peer"
Jul 22 03:37:14.428902 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:14.428869    2576 generic.go:356] "Generic (PLEG): container finished" podID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerID="65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b" exitCode=0
Jul 22 03:37:14.429085 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:14.428924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" event={"ID":"6c1d5b0d-908c-431f-bf07-e855e9b4da8c","Type":"ContainerDied","Data":"65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b"}
Jul 22 03:37:14.429329 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:14.429316    2576 scope.go:117] "RemoveContainer" containerID="65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b"
Jul 22 03:37:14.430670 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:14.430626    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:37:14.430784 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:14.430731    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:37:14.430849 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:14.430782    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:37:15.437782 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:15.437729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" event={"ID":"6c1d5b0d-908c-431f-bf07-e855e9b4da8c","Type":"ContainerStarted","Data":"a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b"}
Jul 22 03:37:16.405909 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:16.405873    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:37:16.406135 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:16.406110    2576 patch_prober.go:28] interesting pod/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 22 03:37:16.406222 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:16.406173    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 22 03:37:17.405711 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:17.405658    2576 patch_prober.go:28] interesting pod/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 22 03:37:17.406239 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:17.405730    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 22 03:37:18.406089 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:18.406055    2576 patch_prober.go:28] interesting pod/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 22 03:37:18.406527 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:18.406110    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 22 03:37:19.409371 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:19.409344    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:37:19.409786 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:19.409740    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:37:19.410507 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:19.410484    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:37:19.464596 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:19.464563    2576 generic.go:356] "Generic (PLEG): container finished" podID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerID="c3efc951687b3883b2a99e53b5d23ff5c608363e2af79c340b31b8d502fcdbbd" exitCode=0
Jul 22 03:37:19.464796 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:19.464638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" event={"ID":"867d91d6-4d3a-44a3-b85c-191c93d63f42","Type":"ContainerDied","Data":"c3efc951687b3883b2a99e53b5d23ff5c608363e2af79c340b31b8d502fcdbbd"}
Jul 22 03:37:19.465235 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:19.465212    2576 scope.go:117] "RemoveContainer" containerID="c3efc951687b3883b2a99e53b5d23ff5c608363e2af79c340b31b8d502fcdbbd"
Jul 22 03:37:19.466338 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:19.466307    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:37:19.466466 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:19.466383    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:37:19.466466 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:19.466441    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 03:37:20.475933 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:20.475890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" event={"ID":"867d91d6-4d3a-44a3-b85c-191c93d63f42","Type":"ContainerStarted","Data":"b64501ee21fee84062615db6fe376b20f3c9453831e79311f0960e5c2af183c8"}
Jul 22 03:37:20.898738 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:20.898700    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:20.899945 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:20.899917    2576 patch_prober.go:28] interesting pod/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 22 03:37:20.900050 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:20.899984    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 22 03:37:21.899122 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:21.899083    2576 patch_prober.go:28] interesting pod/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 22 03:37:21.899562 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:21.899156    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 22 03:37:22.399245 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:22.399216    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:22.898988 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:22.898958    2576 patch_prober.go:28] interesting pod/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 22 03:37:22.899177 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:22.899022    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 22 03:37:23.899100 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:23.899062    2576 patch_prober.go:28] interesting pod/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 22 03:37:23.899300 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:23.899125    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 22 03:37:24.903228 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:24.903196    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:24.904316 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:24.904297    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:37:31.303815 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.303778    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"]
Jul 22 03:37:31.304277 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.304088    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy"
Jul 22 03:37:31.304277 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.304098    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d841146-c9c1-4035-bad9-5d094155e072" containerName="istio-proxy"
Jul 22 03:37:31.307200 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.307184    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.311343 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.311318    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c19e4b\"/\"openshift-service-ca.crt\""
Jul 22 03:37:31.311507 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.311343    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c19e4b\"/\"default-dockercfg-p24hb\""
Jul 22 03:37:31.311507 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.311351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c19e4b\"/\"auth-test-model-c19e4b-kserve-self-signed-certs\""
Jul 22 03:37:31.311507 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.311344    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c19e4b\"/\"kube-root-ca.crt\""
Jul 22 03:37:31.319008 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.318984    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"]
Jul 22 03:37:31.428224 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.428190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-home\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.428224 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.428225    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-model-cache\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.428490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.428245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-dshm\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.428490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.428273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-tmp-dir\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.428490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.428346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e320a76-e3ac-42e6-83b6-3987756349bc-tls-certs\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.428490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.428394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mx9r\" (UniqueName: \"kubernetes.io/projected/8e320a76-e3ac-42e6-83b6-3987756349bc-kube-api-access-2mx9r\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.529383 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.529336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-home\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.529383 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.529385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-model-cache\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.529644 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.529429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-dshm\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.529644 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.529457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-tmp-dir\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.529644 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.529509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e320a76-e3ac-42e6-83b6-3987756349bc-tls-certs\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.529644 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.529557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mx9r\" (UniqueName: \"kubernetes.io/projected/8e320a76-e3ac-42e6-83b6-3987756349bc-kube-api-access-2mx9r\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.529863 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.529826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-home\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.530227 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.530190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-tmp-dir\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.530227 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.530217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-model-cache\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.532494 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.532469    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-dshm\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.532911 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.532883    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e320a76-e3ac-42e6-83b6-3987756349bc-tls-certs\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.539690 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.539663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mx9r\" (UniqueName: \"kubernetes.io/projected/8e320a76-e3ac-42e6-83b6-3987756349bc-kube-api-access-2mx9r\") pod \"auth-test-model-c19e4b-kserve-7b8558579f-dh8xf\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") " pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.616448 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.616325    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:31.751183 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:31.751148    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"]
Jul 22 03:37:31.754993 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:37:31.754966    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e320a76_e3ac_42e6_83b6_3987756349bc.slice/crio-bd73ca3a7dce8820634f9e0bd13a7399dd318ab22d18e808221f425b951a1ca7 WatchSource:0}: Error finding container bd73ca3a7dce8820634f9e0bd13a7399dd318ab22d18e808221f425b951a1ca7: Status 404 returned error can't find the container with id bd73ca3a7dce8820634f9e0bd13a7399dd318ab22d18e808221f425b951a1ca7
Jul 22 03:37:32.535311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:32.535271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf" event={"ID":"8e320a76-e3ac-42e6-83b6-3987756349bc","Type":"ContainerStarted","Data":"4b3530ce9e6d6ce77c081a9215d897f46e22edd03e33c8cc7eadf9127c702413"}
Jul 22 03:37:32.535727 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:32.535320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf" event={"ID":"8e320a76-e3ac-42e6-83b6-3987756349bc","Type":"ContainerStarted","Data":"bd73ca3a7dce8820634f9e0bd13a7399dd318ab22d18e808221f425b951a1ca7"}
Jul 22 03:37:32.553731 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:32.553680    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf" podStartSLOduration=1.553662919 podStartE2EDuration="1.553662919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:37:32.551861763 +0000 UTC m=+2366.437989906" watchObservedRunningTime="2026-07-22 03:37:32.553662919 +0000 UTC m=+2366.439791059"
Jul 22 03:37:41.617311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:41.617255    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:41.617311 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:41.617324    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:41.629909 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:41.629876    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:37:42.588937 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:37:42.588900    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:38:12.805536 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.805503    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"]
Jul 22 03:38:12.808384 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.808364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:12.810884 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.810861    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"openshift-service-ca.crt\""
Jul 22 03:38:12.811840 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.811821    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"kube-root-ca.crt\""
Jul 22 03:38:12.812040 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.812022    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"auth-test-model-49462a-kserve-self-signed-certs\""
Jul 22 03:38:12.812121 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.812100    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"default-dockercfg-7jvt6\""
Jul 22 03:38:12.819376 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.819353    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"]
Jul 22 03:38:12.899002 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.898967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-tmp-dir\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:12.899002 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.899006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-dshm\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:12.899235 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.899063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-model-cache\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:12.899235 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.899150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mbbr\" (UniqueName: \"kubernetes.io/projected/9189a454-935e-4362-ab95-7bad373b46de-kube-api-access-5mbbr\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:12.899235 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.899197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9189a454-935e-4362-ab95-7bad373b46de-tls-certs\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:12.899235 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:12.899226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-home\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.000205 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.000164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mbbr\" (UniqueName: \"kubernetes.io/projected/9189a454-935e-4362-ab95-7bad373b46de-kube-api-access-5mbbr\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.000441 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.000213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9189a454-935e-4362-ab95-7bad373b46de-tls-certs\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.000441 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.000249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-home\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.000441 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.000277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-tmp-dir\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.000441 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.000307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-dshm\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.000912 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.000748    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-model-cache\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.000912 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.000859    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-tmp-dir\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.001545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.001522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-home\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.001691 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.001636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-model-cache\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.003080 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.003042    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-dshm\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.004415 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.004351    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9189a454-935e-4362-ab95-7bad373b46de-tls-certs\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.010821 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.010775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mbbr\" (UniqueName: \"kubernetes.io/projected/9189a454-935e-4362-ab95-7bad373b46de-kube-api-access-5mbbr\") pod \"auth-test-model-49462a-kserve-6f56c4b4c-4tgg9\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") " pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.118507 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.118416    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:13.255205 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.255169    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"]
Jul 22 03:38:13.258926 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:38:13.258895    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9189a454_935e_4362_ab95_7bad373b46de.slice/crio-84d7519f48287698003e00cfe2cdc1e0ea0ef5b2e3aa8f9e240861a3c4e8fd39 WatchSource:0}: Error finding container 84d7519f48287698003e00cfe2cdc1e0ea0ef5b2e3aa8f9e240861a3c4e8fd39: Status 404 returned error can't find the container with id 84d7519f48287698003e00cfe2cdc1e0ea0ef5b2e3aa8f9e240861a3c4e8fd39
Jul 22 03:38:13.711514 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.711472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9" event={"ID":"9189a454-935e-4362-ab95-7bad373b46de","Type":"ContainerStarted","Data":"e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a"}
Jul 22 03:38:13.711514 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.711517    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9" event={"ID":"9189a454-935e-4362-ab95-7bad373b46de","Type":"ContainerStarted","Data":"84d7519f48287698003e00cfe2cdc1e0ea0ef5b2e3aa8f9e240861a3c4e8fd39"}
Jul 22 03:38:13.730610 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:13.730557    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9" podStartSLOduration=1.730541459 podStartE2EDuration="1.730541459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:38:13.72947874 +0000 UTC m=+2407.615606881" watchObservedRunningTime="2026-07-22 03:38:13.730541459 +0000 UTC m=+2407.616669598"
Jul 22 03:38:23.119390 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:23.119332    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:23.119390 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:23.119432    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:23.131923 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:23.131890    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:38:23.769091 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:38:23.769063    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:40:13.053072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:13.052987    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"]
Jul 22 03:40:13.921718 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:13.921681    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"]
Jul 22 03:40:28.073213 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.073149    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf" podUID="8e320a76-e3ac-42e6-83b6-3987756349bc" containerName="main" containerID="cri-o://4b3530ce9e6d6ce77c081a9215d897f46e22edd03e33c8cc7eadf9127c702413" gracePeriod=45
Jul 22 03:40:28.312506 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.312473    2576 generic.go:356] "Generic (PLEG): container finished" podID="8e320a76-e3ac-42e6-83b6-3987756349bc" containerID="4b3530ce9e6d6ce77c081a9215d897f46e22edd03e33c8cc7eadf9127c702413" exitCode=0
Jul 22 03:40:28.312630 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.312515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf" event={"ID":"8e320a76-e3ac-42e6-83b6-3987756349bc","Type":"ContainerDied","Data":"4b3530ce9e6d6ce77c081a9215d897f46e22edd03e33c8cc7eadf9127c702413"}
Jul 22 03:40:28.312630 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.312550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf" event={"ID":"8e320a76-e3ac-42e6-83b6-3987756349bc","Type":"ContainerDied","Data":"bd73ca3a7dce8820634f9e0bd13a7399dd318ab22d18e808221f425b951a1ca7"}
Jul 22 03:40:28.312630 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.312563    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd73ca3a7dce8820634f9e0bd13a7399dd318ab22d18e808221f425b951a1ca7"
Jul 22 03:40:28.323725 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.323670    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:40:28.437779 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.437741    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-dshm\") pod \"8e320a76-e3ac-42e6-83b6-3987756349bc\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") "
Jul 22 03:40:28.437976 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.437815    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mx9r\" (UniqueName: \"kubernetes.io/projected/8e320a76-e3ac-42e6-83b6-3987756349bc-kube-api-access-2mx9r\") pod \"8e320a76-e3ac-42e6-83b6-3987756349bc\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") "
Jul 22 03:40:28.437976 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.437871    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-model-cache\") pod \"8e320a76-e3ac-42e6-83b6-3987756349bc\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") "
Jul 22 03:40:28.437976 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.437904    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e320a76-e3ac-42e6-83b6-3987756349bc-tls-certs\") pod \"8e320a76-e3ac-42e6-83b6-3987756349bc\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") "
Jul 22 03:40:28.437976 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.437955    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-home\") pod \"8e320a76-e3ac-42e6-83b6-3987756349bc\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") "
Jul 22 03:40:28.438282 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.437983    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-tmp-dir\") pod \"8e320a76-e3ac-42e6-83b6-3987756349bc\" (UID: \"8e320a76-e3ac-42e6-83b6-3987756349bc\") "
Jul 22 03:40:28.438282 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.438167    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-model-cache" (OuterVolumeSpecName: "model-cache") pod "8e320a76-e3ac-42e6-83b6-3987756349bc" (UID: "8e320a76-e3ac-42e6-83b6-3987756349bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:40:28.438373 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.438240    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-home" (OuterVolumeSpecName: "home") pod "8e320a76-e3ac-42e6-83b6-3987756349bc" (UID: "8e320a76-e3ac-42e6-83b6-3987756349bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:40:28.438373 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.438294    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8e320a76-e3ac-42e6-83b6-3987756349bc" (UID: "8e320a76-e3ac-42e6-83b6-3987756349bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:40:28.438477 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.438388    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:28.438477 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.438426    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:28.438477 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.438440    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:28.440242 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.440218    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-dshm" (OuterVolumeSpecName: "dshm") pod "8e320a76-e3ac-42e6-83b6-3987756349bc" (UID: "8e320a76-e3ac-42e6-83b6-3987756349bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:40:28.440242 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.440229    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e320a76-e3ac-42e6-83b6-3987756349bc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8e320a76-e3ac-42e6-83b6-3987756349bc" (UID: "8e320a76-e3ac-42e6-83b6-3987756349bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:40:28.440242 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.440239    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e320a76-e3ac-42e6-83b6-3987756349bc-kube-api-access-2mx9r" (OuterVolumeSpecName: "kube-api-access-2mx9r") pod "8e320a76-e3ac-42e6-83b6-3987756349bc" (UID: "8e320a76-e3ac-42e6-83b6-3987756349bc"). InnerVolumeSpecName "kube-api-access-2mx9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:40:28.539049 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.538997    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e320a76-e3ac-42e6-83b6-3987756349bc-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:28.539049 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.539042    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e320a76-e3ac-42e6-83b6-3987756349bc-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:28.539049 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.539052    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mx9r\" (UniqueName: \"kubernetes.io/projected/8e320a76-e3ac-42e6-83b6-3987756349bc-kube-api-access-2mx9r\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:28.941836 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:28.941771    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9" podUID="9189a454-935e-4362-ab95-7bad373b46de" containerName="main" containerID="cri-o://e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a" gracePeriod=45
Jul 22 03:40:29.190821 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.190794    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:40:29.246101 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.246001    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mbbr\" (UniqueName: \"kubernetes.io/projected/9189a454-935e-4362-ab95-7bad373b46de-kube-api-access-5mbbr\") pod \"9189a454-935e-4362-ab95-7bad373b46de\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") "
Jul 22 03:40:29.246101 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.246057    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-dshm\") pod \"9189a454-935e-4362-ab95-7bad373b46de\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") "
Jul 22 03:40:29.246428 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.246144    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-tmp-dir\") pod \"9189a454-935e-4362-ab95-7bad373b46de\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") "
Jul 22 03:40:29.246428 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.246169    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9189a454-935e-4362-ab95-7bad373b46de-tls-certs\") pod \"9189a454-935e-4362-ab95-7bad373b46de\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") "
Jul 22 03:40:29.246428 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.246202    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-model-cache\") pod \"9189a454-935e-4362-ab95-7bad373b46de\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") "
Jul 22 03:40:29.246428 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.246243    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-home\") pod \"9189a454-935e-4362-ab95-7bad373b46de\" (UID: \"9189a454-935e-4362-ab95-7bad373b46de\") "
Jul 22 03:40:29.246643 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.246389    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9189a454-935e-4362-ab95-7bad373b46de" (UID: "9189a454-935e-4362-ab95-7bad373b46de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:40:29.246643 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.246511    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-model-cache" (OuterVolumeSpecName: "model-cache") pod "9189a454-935e-4362-ab95-7bad373b46de" (UID: "9189a454-935e-4362-ab95-7bad373b46de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:40:29.246643 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.246560    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-home" (OuterVolumeSpecName: "home") pod "9189a454-935e-4362-ab95-7bad373b46de" (UID: "9189a454-935e-4362-ab95-7bad373b46de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:40:29.246643 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.246577    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:29.248367 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.248335    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-dshm" (OuterVolumeSpecName: "dshm") pod "9189a454-935e-4362-ab95-7bad373b46de" (UID: "9189a454-935e-4362-ab95-7bad373b46de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:40:29.248514 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.248417    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9189a454-935e-4362-ab95-7bad373b46de-kube-api-access-5mbbr" (OuterVolumeSpecName: "kube-api-access-5mbbr") pod "9189a454-935e-4362-ab95-7bad373b46de" (UID: "9189a454-935e-4362-ab95-7bad373b46de"). InnerVolumeSpecName "kube-api-access-5mbbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:40:29.248514 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.248442    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9189a454-935e-4362-ab95-7bad373b46de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9189a454-935e-4362-ab95-7bad373b46de" (UID: "9189a454-935e-4362-ab95-7bad373b46de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:40:29.319576 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.319543    2576 generic.go:356] "Generic (PLEG): container finished" podID="9189a454-935e-4362-ab95-7bad373b46de" containerID="e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a" exitCode=0
Jul 22 03:40:29.319576 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.319588    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"
Jul 22 03:40:29.319815 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.319625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9" event={"ID":"9189a454-935e-4362-ab95-7bad373b46de","Type":"ContainerDied","Data":"e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a"}
Jul 22 03:40:29.319815 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.319664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9" event={"ID":"9189a454-935e-4362-ab95-7bad373b46de","Type":"ContainerDied","Data":"84d7519f48287698003e00cfe2cdc1e0ea0ef5b2e3aa8f9e240861a3c4e8fd39"}
Jul 22 03:40:29.319815 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.319689    2576 scope.go:117] "RemoveContainer" containerID="e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a"
Jul 22 03:40:29.319975 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.319829    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"
Jul 22 03:40:29.329292 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.329271    2576 scope.go:117] "RemoveContainer" containerID="e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a"
Jul 22 03:40:29.329586 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:40:29.329566    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a\": container with ID starting with e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a not found: ID does not exist" containerID="e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a"
Jul 22 03:40:29.329668 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.329594    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a"} err="failed to get container status \"e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a\": rpc error: code = NotFound desc = could not find container \"e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a\": container with ID starting with e91134fe0f4fa55cb73cce518c6aa5ef0647f75756b12ba8ab44a1262f57ec8a not found: ID does not exist"
Jul 22 03:40:29.346700 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.346667    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"]
Jul 22 03:40:29.347027 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.347009    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:29.347072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.347031    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mbbr\" (UniqueName: \"kubernetes.io/projected/9189a454-935e-4362-ab95-7bad373b46de-kube-api-access-5mbbr\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:29.347072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.347040    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:29.347072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.347049    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9189a454-935e-4362-ab95-7bad373b46de-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:29.347072 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.347059    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9189a454-935e-4362-ab95-7bad373b46de-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:40:29.354365 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.354342    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/auth-test-model-c19e4b-kserve-7b8558579f-dh8xf"]
Jul 22 03:40:29.373455 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.373429    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"]
Jul 22 03:40:29.378670 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:29.378646    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/auth-test-model-49462a-kserve-6f56c4b4c-4tgg9"]
Jul 22 03:40:30.183786 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:30.183752    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e320a76-e3ac-42e6-83b6-3987756349bc" path="/var/lib/kubelet/pods/8e320a76-e3ac-42e6-83b6-3987756349bc/volumes"
Jul 22 03:40:30.184153 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:30.184140    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9189a454-935e-4362-ab95-7bad373b46de" path="/var/lib/kubelet/pods/9189a454-935e-4362-ab95-7bad373b46de/volumes"
Jul 22 03:40:35.813810 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.813765    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"]
Jul 22 03:40:35.814236 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.814080    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e320a76-e3ac-42e6-83b6-3987756349bc" containerName="main"
Jul 22 03:40:35.814236 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.814092    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e320a76-e3ac-42e6-83b6-3987756349bc" containerName="main"
Jul 22 03:40:35.814236 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.814104    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9189a454-935e-4362-ab95-7bad373b46de" containerName="main"
Jul 22 03:40:35.814236 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.814110    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9189a454-935e-4362-ab95-7bad373b46de" containerName="main"
Jul 22 03:40:35.814236 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.814170    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e320a76-e3ac-42e6-83b6-3987756349bc" containerName="main"
Jul 22 03:40:35.814236 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.814178    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9189a454-935e-4362-ab95-7bad373b46de" containerName="main"
Jul 22 03:40:35.818138 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.818120    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:35.821593 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.821567    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c19e4b\"/\"kube-root-ca.crt\""
Jul 22 03:40:35.821593 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.821587    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c19e4b\"/\"openshift-service-ca.crt\""
Jul 22 03:40:35.821798 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.821568    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c19e4b\"/\"sub-test-model-c19e4b-kserve-self-signed-certs\""
Jul 22 03:40:35.821798 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.821569    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c19e4b\"/\"default-dockercfg-p24hb\""
Jul 22 03:40:35.826262 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.826237    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"]
Jul 22 03:40:35.904178 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.904138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-home\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:35.904442 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.904196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tmp-dir\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:35.904442 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.904282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-model-cache\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:35.904442 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.904312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-dshm\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:35.904442 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.904343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t5sv\" (UniqueName: \"kubernetes.io/projected/7f5519ba-2cf2-4886-afcb-53f84b1569a7-kube-api-access-5t5sv\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:35.904610 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:35.904485    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tls-certs\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.005755 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.005720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tls-certs\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.005973 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.005771    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-home\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.005973 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.005807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tmp-dir\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.005973 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.005859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-model-cache\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.005973 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.005889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-dshm\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.006184 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.006017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5sv\" (UniqueName: \"kubernetes.io/projected/7f5519ba-2cf2-4886-afcb-53f84b1569a7-kube-api-access-5t5sv\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.006283 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.006254    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-home\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.006425 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.006270    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tmp-dir\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.006425 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.006357    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-model-cache\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.008068 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.008041    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-dshm\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.008469 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.008448    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tls-certs\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.014614 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.014597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t5sv\" (UniqueName: \"kubernetes.io/projected/7f5519ba-2cf2-4886-afcb-53f84b1569a7-kube-api-access-5t5sv\") pod \"sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") " pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.128119 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.128016    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:36.269273 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.269226    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"]
Jul 22 03:40:36.271501 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:40:36.271471    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f5519ba_2cf2_4886_afcb_53f84b1569a7.slice/crio-03349cf6862b0c34c361c42024529682391cdc3ad57c7f965ee319c2734315e8 WatchSource:0}: Error finding container 03349cf6862b0c34c361c42024529682391cdc3ad57c7f965ee319c2734315e8: Status 404 returned error can't find the container with id 03349cf6862b0c34c361c42024529682391cdc3ad57c7f965ee319c2734315e8
Jul 22 03:40:36.351825 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.351788    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6" event={"ID":"7f5519ba-2cf2-4886-afcb-53f84b1569a7","Type":"ContainerStarted","Data":"017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317"}
Jul 22 03:40:36.351980 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.351832    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6" event={"ID":"7f5519ba-2cf2-4886-afcb-53f84b1569a7","Type":"ContainerStarted","Data":"03349cf6862b0c34c361c42024529682391cdc3ad57c7f965ee319c2734315e8"}
Jul 22 03:40:36.372537 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:36.372487    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6" podStartSLOduration=1.3724725819999999 podStartE2EDuration="1.372472582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:40:36.370321021 +0000 UTC m=+2550.256449160" watchObservedRunningTime="2026-07-22 03:40:36.372472582 +0000 UTC m=+2550.258600743"
Jul 22 03:40:46.128471 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:46.128430    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:46.129014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:46.128486    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:46.140911 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:46.140883    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:40:46.411301 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:40:46.411274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:41:03.912962 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.912924    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"]
Jul 22 03:41:03.916341 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.916323    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:03.919320 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.919299    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"default-dockercfg-7jvt6\""
Jul 22 03:41:03.920439 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.920418    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"openshift-service-ca.crt\""
Jul 22 03:41:03.920556 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.920424    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"sub-test-model-49462a-kserve-self-signed-certs\""
Jul 22 03:41:03.920556 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.920476    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"kube-root-ca.crt\""
Jul 22 03:41:03.933983 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.933955    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"]
Jul 22 03:41:03.948256 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.948220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2336069d-f5b1-418a-9b71-a99193c5cd3f-tls-certs\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:03.948441 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.948349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-model-cache\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:03.948441 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.948375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-tmp-dir\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:03.948585 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.948460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-dshm\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:03.948585 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.948489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-home\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:03.948585 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:03.948517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76zgz\" (UniqueName: \"kubernetes.io/projected/2336069d-f5b1-418a-9b71-a99193c5cd3f-kube-api-access-76zgz\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.049283 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.049247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-model-cache\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.049283 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.049287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-tmp-dir\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.049589 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.049319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-dshm\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.049589 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.049335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-home\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.049589 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.049350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76zgz\" (UniqueName: \"kubernetes.io/projected/2336069d-f5b1-418a-9b71-a99193c5cd3f-kube-api-access-76zgz\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.049589 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.049372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2336069d-f5b1-418a-9b71-a99193c5cd3f-tls-certs\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.049820 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.049759    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-tmp-dir\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.049820 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.049767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-home\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.049898 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.049846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-model-cache\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.051740 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.051718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-dshm\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.051914 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.051896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2336069d-f5b1-418a-9b71-a99193c5cd3f-tls-certs\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.064787 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.064763    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76zgz\" (UniqueName: \"kubernetes.io/projected/2336069d-f5b1-418a-9b71-a99193c5cd3f-kube-api-access-76zgz\") pod \"sub-test-model-49462a-kserve-546b4496d7-2l2c7\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") " pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.225836 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.225730    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:04.359324 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.359292    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"]
Jul 22 03:41:04.362567 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:41:04.362527    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2336069d_f5b1_418a_9b71_a99193c5cd3f.slice/crio-51e5637c600df9c3cfaa2ee9abb7f2c4d469090c57eef50dcf0b003bd73bbab9 WatchSource:0}: Error finding container 51e5637c600df9c3cfaa2ee9abb7f2c4d469090c57eef50dcf0b003bd73bbab9: Status 404 returned error can't find the container with id 51e5637c600df9c3cfaa2ee9abb7f2c4d469090c57eef50dcf0b003bd73bbab9
Jul 22 03:41:04.486251 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.486152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7" event={"ID":"2336069d-f5b1-418a-9b71-a99193c5cd3f","Type":"ContainerStarted","Data":"6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7"}
Jul 22 03:41:04.486251 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.486201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7" event={"ID":"2336069d-f5b1-418a-9b71-a99193c5cd3f","Type":"ContainerStarted","Data":"51e5637c600df9c3cfaa2ee9abb7f2c4d469090c57eef50dcf0b003bd73bbab9"}
Jul 22 03:41:04.503982 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:04.503921    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7" podStartSLOduration=1.503902177 podStartE2EDuration="1.503902177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:41:04.502488287 +0000 UTC m=+2578.388616428" watchObservedRunningTime="2026-07-22 03:41:04.503902177 +0000 UTC m=+2578.390030316"
Jul 22 03:41:14.226636 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:14.226600    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:14.227048 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:14.226654    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:14.239256 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:14.239233    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:14.546821 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:14.546728    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:41:47.173975 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:47.173886    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"]
Jul 22 03:41:48.074715 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:48.074679    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"]
Jul 22 03:41:59.099332 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.099298    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"]
Jul 22 03:41:59.102671 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.102652    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.105282 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.105253    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c19e4b\"/\"rate-test-model-c19e4b-kserve-self-signed-certs\""
Jul 22 03:41:59.113512 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.113487    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"]
Jul 22 03:41:59.148196 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.148163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-dshm\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.148196 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.148196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/770bcbae-b401-4d94-9d19-54527a69fca8-tls-certs\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.148418 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.148242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-model-cache\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.148418 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.148293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-tmp-dir\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.148418 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.148314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-home\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.148418 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.148331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwphr\" (UniqueName: \"kubernetes.io/projected/770bcbae-b401-4d94-9d19-54527a69fca8-kube-api-access-pwphr\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.249545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.249503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-tmp-dir\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.249545 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.249544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-home\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.249785 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.249568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwphr\" (UniqueName: \"kubernetes.io/projected/770bcbae-b401-4d94-9d19-54527a69fca8-kube-api-access-pwphr\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.249785 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.249653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-dshm\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.249785 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.249678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/770bcbae-b401-4d94-9d19-54527a69fca8-tls-certs\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.249785 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.249732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-model-cache\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.250089 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.250056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-tmp-dir\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.250089 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.250077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-home\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.250251 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.250108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-model-cache\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.252112 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.252090    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-dshm\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.252408 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.252372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/770bcbae-b401-4d94-9d19-54527a69fca8-tls-certs\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.258629 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.258606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwphr\" (UniqueName: \"kubernetes.io/projected/770bcbae-b401-4d94-9d19-54527a69fca8-kube-api-access-pwphr\") pod \"rate-test-model-c19e4b-kserve-6d8677b687-l2gwx\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") " pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.411800 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.411766    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:41:59.549776 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.549752    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"]
Jul 22 03:41:59.551801 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:41:59.551774    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod770bcbae_b401_4d94_9d19_54527a69fca8.slice/crio-f85ba4736a05f9ffd5b8bd6fb8782f4bce68c28321eaaffac25b04251881ea1a WatchSource:0}: Error finding container f85ba4736a05f9ffd5b8bd6fb8782f4bce68c28321eaaffac25b04251881ea1a: Status 404 returned error can't find the container with id f85ba4736a05f9ffd5b8bd6fb8782f4bce68c28321eaaffac25b04251881ea1a
Jul 22 03:41:59.742276 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.742185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx" event={"ID":"770bcbae-b401-4d94-9d19-54527a69fca8","Type":"ContainerStarted","Data":"82a2782eb33cc2f4aa4a1c8f0154c8fbdac879590f540197832562550d535f13"}
Jul 22 03:41:59.742276 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.742230    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx" event={"ID":"770bcbae-b401-4d94-9d19-54527a69fca8","Type":"ContainerStarted","Data":"f85ba4736a05f9ffd5b8bd6fb8782f4bce68c28321eaaffac25b04251881ea1a"}
Jul 22 03:41:59.761875 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:41:59.761786    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx" podStartSLOduration=0.761770913 podStartE2EDuration="761.770913ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:41:59.760175232 +0000 UTC m=+2633.646303371" watchObservedRunningTime="2026-07-22 03:41:59.761770913 +0000 UTC m=+2633.647899053"
Jul 22 03:42:02.193685 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.193643    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6" podUID="7f5519ba-2cf2-4886-afcb-53f84b1569a7" containerName="main" containerID="cri-o://017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317" gracePeriod=45
Jul 22 03:42:02.446459 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.446372    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:42:02.482036 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482009    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-home\") pod \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") "
Jul 22 03:42:02.482198 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482089    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tmp-dir\") pod \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") "
Jul 22 03:42:02.482198 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482108    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-model-cache\") pod \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") "
Jul 22 03:42:02.482198 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482133    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-dshm\") pod \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") "
Jul 22 03:42:02.482198 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482170    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t5sv\" (UniqueName: \"kubernetes.io/projected/7f5519ba-2cf2-4886-afcb-53f84b1569a7-kube-api-access-5t5sv\") pod \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") "
Jul 22 03:42:02.482198 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482193    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tls-certs\") pod \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\" (UID: \"7f5519ba-2cf2-4886-afcb-53f84b1569a7\") "
Jul 22 03:42:02.482488 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482299    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-home" (OuterVolumeSpecName: "home") pod "7f5519ba-2cf2-4886-afcb-53f84b1569a7" (UID: "7f5519ba-2cf2-4886-afcb-53f84b1569a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:42:02.482488 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482385    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "7f5519ba-2cf2-4886-afcb-53f84b1569a7" (UID: "7f5519ba-2cf2-4886-afcb-53f84b1569a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:42:02.482488 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482450    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7f5519ba-2cf2-4886-afcb-53f84b1569a7" (UID: "7f5519ba-2cf2-4886-afcb-53f84b1569a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:42:02.482636 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482493    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:02.482636 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.482507    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:02.484438 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.484413    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-dshm" (OuterVolumeSpecName: "dshm") pod "7f5519ba-2cf2-4886-afcb-53f84b1569a7" (UID: "7f5519ba-2cf2-4886-afcb-53f84b1569a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:42:02.484438 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.484432    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7f5519ba-2cf2-4886-afcb-53f84b1569a7" (UID: "7f5519ba-2cf2-4886-afcb-53f84b1569a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:42:02.484597 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.484475    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5519ba-2cf2-4886-afcb-53f84b1569a7-kube-api-access-5t5sv" (OuterVolumeSpecName: "kube-api-access-5t5sv") pod "7f5519ba-2cf2-4886-afcb-53f84b1569a7" (UID: "7f5519ba-2cf2-4886-afcb-53f84b1569a7"). InnerVolumeSpecName "kube-api-access-5t5sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:42:02.583566 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.583525    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t5sv\" (UniqueName: \"kubernetes.io/projected/7f5519ba-2cf2-4886-afcb-53f84b1569a7-kube-api-access-5t5sv\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:02.583566 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.583559    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:02.583566 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.583570    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:02.583566 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.583578    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f5519ba-2cf2-4886-afcb-53f84b1569a7-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:02.756946 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.756860    2576 generic.go:356] "Generic (PLEG): container finished" podID="7f5519ba-2cf2-4886-afcb-53f84b1569a7" containerID="017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317" exitCode=0
Jul 22 03:42:02.756946 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.756903    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"
Jul 22 03:42:02.757133 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.756949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6" event={"ID":"7f5519ba-2cf2-4886-afcb-53f84b1569a7","Type":"ContainerDied","Data":"017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317"}
Jul 22 03:42:02.757133 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.756993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6" event={"ID":"7f5519ba-2cf2-4886-afcb-53f84b1569a7","Type":"ContainerDied","Data":"03349cf6862b0c34c361c42024529682391cdc3ad57c7f965ee319c2734315e8"}
Jul 22 03:42:02.757133 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.757010    2576 scope.go:117] "RemoveContainer" containerID="017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317"
Jul 22 03:42:02.765819 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.765799    2576 scope.go:117] "RemoveContainer" containerID="017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317"
Jul 22 03:42:02.766082 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:42:02.766063    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317\": container with ID starting with 017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317 not found: ID does not exist" containerID="017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317"
Jul 22 03:42:02.766147 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.766091    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317"} err="failed to get container status \"017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317\": rpc error: code = NotFound desc = could not find container \"017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317\": container with ID starting with 017a98c3abecaab9f742b668ccac8fbd29378c28d9509544d4b5f198e0b81317 not found: ID does not exist"
Jul 22 03:42:02.777675 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.777649    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"]
Jul 22 03:42:02.780985 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:02.780962    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/sub-test-model-c19e4b-kserve-74d7df9bff-dlmz6"]
Jul 22 03:42:03.094963 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.094874    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7" podUID="2336069d-f5b1-418a-9b71-a99193c5cd3f" containerName="main" containerID="cri-o://6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7" gracePeriod=45
Jul 22 03:42:03.347217 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.347153    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:42:03.391345 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391308    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2336069d-f5b1-418a-9b71-a99193c5cd3f-tls-certs\") pod \"2336069d-f5b1-418a-9b71-a99193c5cd3f\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") "
Jul 22 03:42:03.391535 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391365    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-home\") pod \"2336069d-f5b1-418a-9b71-a99193c5cd3f\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") "
Jul 22 03:42:03.391535 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391430    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-model-cache\") pod \"2336069d-f5b1-418a-9b71-a99193c5cd3f\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") "
Jul 22 03:42:03.391615 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391582    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-tmp-dir\") pod \"2336069d-f5b1-418a-9b71-a99193c5cd3f\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") "
Jul 22 03:42:03.391650 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391605    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-home" (OuterVolumeSpecName: "home") pod "2336069d-f5b1-418a-9b71-a99193c5cd3f" (UID: "2336069d-f5b1-418a-9b71-a99193c5cd3f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:42:03.391650 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391613    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76zgz\" (UniqueName: \"kubernetes.io/projected/2336069d-f5b1-418a-9b71-a99193c5cd3f-kube-api-access-76zgz\") pod \"2336069d-f5b1-418a-9b71-a99193c5cd3f\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") "
Jul 22 03:42:03.391750 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391678    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-dshm\") pod \"2336069d-f5b1-418a-9b71-a99193c5cd3f\" (UID: \"2336069d-f5b1-418a-9b71-a99193c5cd3f\") "
Jul 22 03:42:03.391750 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391688    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-model-cache" (OuterVolumeSpecName: "model-cache") pod "2336069d-f5b1-418a-9b71-a99193c5cd3f" (UID: "2336069d-f5b1-418a-9b71-a99193c5cd3f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:42:03.391840 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391822    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2336069d-f5b1-418a-9b71-a99193c5cd3f" (UID: "2336069d-f5b1-418a-9b71-a99193c5cd3f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:42:03.391987 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391969    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:03.392069 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.391987    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:03.392069 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.392005    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:03.393605 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.393579    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2336069d-f5b1-418a-9b71-a99193c5cd3f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2336069d-f5b1-418a-9b71-a99193c5cd3f" (UID: "2336069d-f5b1-418a-9b71-a99193c5cd3f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:42:03.393769 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.393742    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2336069d-f5b1-418a-9b71-a99193c5cd3f-kube-api-access-76zgz" (OuterVolumeSpecName: "kube-api-access-76zgz") pod "2336069d-f5b1-418a-9b71-a99193c5cd3f" (UID: "2336069d-f5b1-418a-9b71-a99193c5cd3f"). InnerVolumeSpecName "kube-api-access-76zgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:42:03.393851 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.393787    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-dshm" (OuterVolumeSpecName: "dshm") pod "2336069d-f5b1-418a-9b71-a99193c5cd3f" (UID: "2336069d-f5b1-418a-9b71-a99193c5cd3f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:42:03.493365 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.493309    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76zgz\" (UniqueName: \"kubernetes.io/projected/2336069d-f5b1-418a-9b71-a99193c5cd3f-kube-api-access-76zgz\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:03.493365 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.493369    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2336069d-f5b1-418a-9b71-a99193c5cd3f-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:03.493365 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.493380    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2336069d-f5b1-418a-9b71-a99193c5cd3f-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:42:03.766619 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.766580    2576 generic.go:356] "Generic (PLEG): container finished" podID="2336069d-f5b1-418a-9b71-a99193c5cd3f" containerID="6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7" exitCode=0
Jul 22 03:42:03.766619 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.766622    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7" event={"ID":"2336069d-f5b1-418a-9b71-a99193c5cd3f","Type":"ContainerDied","Data":"6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7"}
Jul 22 03:42:03.766883 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.766652    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7" event={"ID":"2336069d-f5b1-418a-9b71-a99193c5cd3f","Type":"ContainerDied","Data":"51e5637c600df9c3cfaa2ee9abb7f2c4d469090c57eef50dcf0b003bd73bbab9"}
Jul 22 03:42:03.766883 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.766651    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"
Jul 22 03:42:03.766883 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.766724    2576 scope.go:117] "RemoveContainer" containerID="6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7"
Jul 22 03:42:03.775302 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.775279    2576 scope.go:117] "RemoveContainer" containerID="6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7"
Jul 22 03:42:03.775625 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:42:03.775596    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7\": container with ID starting with 6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7 not found: ID does not exist" containerID="6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7"
Jul 22 03:42:03.775733 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.775636    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7"} err="failed to get container status \"6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7\": rpc error: code = NotFound desc = could not find container \"6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7\": container with ID starting with 6eabd6d17f4c2fc180fb85ca097afde4a15a266a8fea18a78d0f01366ef714d7 not found: ID does not exist"
Jul 22 03:42:03.797179 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.797140    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"]
Jul 22 03:42:03.805254 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:03.805222    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/sub-test-model-49462a-kserve-546b4496d7-2l2c7"]
Jul 22 03:42:04.183451 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:04.183390    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2336069d-f5b1-418a-9b71-a99193c5cd3f" path="/var/lib/kubelet/pods/2336069d-f5b1-418a-9b71-a99193c5cd3f/volumes"
Jul 22 03:42:04.183828 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:04.183814    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f5519ba-2cf2-4886-afcb-53f84b1569a7" path="/var/lib/kubelet/pods/7f5519ba-2cf2-4886-afcb-53f84b1569a7/volumes"
Jul 22 03:42:09.412451 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:09.412385    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:42:09.412881 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:09.412470    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:42:09.424981 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:09.424954    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:42:09.809116 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:09.809028    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:42:26.306573 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.306535    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"]
Jul 22 03:42:26.307341 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.306848    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2336069d-f5b1-418a-9b71-a99193c5cd3f" containerName="main"
Jul 22 03:42:26.307341 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.306859    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2336069d-f5b1-418a-9b71-a99193c5cd3f" containerName="main"
Jul 22 03:42:26.307341 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.306867    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5519ba-2cf2-4886-afcb-53f84b1569a7" containerName="main"
Jul 22 03:42:26.307341 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.306872    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5519ba-2cf2-4886-afcb-53f84b1569a7" containerName="main"
Jul 22 03:42:26.307341 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.306931    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2336069d-f5b1-418a-9b71-a99193c5cd3f" containerName="main"
Jul 22 03:42:26.307341 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.306940    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f5519ba-2cf2-4886-afcb-53f84b1569a7" containerName="main"
Jul 22 03:42:26.309702 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.309686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.312948 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.312927    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"kube-root-ca.crt\""
Jul 22 03:42:26.313139 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.313099    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"rate-test-model-49462a-kserve-self-signed-certs\""
Jul 22 03:42:26.313139 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.313124    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"openshift-service-ca.crt\""
Jul 22 03:42:26.313304 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.313130    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-49462a\"/\"default-dockercfg-7jvt6\""
Jul 22 03:42:26.320477 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.320445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"]
Jul 22 03:42:26.402387 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.402354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tls-certs\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.402588 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.402393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-home\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.402588 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.402477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v4m7\" (UniqueName: \"kubernetes.io/projected/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-kube-api-access-8v4m7\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.402588 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.402512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-model-cache\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.402588 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.402545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-dshm\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.402588 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.402566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tmp-dir\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.505271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.504074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-model-cache\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.505271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.504130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-dshm\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.505271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.504163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tmp-dir\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.505271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.504254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tls-certs\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.505271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.504282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-home\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.505271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.504344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v4m7\" (UniqueName: \"kubernetes.io/projected/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-kube-api-access-8v4m7\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.505271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.504682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-model-cache\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.505271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.504975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tmp-dir\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.505271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.505227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-home\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.508505 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.508480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-dshm\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.510032 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.509928    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tls-certs\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.514638 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.514581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v4m7\" (UniqueName: \"kubernetes.io/projected/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-kube-api-access-8v4m7\") pod \"rate-test-model-49462a-kserve-d48b4fcf9-ptghc\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") " pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.622084 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.621995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:26.756094 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.756063    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"]
Jul 22 03:42:26.757698 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:42:26.757672    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29b0f6d1_fa89_42af_a21c_e3ededbd2f85.slice/crio-8f09eb265744d5659330e1b5bd469a4da33b8c586f6823b927323fb2bd8df333 WatchSource:0}: Error finding container 8f09eb265744d5659330e1b5bd469a4da33b8c586f6823b927323fb2bd8df333: Status 404 returned error can't find the container with id 8f09eb265744d5659330e1b5bd469a4da33b8c586f6823b927323fb2bd8df333
Jul 22 03:42:26.872203 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.872110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc" event={"ID":"29b0f6d1-fa89-42af-a21c-e3ededbd2f85","Type":"ContainerStarted","Data":"ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246"}
Jul 22 03:42:26.872203 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.872164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc" event={"ID":"29b0f6d1-fa89-42af-a21c-e3ededbd2f85","Type":"ContainerStarted","Data":"8f09eb265744d5659330e1b5bd469a4da33b8c586f6823b927323fb2bd8df333"}
Jul 22 03:42:26.892125 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:26.892074    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc" podStartSLOduration=0.892059277 podStartE2EDuration="892.059277ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:42:26.889562529 +0000 UTC m=+2660.775690670" watchObservedRunningTime="2026-07-22 03:42:26.892059277 +0000 UTC m=+2660.778187416"
Jul 22 03:42:36.622412 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:36.622370    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:36.622943 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:36.622449    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:36.635094 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:36.635068    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:42:36.929790 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:42:36.929757    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:43:10.913863 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:10.913775    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"]
Jul 22 03:43:11.806462 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:11.806421    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"]
Jul 22 03:43:25.934094 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:25.934049    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx" podUID="770bcbae-b401-4d94-9d19-54527a69fca8" containerName="main" containerID="cri-o://82a2782eb33cc2f4aa4a1c8f0154c8fbdac879590f540197832562550d535f13" gracePeriod=45
Jul 22 03:43:26.137512 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.137438    2576 generic.go:356] "Generic (PLEG): container finished" podID="770bcbae-b401-4d94-9d19-54527a69fca8" containerID="82a2782eb33cc2f4aa4a1c8f0154c8fbdac879590f540197832562550d535f13" exitCode=0
Jul 22 03:43:26.137687 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.137515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx" event={"ID":"770bcbae-b401-4d94-9d19-54527a69fca8","Type":"ContainerDied","Data":"82a2782eb33cc2f4aa4a1c8f0154c8fbdac879590f540197832562550d535f13"}
Jul 22 03:43:26.190798 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.190737    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:43:26.241607 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.241578    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/770bcbae-b401-4d94-9d19-54527a69fca8-tls-certs\") pod \"770bcbae-b401-4d94-9d19-54527a69fca8\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") "
Jul 22 03:43:26.241816 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.241649    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-model-cache\") pod \"770bcbae-b401-4d94-9d19-54527a69fca8\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") "
Jul 22 03:43:26.241816 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.241699    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwphr\" (UniqueName: \"kubernetes.io/projected/770bcbae-b401-4d94-9d19-54527a69fca8-kube-api-access-pwphr\") pod \"770bcbae-b401-4d94-9d19-54527a69fca8\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") "
Jul 22 03:43:26.241816 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.241728    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-dshm\") pod \"770bcbae-b401-4d94-9d19-54527a69fca8\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") "
Jul 22 03:43:26.241816 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.241746    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-tmp-dir\") pod \"770bcbae-b401-4d94-9d19-54527a69fca8\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") "
Jul 22 03:43:26.241816 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.241760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-home\") pod \"770bcbae-b401-4d94-9d19-54527a69fca8\" (UID: \"770bcbae-b401-4d94-9d19-54527a69fca8\") "
Jul 22 03:43:26.242105 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.241886    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-model-cache" (OuterVolumeSpecName: "model-cache") pod "770bcbae-b401-4d94-9d19-54527a69fca8" (UID: "770bcbae-b401-4d94-9d19-54527a69fca8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:26.242105 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.242031    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "770bcbae-b401-4d94-9d19-54527a69fca8" (UID: "770bcbae-b401-4d94-9d19-54527a69fca8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:26.242204 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.242109    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:26.242204 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.242114    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-home" (OuterVolumeSpecName: "home") pod "770bcbae-b401-4d94-9d19-54527a69fca8" (UID: "770bcbae-b401-4d94-9d19-54527a69fca8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:26.243808 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.243786    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-dshm" (OuterVolumeSpecName: "dshm") pod "770bcbae-b401-4d94-9d19-54527a69fca8" (UID: "770bcbae-b401-4d94-9d19-54527a69fca8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:26.243923 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.243871    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/770bcbae-b401-4d94-9d19-54527a69fca8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "770bcbae-b401-4d94-9d19-54527a69fca8" (UID: "770bcbae-b401-4d94-9d19-54527a69fca8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:43:26.243963 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.243919    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/770bcbae-b401-4d94-9d19-54527a69fca8-kube-api-access-pwphr" (OuterVolumeSpecName: "kube-api-access-pwphr") pod "770bcbae-b401-4d94-9d19-54527a69fca8" (UID: "770bcbae-b401-4d94-9d19-54527a69fca8"). InnerVolumeSpecName "kube-api-access-pwphr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:43:26.343490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.343452    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:26.343490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.343482    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:26.343490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.343491    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/770bcbae-b401-4d94-9d19-54527a69fca8-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:26.343490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.343501    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/770bcbae-b401-4d94-9d19-54527a69fca8-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:26.343764 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.343510    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwphr\" (UniqueName: \"kubernetes.io/projected/770bcbae-b401-4d94-9d19-54527a69fca8-kube-api-access-pwphr\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:26.826514 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.826445    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc" podUID="29b0f6d1-fa89-42af-a21c-e3ededbd2f85" containerName="main" containerID="cri-o://ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246" gracePeriod=45
Jul 22 03:43:26.919282 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:26.919232    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc" podUID="29b0f6d1-fa89-42af-a21c-e3ededbd2f85" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": dial tcp 10.133.0.54:8000: connect: connection refused"
Jul 22 03:43:27.079003 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.078941    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:43:27.143590 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.143555    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"
Jul 22 03:43:27.143590 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.143568    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx" event={"ID":"770bcbae-b401-4d94-9d19-54527a69fca8","Type":"ContainerDied","Data":"f85ba4736a05f9ffd5b8bd6fb8782f4bce68c28321eaaffac25b04251881ea1a"}
Jul 22 03:43:27.143844 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.143622    2576 scope.go:117] "RemoveContainer" containerID="82a2782eb33cc2f4aa4a1c8f0154c8fbdac879590f540197832562550d535f13"
Jul 22 03:43:27.144919 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.144896    2576 generic.go:356] "Generic (PLEG): container finished" podID="29b0f6d1-fa89-42af-a21c-e3ededbd2f85" containerID="ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246" exitCode=0
Jul 22 03:43:27.145022 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.144939    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"
Jul 22 03:43:27.145022 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.144945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc" event={"ID":"29b0f6d1-fa89-42af-a21c-e3ededbd2f85","Type":"ContainerDied","Data":"ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246"}
Jul 22 03:43:27.145022 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.144975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc" event={"ID":"29b0f6d1-fa89-42af-a21c-e3ededbd2f85","Type":"ContainerDied","Data":"8f09eb265744d5659330e1b5bd469a4da33b8c586f6823b927323fb2bd8df333"}
Jul 22 03:43:27.150440 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.150414    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tls-certs\") pod \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") "
Jul 22 03:43:27.150571 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.150487    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-dshm\") pod \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") "
Jul 22 03:43:27.150638 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.150592    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-home\") pod \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") "
Jul 22 03:43:27.150638 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.150621    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tmp-dir\") pod \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") "
Jul 22 03:43:27.151182 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.150646    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-model-cache\") pod \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") "
Jul 22 03:43:27.151182 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.150686    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v4m7\" (UniqueName: \"kubernetes.io/projected/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-kube-api-access-8v4m7\") pod \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\" (UID: \"29b0f6d1-fa89-42af-a21c-e3ededbd2f85\") "
Jul 22 03:43:27.151182 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.150894    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-home" (OuterVolumeSpecName: "home") pod "29b0f6d1-fa89-42af-a21c-e3ededbd2f85" (UID: "29b0f6d1-fa89-42af-a21c-e3ededbd2f85"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:27.151182 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.151007    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-model-cache" (OuterVolumeSpecName: "model-cache") pod "29b0f6d1-fa89-42af-a21c-e3ededbd2f85" (UID: "29b0f6d1-fa89-42af-a21c-e3ededbd2f85"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:27.151182 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.151129    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "29b0f6d1-fa89-42af-a21c-e3ededbd2f85" (UID: "29b0f6d1-fa89-42af-a21c-e3ededbd2f85"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:27.151532 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.151316    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-home\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:27.151532 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.151335    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tmp-dir\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:27.151532 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.151351    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-model-cache\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:27.152855 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.152831    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "29b0f6d1-fa89-42af-a21c-e3ededbd2f85" (UID: "29b0f6d1-fa89-42af-a21c-e3ededbd2f85"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:43:27.152943 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.152912    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-dshm" (OuterVolumeSpecName: "dshm") pod "29b0f6d1-fa89-42af-a21c-e3ededbd2f85" (UID: "29b0f6d1-fa89-42af-a21c-e3ededbd2f85"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:27.153134 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.153115    2576 scope.go:117] "RemoveContainer" containerID="ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246"
Jul 22 03:43:27.153439 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.153416    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-kube-api-access-8v4m7" (OuterVolumeSpecName: "kube-api-access-8v4m7") pod "29b0f6d1-fa89-42af-a21c-e3ededbd2f85" (UID: "29b0f6d1-fa89-42af-a21c-e3ededbd2f85"). InnerVolumeSpecName "kube-api-access-8v4m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:43:27.172523 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.172498    2576 scope.go:117] "RemoveContainer" containerID="ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246"
Jul 22 03:43:27.173134 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:43:27.173101    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246\": container with ID starting with ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246 not found: ID does not exist" containerID="ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246"
Jul 22 03:43:27.173234 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.173140    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246"} err="failed to get container status \"ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246\": rpc error: code = NotFound desc = could not find container \"ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246\": container with ID starting with ce6fa7b8125854f0b3344a0dfd75388dcb9288414bd7c9b9090421c604073246 not found: ID does not exist"
Jul 22 03:43:27.174700 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.174680    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"]
Jul 22 03:43:27.178422 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.178385    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c19e4b/rate-test-model-c19e4b-kserve-6d8677b687-l2gwx"]
Jul 22 03:43:27.252466 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.252425    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-dshm\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:27.252466 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.252460    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v4m7\" (UniqueName: \"kubernetes.io/projected/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-kube-api-access-8v4m7\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:27.252670 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.252476    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29b0f6d1-fa89-42af-a21c-e3ededbd2f85-tls-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:27.467274 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.467241    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"]
Jul 22 03:43:27.471234 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:27.471209    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-49462a/rate-test-model-49462a-kserve-d48b4fcf9-ptghc"]
Jul 22 03:43:28.183231 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:28.183195    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29b0f6d1-fa89-42af-a21c-e3ededbd2f85" path="/var/lib/kubelet/pods/29b0f6d1-fa89-42af-a21c-e3ededbd2f85/volumes"
Jul 22 03:43:28.183653 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:28.183614    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="770bcbae-b401-4d94-9d19-54527a69fca8" path="/var/lib/kubelet/pods/770bcbae-b401-4d94-9d19-54527a69fca8/volumes"
Jul 22 03:43:53.307387 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:53.307347    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"]
Jul 22 03:43:53.307943 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:53.307572    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy" containerID="cri-o://a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b" gracePeriod=30
Jul 22 03:43:58.555521 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.555493    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:43:58.725678 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.725643    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istiod-ca-cert\") pod \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") "
Jul 22 03:43:58.725869 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.725705    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-envoy\") pod \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") "
Jul 22 03:43:58.725869 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.725730    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-token\") pod \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") "
Jul 22 03:43:58.725869 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.725755    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-podinfo\") pod \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") "
Jul 22 03:43:58.725869 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.725814    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-socket\") pod \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") "
Jul 22 03:43:58.725869 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.725850    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-credential-socket\") pod \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") "
Jul 22 03:43:58.726151 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.725881    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-certs\") pod \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") "
Jul 22 03:43:58.726151 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.725928    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg5v8\" (UniqueName: \"kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-kube-api-access-sg5v8\") pod \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") "
Jul 22 03:43:58.726151 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.725996    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-data\") pod \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\" (UID: \"6c1d5b0d-908c-431f-bf07-e855e9b4da8c\") "
Jul 22 03:43:58.726151 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.726112    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c1d5b0d-908c-431f-bf07-e855e9b4da8c" (UID: "6c1d5b0d-908c-431f-bf07-e855e9b4da8c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:43:58.726361 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.726163    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c1d5b0d-908c-431f-bf07-e855e9b4da8c" (UID: "6c1d5b0d-908c-431f-bf07-e855e9b4da8c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:58.726361 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.726317    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c1d5b0d-908c-431f-bf07-e855e9b4da8c" (UID: "6c1d5b0d-908c-431f-bf07-e855e9b4da8c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:58.726507 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.726361    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:58.726507 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.726380    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:58.726507 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.726377    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c1d5b0d-908c-431f-bf07-e855e9b4da8c" (UID: "6c1d5b0d-908c-431f-bf07-e855e9b4da8c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:58.727054 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.727026    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c1d5b0d-908c-431f-bf07-e855e9b4da8c" (UID: "6c1d5b0d-908c-431f-bf07-e855e9b4da8c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:58.728157 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.728129    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c1d5b0d-908c-431f-bf07-e855e9b4da8c" (UID: "6c1d5b0d-908c-431f-bf07-e855e9b4da8c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:43:58.728157 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.728143    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c1d5b0d-908c-431f-bf07-e855e9b4da8c" (UID: "6c1d5b0d-908c-431f-bf07-e855e9b4da8c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:43:58.728287 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.728206    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c1d5b0d-908c-431f-bf07-e855e9b4da8c" (UID: "6c1d5b0d-908c-431f-bf07-e855e9b4da8c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:43:58.728287 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.728229    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-kube-api-access-sg5v8" (OuterVolumeSpecName: "kube-api-access-sg5v8") pod "6c1d5b0d-908c-431f-bf07-e855e9b4da8c" (UID: "6c1d5b0d-908c-431f-bf07-e855e9b4da8c"). InnerVolumeSpecName "kube-api-access-sg5v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:43:58.826880 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.826846    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:58.827034 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.826881    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg5v8\" (UniqueName: \"kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-kube-api-access-sg5v8\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:58.827034 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.826902    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:58.827034 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.826913    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:58.827034 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.826921    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:58.827034 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.826928    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:58.827034 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:58.826936    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c1d5b0d-908c-431f-bf07-e855e9b4da8c-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:43:59.288088 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.288051    2576 generic.go:356] "Generic (PLEG): container finished" podID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerID="a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b" exitCode=0
Jul 22 03:43:59.288271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.288096    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"
Jul 22 03:43:59.288271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.288132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" event={"ID":"6c1d5b0d-908c-431f-bf07-e855e9b4da8c","Type":"ContainerDied","Data":"a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b"}
Jul 22 03:43:59.288271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.288188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw" event={"ID":"6c1d5b0d-908c-431f-bf07-e855e9b4da8c","Type":"ContainerDied","Data":"d8b1722bdce00dbe0d26a10ba97dc3026058c39d7d17b167c26e6ad0cf602d48"}
Jul 22 03:43:59.288271 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.288211    2576 scope.go:117] "RemoveContainer" containerID="a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b"
Jul 22 03:43:59.298359 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.298334    2576 scope.go:117] "RemoveContainer" containerID="65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b"
Jul 22 03:43:59.306710 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.306686    2576 scope.go:117] "RemoveContainer" containerID="a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b"
Jul 22 03:43:59.306963 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:43:59.306941    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b\": container with ID starting with a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b not found: ID does not exist" containerID="a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b"
Jul 22 03:43:59.307041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.306975    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b"} err="failed to get container status \"a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b\": rpc error: code = NotFound desc = could not find container \"a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b\": container with ID starting with a55b488f4476421cbbe6ca77c23d713bd2f06c70dec70c21bfd3471f414bb58b not found: ID does not exist"
Jul 22 03:43:59.307041 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.307000    2576 scope.go:117] "RemoveContainer" containerID="65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b"
Jul 22 03:43:59.307212 ip-10-0-139-214 kubenswrapper[2576]: E0722 03:43:59.307196    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b\": container with ID starting with 65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b not found: ID does not exist" containerID="65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b"
Jul 22 03:43:59.307259 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.307223    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b"} err="failed to get container status \"65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b\": rpc error: code = NotFound desc = could not find container \"65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b\": container with ID starting with 65f7af5a405a5edabc827e6974201d385618f2edbed157d496067660d2f8814b not found: ID does not exist"
Jul 22 03:43:59.312487 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.312462    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"]
Jul 22 03:43:59.315669 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:43:59.315648    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c19e4b-openshift-default-85d54ff4d7-lt7xw"]
Jul 22 03:44:00.183415 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:00.183363    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" path="/var/lib/kubelet/pods/6c1d5b0d-908c-431f-bf07-e855e9b4da8c/volumes"
Jul 22 03:44:08.451392 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:08.451354    2576 scope.go:117] "RemoveContainer" containerID="4b3530ce9e6d6ce77c081a9215d897f46e22edd03e33c8cc7eadf9127c702413"
Jul 22 03:44:16.201256 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:16.201220    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"]
Jul 22 03:44:16.201760 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:16.201434    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy" containerID="cri-o://b64501ee21fee84062615db6fe376b20f3c9453831e79311f0960e5c2af183c8" gracePeriod=30
Jul 22 03:44:16.925834 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:16.925802    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85fbf4d885-dxt5l_de7b5d21-5301-4960-9540-8e811df85e02/authorino/0.log"
Jul 22 03:44:21.389248 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.389206    2576 generic.go:356] "Generic (PLEG): container finished" podID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerID="b64501ee21fee84062615db6fe376b20f3c9453831e79311f0960e5c2af183c8" exitCode=0
Jul 22 03:44:21.389632 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.389312    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" event={"ID":"867d91d6-4d3a-44a3-b85c-191c93d63f42","Type":"ContainerDied","Data":"b64501ee21fee84062615db6fe376b20f3c9453831e79311f0960e5c2af183c8"}
Jul 22 03:44:21.389632 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.389372    2576 scope.go:117] "RemoveContainer" containerID="c3efc951687b3883b2a99e53b5d23ff5c608363e2af79c340b31b8d502fcdbbd"
Jul 22 03:44:21.453254 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.453230    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:44:21.518374 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518287    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-credential-socket\") pod \"867d91d6-4d3a-44a3-b85c-191c93d63f42\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") "
Jul 22 03:44:21.518374 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518345    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-envoy\") pod \"867d91d6-4d3a-44a3-b85c-191c93d63f42\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") "
Jul 22 03:44:21.518374 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518373    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/867d91d6-4d3a-44a3-b85c-191c93d63f42-istiod-ca-cert\") pod \"867d91d6-4d3a-44a3-b85c-191c93d63f42\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") "
Jul 22 03:44:21.518638 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-socket\") pod \"867d91d6-4d3a-44a3-b85c-191c93d63f42\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") "
Jul 22 03:44:21.518638 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518469    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-certs\") pod \"867d91d6-4d3a-44a3-b85c-191c93d63f42\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") "
Jul 22 03:44:21.518638 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518509    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxdkr\" (UniqueName: \"kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-kube-api-access-cxdkr\") pod \"867d91d6-4d3a-44a3-b85c-191c93d63f42\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") "
Jul 22 03:44:21.518638 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518547    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-podinfo\") pod \"867d91d6-4d3a-44a3-b85c-191c93d63f42\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") "
Jul 22 03:44:21.518846 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518626    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "867d91d6-4d3a-44a3-b85c-191c93d63f42" (UID: "867d91d6-4d3a-44a3-b85c-191c93d63f42"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:44:21.518846 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518700    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-token\") pod \"867d91d6-4d3a-44a3-b85c-191c93d63f42\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") "
Jul 22 03:44:21.518846 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518748    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-data\") pod \"867d91d6-4d3a-44a3-b85c-191c93d63f42\" (UID: \"867d91d6-4d3a-44a3-b85c-191c93d63f42\") "
Jul 22 03:44:21.518992 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518842    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "867d91d6-4d3a-44a3-b85c-191c93d63f42" (UID: "867d91d6-4d3a-44a3-b85c-191c93d63f42"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:44:21.518992 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.518854    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/867d91d6-4d3a-44a3-b85c-191c93d63f42-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "867d91d6-4d3a-44a3-b85c-191c93d63f42" (UID: "867d91d6-4d3a-44a3-b85c-191c93d63f42"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:44:21.519090 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.519074    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:44:21.519144 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.519095    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-credential-socket\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:44:21.519144 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.519110    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/867d91d6-4d3a-44a3-b85c-191c93d63f42-istiod-ca-cert\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:44:21.519336 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.519310    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "867d91d6-4d3a-44a3-b85c-191c93d63f42" (UID: "867d91d6-4d3a-44a3-b85c-191c93d63f42"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:44:21.519733 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.519709    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-data" (OuterVolumeSpecName: "istio-data") pod "867d91d6-4d3a-44a3-b85c-191c93d63f42" (UID: "867d91d6-4d3a-44a3-b85c-191c93d63f42"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:44:21.520869 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.520839    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-kube-api-access-cxdkr" (OuterVolumeSpecName: "kube-api-access-cxdkr") pod "867d91d6-4d3a-44a3-b85c-191c93d63f42" (UID: "867d91d6-4d3a-44a3-b85c-191c93d63f42"). InnerVolumeSpecName "kube-api-access-cxdkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:44:21.520982 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.520847    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-token" (OuterVolumeSpecName: "istio-token") pod "867d91d6-4d3a-44a3-b85c-191c93d63f42" (UID: "867d91d6-4d3a-44a3-b85c-191c93d63f42"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:44:21.521068 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.521050    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "867d91d6-4d3a-44a3-b85c-191c93d63f42" (UID: "867d91d6-4d3a-44a3-b85c-191c93d63f42"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 03:44:21.521111 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.521063    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "867d91d6-4d3a-44a3-b85c-191c93d63f42" (UID: "867d91d6-4d3a-44a3-b85c-191c93d63f42"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:44:21.619882 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.619842    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-podinfo\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:44:21.619882 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.619876    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-token\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:44:21.619882 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.619885    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-data\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:44:21.619882 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.619893    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-istio-envoy\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:44:21.620153 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.619901    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/867d91d6-4d3a-44a3-b85c-191c93d63f42-workload-certs\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:44:21.620153 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:21.619909    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxdkr\" (UniqueName: \"kubernetes.io/projected/867d91d6-4d3a-44a3-b85c-191c93d63f42-kube-api-access-cxdkr\") on node \"ip-10-0-139-214.ec2.internal\" DevicePath \"\""
Jul 22 03:44:22.394546 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:22.394517    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"
Jul 22 03:44:22.394973 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:22.394505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6" event={"ID":"867d91d6-4d3a-44a3-b85c-191c93d63f42","Type":"ContainerDied","Data":"61018513da9b1fdbf5f9ef19f18eb431be1fffc7bba5ca4c5207e2a3bb844338"}
Jul 22 03:44:22.394973 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:22.394654    2576 scope.go:117] "RemoveContainer" containerID="b64501ee21fee84062615db6fe376b20f3c9453831e79311f0960e5c2af183c8"
Jul 22 03:44:22.413650 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:22.413625    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"]
Jul 22 03:44:22.417132 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:22.417110    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-49462a-openshift-default-6644dbb9f-h98l6"]
Jul 22 03:44:23.593878 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:23.593848    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94fc48448-h7qw9_7a51a9ae-66a7-42e4-a786-6053b12476e4/copy-manifests/0.log"
Jul 22 03:44:23.606761 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:23.606728    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94fc48448-h7qw9_7a51a9ae-66a7-42e4-a786-6053b12476e4/manager/0.log"
Jul 22 03:44:24.111456 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:24.111425    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744835-fn47p_1e8b6432-5d12-4021-8401-ac30e0b568cc/cleanup/0.log"
Jul 22 03:44:24.183759 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:24.183725    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" path="/var/lib/kubelet/pods/867d91d6-4d3a-44a3-b85c-191c93d63f42/volumes"
Jul 22 03:44:25.749936 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:25.749898    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85fbf4d885-dxt5l_de7b5d21-5301-4960-9540-8e811df85e02/authorino/0.log"
Jul 22 03:44:27.052572 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:27.052540    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dvd6c_159ba033-8ef8-410c-a86a-9e001944d4fe/istio-proxy/0.log"
Jul 22 03:44:27.415265 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:27.415233    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-684578bfd-h7qhm_6725026a-7ba0-47f5-971a-ec5283e697f8/kube-auth-proxy/0.log"
Jul 22 03:44:27.904791 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:27.904763    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68489bc688-4q4jw_23505e5c-1564-4aca-8eed-0058bab33390/router/0.log"
Jul 22 03:44:28.286787 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:28.286679    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-fl58m_d0ef08df-96a7-4454-b9da-b5c08c185412/main/0.log"
Jul 22 03:44:28.532776 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:28.532742    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pvgz6_f7d2b9c3-9514-48bc-bde6-5bd746029c16/main/0.log"
Jul 22 03:44:34.988830 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.988794    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kwn6d/must-gather-ltjtt"]
Jul 22 03:44:34.989230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989098    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b0f6d1-fa89-42af-a21c-e3ededbd2f85" containerName="main"
Jul 22 03:44:34.989230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989112    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b0f6d1-fa89-42af-a21c-e3ededbd2f85" containerName="main"
Jul 22 03:44:34.989230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989121    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy"
Jul 22 03:44:34.989230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989127    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy"
Jul 22 03:44:34.989230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989137    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy"
Jul 22 03:44:34.989230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989143    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy"
Jul 22 03:44:34.989230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989162    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy"
Jul 22 03:44:34.989230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989168    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy"
Jul 22 03:44:34.989230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989173    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="770bcbae-b401-4d94-9d19-54527a69fca8" containerName="main"
Jul 22 03:44:34.989230 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989178    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="770bcbae-b401-4d94-9d19-54527a69fca8" containerName="main"
Jul 22 03:44:34.989627 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989238    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy"
Jul 22 03:44:34.989627 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989247    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="867d91d6-4d3a-44a3-b85c-191c93d63f42" containerName="istio-proxy"
Jul 22 03:44:34.989627 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989252    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="29b0f6d1-fa89-42af-a21c-e3ededbd2f85" containerName="main"
Jul 22 03:44:34.989627 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989258    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy"
Jul 22 03:44:34.989627 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989264    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy"
Jul 22 03:44:34.989627 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989269    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="770bcbae-b401-4d94-9d19-54527a69fca8" containerName="main"
Jul 22 03:44:34.989627 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989312    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy"
Jul 22 03:44:34.989627 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.989318    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1d5b0d-908c-431f-bf07-e855e9b4da8c" containerName="istio-proxy"
Jul 22 03:44:34.993789 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.993767    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwn6d/must-gather-ltjtt"
Jul 22 03:44:34.996078 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.996056    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kwn6d\"/\"openshift-service-ca.crt\""
Jul 22 03:44:34.996207 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:34.996160    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kwn6d\"/\"kube-root-ca.crt\""
Jul 22 03:44:35.000647 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.000423    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwn6d/must-gather-ltjtt"]
Jul 22 03:44:35.141156 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.141122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47864e21-ae55-464e-afd9-bfbbe538b1b6-must-gather-output\") pod \"must-gather-ltjtt\" (UID: \"47864e21-ae55-464e-afd9-bfbbe538b1b6\") " pod="openshift-must-gather-kwn6d/must-gather-ltjtt"
Jul 22 03:44:35.141345 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.141248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqhtv\" (UniqueName: \"kubernetes.io/projected/47864e21-ae55-464e-afd9-bfbbe538b1b6-kube-api-access-cqhtv\") pod \"must-gather-ltjtt\" (UID: \"47864e21-ae55-464e-afd9-bfbbe538b1b6\") " pod="openshift-must-gather-kwn6d/must-gather-ltjtt"
Jul 22 03:44:35.242584 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.242479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47864e21-ae55-464e-afd9-bfbbe538b1b6-must-gather-output\") pod \"must-gather-ltjtt\" (UID: \"47864e21-ae55-464e-afd9-bfbbe538b1b6\") " pod="openshift-must-gather-kwn6d/must-gather-ltjtt"
Jul 22 03:44:35.242769 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.242668    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhtv\" (UniqueName: \"kubernetes.io/projected/47864e21-ae55-464e-afd9-bfbbe538b1b6-kube-api-access-cqhtv\") pod \"must-gather-ltjtt\" (UID: \"47864e21-ae55-464e-afd9-bfbbe538b1b6\") " pod="openshift-must-gather-kwn6d/must-gather-ltjtt"
Jul 22 03:44:35.242888 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.242864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47864e21-ae55-464e-afd9-bfbbe538b1b6-must-gather-output\") pod \"must-gather-ltjtt\" (UID: \"47864e21-ae55-464e-afd9-bfbbe538b1b6\") " pod="openshift-must-gather-kwn6d/must-gather-ltjtt"
Jul 22 03:44:35.252809 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.252777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqhtv\" (UniqueName: \"kubernetes.io/projected/47864e21-ae55-464e-afd9-bfbbe538b1b6-kube-api-access-cqhtv\") pod \"must-gather-ltjtt\" (UID: \"47864e21-ae55-464e-afd9-bfbbe538b1b6\") " pod="openshift-must-gather-kwn6d/must-gather-ltjtt"
Jul 22 03:44:35.303460 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.303424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwn6d/must-gather-ltjtt"
Jul 22 03:44:35.441975 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.441949    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwn6d/must-gather-ltjtt"]
Jul 22 03:44:35.444042 ip-10-0-139-214 kubenswrapper[2576]: W0722 03:44:35.444010    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47864e21_ae55_464e_afd9_bfbbe538b1b6.slice/crio-3a5c823965fad5b8571e008842962f6e891bb9743e0193b14fed5f18763c3c9c WatchSource:0}: Error finding container 3a5c823965fad5b8571e008842962f6e891bb9743e0193b14fed5f18763c3c9c: Status 404 returned error can't find the container with id 3a5c823965fad5b8571e008842962f6e891bb9743e0193b14fed5f18763c3c9c
Jul 22 03:44:35.445974 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.445955    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:44:35.449791 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:35.449752    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwn6d/must-gather-ltjtt" event={"ID":"47864e21-ae55-464e-afd9-bfbbe538b1b6","Type":"ContainerStarted","Data":"3a5c823965fad5b8571e008842962f6e891bb9743e0193b14fed5f18763c3c9c"}
Jul 22 03:44:36.457944 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:36.457902    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwn6d/must-gather-ltjtt" event={"ID":"47864e21-ae55-464e-afd9-bfbbe538b1b6","Type":"ContainerStarted","Data":"c57d18d6f3127f82bd823b3f5e14084099c134e01e8cac15921b07b5c59ed8d7"}
Jul 22 03:44:36.458458 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:36.457957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwn6d/must-gather-ltjtt" event={"ID":"47864e21-ae55-464e-afd9-bfbbe538b1b6","Type":"ContainerStarted","Data":"a9c4fed271c8064d1be6c31dfae11f02bf7c491ebefcfdcc2977dc9ac9398ceb"}
Jul 22 03:44:36.478628 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:36.478567    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kwn6d/must-gather-ltjtt" podStartSLOduration=1.6921160450000001 podStartE2EDuration="2.47854463s" totalImagesPullingTime="786.428585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:44:36.475954779 +0000 UTC m=+2790.362082916" watchObservedRunningTime="2026-07-22 03:44:36.47854463 +0000 UTC m=+2790.364672773"
Jul 22 03:44:37.960205 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:37.960160    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-znwcl_3f3ebc44-1e39-458b-90fc-94951e07f565/global-pull-secret-syncer/0.log"
Jul 22 03:44:38.135517 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:38.135480    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sgp8g_da7fd337-2011-4001-9fa1-79a3c813aafd/konnectivity-agent/0.log"
Jul 22 03:44:38.219565 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:38.219488    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-214.ec2.internal_a0dcf5c9a6ed001643e8598db403124c/haproxy/0.log"
Jul 22 03:44:43.322420 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:43.321888    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85fbf4d885-dxt5l_de7b5d21-5301-4960-9540-8e811df85e02/authorino/0.log"
Jul 22 03:44:45.784971 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:45.784937    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c6c9c9bd8-z5r2l_4e4a0b55-f05d-4b91-9cc8-4a83d5dc4354/metrics-server/0.log"
Jul 22 03:44:46.013350 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:46.013313    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wh5gs_0bb0b2ab-3ccd-4b49-8b56-49737e117cdf/node-exporter/0.log"
Jul 22 03:44:46.042345 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:46.042248    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wh5gs_0bb0b2ab-3ccd-4b49-8b56-49737e117cdf/kube-rbac-proxy/0.log"
Jul 22 03:44:46.068935 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:46.068906    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wh5gs_0bb0b2ab-3ccd-4b49-8b56-49737e117cdf/init-textfile/0.log"
Jul 22 03:44:47.829611 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:47.829552    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-r4vp5_7893395e-09be-40cb-bfe8-d4053aa11b2f/networking-console-plugin/0.log"
Jul 22 03:44:48.139476 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.138437    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"]
Jul 22 03:44:48.144759 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.144311    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.147916 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.147886    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kwn6d\"/\"default-dockercfg-qqsd7\""
Jul 22 03:44:48.153601 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.153571    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"]
Jul 22 03:44:48.283348 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.283305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-sys\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.283564 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.283429    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-lib-modules\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.283564 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.283530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-proc\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.283564 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.283561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnzdz\" (UniqueName: \"kubernetes.io/projected/8e5e6cbc-85b1-4230-9261-2d347c29043b-kube-api-access-wnzdz\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.283731 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.283591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-podres\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.384597 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.384552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-lib-modules\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.384805 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.384628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-proc\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.384805 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.384653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnzdz\" (UniqueName: \"kubernetes.io/projected/8e5e6cbc-85b1-4230-9261-2d347c29043b-kube-api-access-wnzdz\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.384805 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.384675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-podres\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.384805 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.384723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-sys\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.384805 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.384761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-lib-modules\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.385090 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.384761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-proc\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.385090 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.384821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-podres\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.385090 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.384826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e5e6cbc-85b1-4230-9261-2d347c29043b-sys\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.398804 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.398774    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnzdz\" (UniqueName: \"kubernetes.io/projected/8e5e6cbc-85b1-4230-9261-2d347c29043b-kube-api-access-wnzdz\") pod \"perf-node-gather-daemonset-tcbrr\" (UID: \"8e5e6cbc-85b1-4230-9261-2d347c29043b\") " pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.460037 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.459997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:48.667529 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:48.667374    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"]
Jul 22 03:44:49.546369 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:49.546327    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr" event={"ID":"8e5e6cbc-85b1-4230-9261-2d347c29043b","Type":"ContainerStarted","Data":"eb5c306dfc0b52b04fd7332c7b964e8921c0029d505af01121e697aeafd144e7"}
Jul 22 03:44:49.546832 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:49.546390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr" event={"ID":"8e5e6cbc-85b1-4230-9261-2d347c29043b","Type":"ContainerStarted","Data":"a6bba53af36f3364c56662ac5d551379855655171bdc7c41e3718c684a06604c"}
Jul 22 03:44:49.546832 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:49.546497    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:49.563732 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:49.563666    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr" podStartSLOduration=1.5636422429999999 podStartE2EDuration="1.563642243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:44:49.561607915 +0000 UTC m=+2803.447736069" watchObservedRunningTime="2026-07-22 03:44:49.563642243 +0000 UTC m=+2803.449770384"
Jul 22 03:44:50.796442 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:50.796412    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4x7n6_4afe1cd6-32e5-4436-8e05-a9ae78fcd219/dns/0.log"
Jul 22 03:44:50.819762 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:50.819731    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4x7n6_4afe1cd6-32e5-4436-8e05-a9ae78fcd219/kube-rbac-proxy/0.log"
Jul 22 03:44:50.998005 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:50.997974    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lvztc_311a7a15-e954-4ed4-8158-b7fdb0246cf2/dns-node-resolver/0.log"
Jul 22 03:44:51.569076 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:51.569046    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t5hpj_f809ee84-b430-4412-a4e2-164df3f746d5/node-ca/0.log"
Jul 22 03:44:52.583014 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:52.582981    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dvd6c_159ba033-8ef8-410c-a86a-9e001944d4fe/istio-proxy/0.log"
Jul 22 03:44:52.867506 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:52.867417    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-684578bfd-h7qhm_6725026a-7ba0-47f5-971a-ec5283e697f8/kube-auth-proxy/0.log"
Jul 22 03:44:53.013362 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:53.013324    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68489bc688-4q4jw_23505e5c-1564-4aca-8eed-0058bab33390/router/0.log"
Jul 22 03:44:53.739104 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:53.739077    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t25b7_03bc3bf8-3b85-4914-85f2-c6d99f758092/serve-healthcheck-canary/0.log"
Jul 22 03:44:54.241544 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:54.241511    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-vs88k_67cb0d95-a82d-471e-9fa4-8ccef9a610e3/insights-operator/0.log"
Jul 22 03:44:54.242192 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:54.242171    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-vs88k_67cb0d95-a82d-471e-9fa4-8ccef9a610e3/insights-operator/1.log"
Jul 22 03:44:54.264618 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:54.264590    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xxgw_d4eeed88-ed48-4d3e-8053-2de02a23f931/kube-rbac-proxy/0.log"
Jul 22 03:44:54.294099 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:54.294067    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xxgw_d4eeed88-ed48-4d3e-8053-2de02a23f931/exporter/0.log"
Jul 22 03:44:54.319568 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:54.319530    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6xxgw_d4eeed88-ed48-4d3e-8053-2de02a23f931/extractor/0.log"
Jul 22 03:44:55.561490 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:55.561460    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kwn6d/perf-node-gather-daemonset-tcbrr"
Jul 22 03:44:57.406474 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:57.406435    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94fc48448-h7qw9_7a51a9ae-66a7-42e4-a786-6053b12476e4/manager/0.log"
Jul 22 03:44:57.429501 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:57.429457    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94fc48448-h7qw9_7a51a9ae-66a7-42e4-a786-6053b12476e4/copy-manifests/0.log"
Jul 22 03:44:58.617647 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:58.617606    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dvd6c_159ba033-8ef8-410c-a86a-9e001944d4fe/istio-proxy/0.log"
Jul 22 03:44:58.787708 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:58.787670    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58c8df6b5b-7r5bs_4b914323-4bea-473a-960d-d48c6d546db8/manager/0.log"
Jul 22 03:44:58.877482 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:58.877415    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-684578bfd-h7qhm_6725026a-7ba0-47f5-971a-ec5283e697f8/kube-auth-proxy/0.log"
Jul 22 03:44:58.990314 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:44:58.990284    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68489bc688-4q4jw_23505e5c-1564-4aca-8eed-0058bab33390/router/0.log"
Jul 22 03:45:00.268678 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:45:00.268600    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dvd6c_159ba033-8ef8-410c-a86a-9e001944d4fe/istio-proxy/0.log"
Jul 22 03:45:00.517134 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:45:00.517105    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-684578bfd-h7qhm_6725026a-7ba0-47f5-971a-ec5283e697f8/kube-auth-proxy/0.log"
Jul 22 03:45:00.621634 ip-10-0-139-214 kubenswrapper[2576]: I0722 03:45:00.621558    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68489bc688-4q4jw_23505e5c-1564-4aca-8eed-0058bab33390/router/0.log"