Jul 17 18:44:39.891494 ip-10-0-137-97 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 18:44:40.275776 ip-10-0-137-97 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 18:44:40.275776 ip-10-0-137-97 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 18:44:40.275776 ip-10-0-137-97 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 18:44:40.275776 ip-10-0-137-97 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 18:44:40.275776 ip-10-0-137-97 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 18:44:40.276498 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.275829    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281330    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281345    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281349    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281352    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281355    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281358    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281364    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281372    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281375    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281377    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281380    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281382    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281385    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281387    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281391    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281394    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281396    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281399    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281402    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:44:40.284772 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281404    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281406    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281409    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281411    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281414    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281416    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281418    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281421    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281423    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281426    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281428    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281431    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281433    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281436    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281439    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281441    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281444    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281446    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281449    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281452    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:44:40.285318 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281454    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281457    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281459    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281463    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281465    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281467    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281470    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281472    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281475    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281477    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281480    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281483    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281486    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281488    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281491    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281493    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281496    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281498    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281501    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:44:40.285813 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281503    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281505    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281508    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281510    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281512    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281515    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281517    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281520    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281523    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281526    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281530    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281534    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281537    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281540    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281542    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281547    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281550    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281553    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281556    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:44:40.286312 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281558    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281561    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281564    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281567    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281569    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281572    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281575    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281579    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281582    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281585    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281588    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281590    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281593    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281596    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281599    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281601    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281604    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281607    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281609    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281611    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:44:40.286851 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281614    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.281617    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282370    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282377    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282380    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282383    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282385    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282394    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282397    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282399    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282402    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282404    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282407    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282409    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282412    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282414    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282416    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282419    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282421    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282424    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:44:40.287367 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282426    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282429    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282448    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282457    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282461    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282464    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282468    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282470    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282473    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282476    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282478    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282480    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282484    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282487    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282489    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282492    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282494    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282496    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282499    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282501    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:44:40.287852 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282504    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282506    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282509    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282511    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282515    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282519    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282521    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282524    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282526    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282529    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282531    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282533    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282536    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282538    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282541    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282543    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282545    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282548    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282551    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:44:40.288393 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282554    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282556    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282558    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282562    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282566    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282569    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282573    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282576    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282578    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282581    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282583    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282585    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282588    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282590    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282593    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282595    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282597    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282600    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282602    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:44:40.288860 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282605    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282607    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282610    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282613    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282616    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282618    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282620    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282631    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282634    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282638    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282641    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282644    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282647    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282649    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282652    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282654    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282656    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282659    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282662    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282664    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:44:40.289334 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282667    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282669    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.282673    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283067    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283072    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283075    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283078    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283081    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283083    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283087    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283089    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283091    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283094    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283096    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283099    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283101    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283104    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283107    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283109    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:44:40.289820 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283112    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283114    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283116    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283119    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283121    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283124    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283127    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283131    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283133    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283137    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283141    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283143    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283146    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283149    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283151    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283153    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283156    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283158    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283161    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:44:40.290619 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283163    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283165    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283168    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283171    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283173    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283176    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283178    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283180    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283185    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283188    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283190    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283193    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283211    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283214    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283217    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283219    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283221    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283224    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283227    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283229    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:44:40.291430 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283231    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283234    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283239    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283241    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283244    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283247    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283249    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283252    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283255    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283257    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283259    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283263    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283266    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283269    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283272    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283275    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283278    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283280    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283282    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:44:40.292225 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283285    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283289    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283292    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283294    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283297    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283300    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283302    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283304    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283307    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283309    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283312    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283314    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283316    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283319    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283322    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283326    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283329    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283331    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283334    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283336    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:44:40.292696 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283339    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283341    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283343    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283346    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.283348    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283416    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283423    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283428    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283433    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283437    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283440    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283444    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283448    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283453    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283455    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283459    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283462    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283465    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283468    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283470    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283473    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283476    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283479    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 18:44:40.293376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283483    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283486    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283489    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283492    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283497    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283501    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283504    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283507    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283510    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283513    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283516    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283519    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283522    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283525    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283529    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283531    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283534    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283537    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283539    2581 flags.go:64] FLAG: --enable-server="true"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283543    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283547    2581 flags.go:64] FLAG: --event-burst="100"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283550    2581 flags.go:64] FLAG: --event-qps="50"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283554    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283557    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 18:44:40.294390 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283560    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283563    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283566    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283569    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283571    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283574    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283577    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283580    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283582    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283585    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283588    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283590    2581 flags.go:64] FLAG: --feature-gates=""
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283595    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283597    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283600    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283604    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283607    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283609    2581 flags.go:64] FLAG: --help="false"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283612    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283615    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283618    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283621    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283624    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 18:44:40.295399 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283627    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283630    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283632    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283635    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283637    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283641    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283643    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283647    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283650    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283653    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283656    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283658    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283661    2581 flags.go:64] FLAG: --lock-file=""
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283663    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283666    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283669    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283674    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283677    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283679    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283682    2581 flags.go:64] FLAG: --logging-format="text"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283685    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283689    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283692    2581 flags.go:64] FLAG: --manifest-url=""
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283694    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283699    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 18:44:40.296126 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283701    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283705    2581 flags.go:64] FLAG: --max-pods="110"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283708    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283711    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283713    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283716    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283719    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283722    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283725    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283732    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283735    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283738    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283741    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283744    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283749    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283753    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283756    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283758    2581 flags.go:64] FLAG: --port="10250"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283761    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283764    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08b2e5ce237457688"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283767    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283770    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283772    2581 flags.go:64] FLAG: --register-node="true"
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283775    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 17 18:44:40.296756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283778    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283781    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283784    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283786    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283791    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283794    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283797    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283799    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283802    2581 flags.go:64] FLAG: --runonce="false"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283804    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283807    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283810    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283813    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283816    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283818    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283821    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283824    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283827    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283829    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283832    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283834    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283837    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283840    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283844    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283849    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 18:44:40.297404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283852    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283854    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283859    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283861    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283864    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283867    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283869    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283872    2581 flags.go:64] FLAG: --v="2"
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283876    2581 flags.go:64] FLAG: --version="false"
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283880    2581 flags.go:64] FLAG: --vmodule=""
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283883    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.283887    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284011    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284015    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284018    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284021    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284023    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284027    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284029    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284031    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284034    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284036    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:44:40.298009 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284038    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284041    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284044    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284046    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284048    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284051    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284053    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284057    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284062    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284065    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284067    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284070    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284073    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284075    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284077    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284080    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284084    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284087    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284090    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:44:40.298562 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284093    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284096    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284100    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284103    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284105    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284108    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284110    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284112    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284115    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284117    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284119    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284122    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284124    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284126    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284129    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284131    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284133    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284136    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284138    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284142    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:44:40.299039 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284145    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284149    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284152    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284155    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284157    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284160    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284163    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284165    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284168    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284171    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284173    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284175    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284178    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284180    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284184    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284186    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284189    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284191    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284209    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284212    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:44:40.299578 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284215    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284217    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284220    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284223    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284225    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284228    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284230    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284232    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284235    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284237    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284240    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284242    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284244    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284248    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284250    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284253    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284256    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284258    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284261    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284263    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:44:40.300061 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284266    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284268    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284270    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284273    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284276    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284278    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284282    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284284    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284287    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.284289    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.284295    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.292064    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.292085    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.292988    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 18:44:40.300557 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.293002    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293089    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293097    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293102    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293107    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293111    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293116    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293120    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293126    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293130    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293134    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293139    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293143    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293147    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293151    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293156    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293160    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293164    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293168    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293173    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:44:40.300914 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293177    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293181    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293185    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293189    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293193    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293217    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293222    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293226    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293230    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293234    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293240    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293244    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293248    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293252    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293256    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293260    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293265    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293269    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293273    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293278    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:44:40.301402 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293282    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293287    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293291    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293294    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293299    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293303    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293307    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293311    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293315    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293319    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293323    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293327    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293332    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293336    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293340    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293344    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293348    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293352    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293357    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293363    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:44:40.301877 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293368    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293373    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293377    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293383    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293387    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293391    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293394    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293398    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293402    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293406    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293410    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293414    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293418    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293422    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293426    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293431    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293435    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293439    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293443    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293447    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:44:40.302375 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293451    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293456    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293460    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293467    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293473    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293478    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293482    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293487    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293493    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293498    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293503    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293508    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293513    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293517    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293521    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293526    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293531    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293535    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293539    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:44:40.302888 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293543    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.293552    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293744    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293751    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293756    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293761    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293765    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293770    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293774    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293778    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293782    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293786    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293791    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293795    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293799    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 18:44:40.303368 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293802    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293806    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293810    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293814    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293818    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293822    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293826    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293830    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293834    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293838    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293842    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293847    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293851    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293855    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293859    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293864    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293868    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293873    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293877    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293881    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 18:44:40.303735 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293885    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293889    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293893    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293897    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293901    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293905    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293909    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293913    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293919    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293926    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293930    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293935    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293940    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293945    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293950    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293955    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293959    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293963    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293967    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293972    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 18:44:40.304214 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293976    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293981    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293986    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293990    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293995    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.293999    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294004    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294008    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294013    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294018    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294022    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294026    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294032    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294038    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294042    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294046    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294051    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294055    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 18:44:40.304687 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294059    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294063    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294067    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294071    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294075    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294079    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294083    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294088    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294093    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294096    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294100    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294105    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294109    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294112    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294116    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294121    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294125    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294128    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294133    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294137    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 18:44:40.305123 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294141    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294146    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294151    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294639    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294648    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294652    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294656    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:40.294660    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.294669    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.295877    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.298305    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.300044    2581 server.go:1019] "Starting client certificate rotation"
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.300143    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 18:44:40.305690 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.300176    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 18:44:40.306024 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.302791    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 18:44:40.306024 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.304947    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 18:44:40.314742 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.314725    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 17 18:44:40.316867 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.316854    2581 log.go:25] "Validated CRI v1 image API"
Jul 17 18:44:40.318536 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.318518    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 18:44:40.320677 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.320650    2581 fs.go:135] Filesystem UUIDs: map[10017da4-b2c2-44cf-a8b8-1ffea44e1372:/dev/nvme0n1p3 29c14513-0c05-4a72-b634-96e3e7d1579b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 17 18:44:40.320744 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.320676    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 18:44:40.325680 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.325563    2581 manager.go:216] Machine: {Timestamp:2026-07-17 18:44:40.324293171 +0000 UTC m=+0.318659176 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099637 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cdf73d8d340f2b61caf3c921cb6af SystemUUID:ec2cdf73-d8d3-40f2-b61c-af3c921cb6af BootID:193150d2-ffba-4f81-87a7-a759a22e1a9d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:93:e9:4e:d7:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:93:e9:4e:d7:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:1e:e2:20:19:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 18:44:40.325680 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.325679    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 18:44:40.325781 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.325753    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 18:44:40.328954 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.328932    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 18:44:40.329087 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.328957    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-97.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 18:44:40.329709 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.329698    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 18:44:40.329740 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.329711    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 18:44:40.329740 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.329719    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 18:44:40.330353 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.330343    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 18:44:40.331542 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.331532    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 18:44:40.334352 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.334334    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 18:44:40.334664 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.334642    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 18:44:40.334736 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.334685    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 18:44:40.334736 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.334702    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 18:44:40.334736 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.334724    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 18:44:40.334861 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.334738    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 17 18:44:40.334861 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.334758    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 18:44:40.335230 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.335215    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 18:44:40.335283 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.335246    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 18:44:40.337225 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.337187    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 18:44:40.338534 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.338515    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 18:44:40.340428 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.340415    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 18:44:40.340480 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.340446    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 18:44:40.341586 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341575    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 18:44:40.341623 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341591    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 18:44:40.341623 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341597    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 18:44:40.341623 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341602    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 18:44:40.341623 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341611    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 18:44:40.341623 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341617    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 18:44:40.341623 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341625    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 18:44:40.341783 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341630    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 18:44:40.341783 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341637    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 18:44:40.341783 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341643    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 18:44:40.341783 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341651    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 18:44:40.341783 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.341657    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 18:44:40.342352 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.342342    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 18:44:40.342352 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.342352    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 18:44:40.345250 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.345229    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-97.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 18:44:40.345469 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.345457    2581 server.go:1268] "Started kubelet"
Jul 17 18:44:40.345551 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.345526    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 18:44:40.345733 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.345687    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 18:44:40.345833 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.345748    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 18:44:40.345892 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.345872    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 18:44:40.345941 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.345871    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 18:44:40.346417 ip-10-0-137-97 systemd[1]: Started Kubernetes Kubelet.
Jul 17 18:44:40.347542 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.347519    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 18:44:40.347645 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.347632    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 18:44:40.351441 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.351424    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 18:44:40.352948 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.352107    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-97.ec2.internal.18c328053dc9c0ea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-97.ec2.internal,UID:ip-10-0-137-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-97.ec2.internal,},FirstTimestamp:2026-07-17 18:44:40.345428202 +0000 UTC m=+0.339794209,LastTimestamp:2026-07-17 18:44:40.345428202 +0000 UTC m=+0.339794209,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-97.ec2.internal,}"
Jul 17 18:44:40.353480 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.353466    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 18:44:40.353540 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.353492    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 18:44:40.353597 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.353566    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:40.354249 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354228    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 18:44:40.354361 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354348    2581 factory.go:55] Registering systemd factory
Jul 17 18:44:40.354409 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354365    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 17 18:44:40.354580 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354566    2581 factory.go:153] Registering CRI-O factory
Jul 17 18:44:40.354580 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354580    2581 factory.go:223] Registration of the crio container factory successfully
Jul 17 18:44:40.354683 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354625    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 18:44:40.354683 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354649    2581 factory.go:103] Registering Raw factory
Jul 17 18:44:40.354683 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354664    2581 manager.go:1196] Started watching for new ooms in manager
Jul 17 18:44:40.354771 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354648    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 18:44:40.354810 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354800    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 18:44:40.354974 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354962    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 18:44:40.355002 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.354976    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 18:44:40.355545 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.355532    2581 manager.go:349] Starting recovery of all containers
Jul 17 18:44:40.356932 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.356909    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 18:44:40.357024 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.356994    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 18:44:40.368843 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.368823    2581 manager.go:354] Recovery completed
Jul 17 18:44:40.370462 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.370358    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rlvqx"
Jul 17 18:44:40.373218 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.373188    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:44:40.374982 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.374965    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:44:40.375076 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.374993    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:44:40.375076 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.375003    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:44:40.375610 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.375596    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 18:44:40.375610 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.375610    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 18:44:40.375725 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.375627    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 18:44:40.375725 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.375641    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:44:40.376461 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.376443    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:44:40.376543 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.376467    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:44:40.376543 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.376477    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:44:40.376831 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.376817    2581 policy_none.go:49] "None policy: Start"
Jul 17 18:44:40.376883 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.376837    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 18:44:40.376883 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.376851    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 18:44:40.377262 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.377174    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-97.ec2.internal.18c328053f8cae03  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-97.ec2.internal,UID:ip-10-0-137-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-97.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-97.ec2.internal,},FirstTimestamp:2026-07-17 18:44:40.374980099 +0000 UTC m=+0.369346108,LastTimestamp:2026-07-17 18:44:40.374980099 +0000 UTC m=+0.369346108,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-97.ec2.internal,}"
Jul 17 18:44:40.377803 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.377789    2581 policy_none.go:47] "Start"
Jul 17 18:44:40.378985 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.378963    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rlvqx"
Jul 17 18:44:40.416720 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.416699    2581 manager.go:337] "Starting Device Plugin manager"
Jul 17 18:44:40.416802 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.416752    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 18:44:40.416802 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.416768    2581 server.go:87] "Starting device plugin registration server"
Jul 17 18:44:40.417047 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.417035    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 18:44:40.417091 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.417050    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 18:44:40.417169 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.417152    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 18:44:40.417255 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.417244    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 18:44:40.417255 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.417254    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 18:44:40.419570 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.419547    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 18:44:40.419671 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.419596    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:40.478397 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.478365    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 18:44:40.479696 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.479673    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 18:44:40.479773 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.479723    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 18:44:40.479773 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.479747    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 18:44:40.479866 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.479780    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 18:44:40.482541 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.482523    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 18:44:40.517948 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.517908    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:44:40.519011 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.518993    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:44:40.519111 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.519028    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:44:40.519111 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.519043    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:44:40.519111 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.519082    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.533697 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.533645    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.533697 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.533666    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-97.ec2.internal\": node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:40.554650 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.554628    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:40.580152 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.580128    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal"]
Jul 17 18:44:40.580255 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.580178    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:44:40.581348 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.581334    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:44:40.581422 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.581360    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:44:40.581422 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.581369    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:44:40.582446 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.582433    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:44:40.582536 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.582524    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.582578 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.582550    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:44:40.583081 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.583065    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:44:40.583081 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.583075    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:44:40.583176 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.583096    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:44:40.583176 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.583108    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:44:40.583176 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.583097    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:44:40.583176 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.583172    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:44:40.584372 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.584358    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.584418 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.584395    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 18:44:40.585038 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.585024    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 18:44:40.585110 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.585046    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 18:44:40.585110 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.585057    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeHasSufficientPID"
Jul 17 18:44:40.608806 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.608779    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-97.ec2.internal\" not found" node="ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.613271 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.613256    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-97.ec2.internal\" not found" node="ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.655242 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.655222    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:40.656357 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.656341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2a5ff74c2e0abc48546d1716910f233-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal\" (UID: \"c2a5ff74c2e0abc48546d1716910f233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.656404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.656367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a5ff74c2e0abc48546d1716910f233-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal\" (UID: \"c2a5ff74c2e0abc48546d1716910f233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.656404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.656384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0b6aa9c2776624cde641ff04a58f3d9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-97.ec2.internal\" (UID: \"f0b6aa9c2776624cde641ff04a58f3d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.755970 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.755949    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:40.757068 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.757052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a5ff74c2e0abc48546d1716910f233-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal\" (UID: \"c2a5ff74c2e0abc48546d1716910f233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.757112 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.757078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0b6aa9c2776624cde641ff04a58f3d9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-97.ec2.internal\" (UID: \"f0b6aa9c2776624cde641ff04a58f3d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.757112 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.757093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2a5ff74c2e0abc48546d1716910f233-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal\" (UID: \"c2a5ff74c2e0abc48546d1716910f233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.757171 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.757140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2a5ff74c2e0abc48546d1716910f233-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal\" (UID: \"c2a5ff74c2e0abc48546d1716910f233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.757171 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.757146    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a5ff74c2e0abc48546d1716910f233-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal\" (UID: \"c2a5ff74c2e0abc48546d1716910f233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.757248 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.757167    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0b6aa9c2776624cde641ff04a58f3d9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-97.ec2.internal\" (UID: \"f0b6aa9c2776624cde641ff04a58f3d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.856703 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.856654    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:40.912633 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.912615    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.916269 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:40.916056    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:40.957527 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:40.957504    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:41.058003 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:41.057977    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:41.158435 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:41.158375    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:41.258941 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:41.258912    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:41.299159 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.299139    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 18:44:41.299550 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.299294    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 18:44:41.359305 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:41.359281    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:41.382872 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.382848    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 18:39:41 +0000 UTC" deadline="2028-01-18 01:18:51.817581792 +0000 UTC"
Jul 17 18:44:41.382872 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.382872    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13182h34m10.434712883s"
Jul 17 18:44:41.459540 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:41.459475    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-97.ec2.internal\" not found"
Jul 17 18:44:41.502272 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:41.502241    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b6aa9c2776624cde641ff04a58f3d9.slice/crio-eac218f32a15c38182bbe662da8335ea4bf85ffe3a315319184a4451ec7358bc WatchSource:0}: Error finding container eac218f32a15c38182bbe662da8335ea4bf85ffe3a315319184a4451ec7358bc: Status 404 returned error can't find the container with id eac218f32a15c38182bbe662da8335ea4bf85ffe3a315319184a4451ec7358bc
Jul 17 18:44:41.502673 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:41.502648    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a5ff74c2e0abc48546d1716910f233.slice/crio-8c16663ae4e014480a58e526770f94f17ec26cb44dd66ff95bf3fc1d76958253 WatchSource:0}: Error finding container 8c16663ae4e014480a58e526770f94f17ec26cb44dd66ff95bf3fc1d76958253: Status 404 returned error can't find the container with id 8c16663ae4e014480a58e526770f94f17ec26cb44dd66ff95bf3fc1d76958253
Jul 17 18:44:41.507375 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.507352    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:44:41.541854 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.541835    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 18:44:41.554045 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.554027    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:41.566869 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.566846    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 18:44:41.568527 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.568515    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal"
Jul 17 18:44:41.581650 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.581634    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 18:44:41.824245 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.824138    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 18:44:41.861432 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:41.861405    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 18:44:42.213519 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.213437    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 18:44:42.336779 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.336723    2581 apiserver.go:52] "Watching apiserver"
Jul 17 18:44:42.346127 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.346097    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 18:44:42.346654 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.346625    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5","openshift-cluster-node-tuning-operator/tuned-mgd5c","openshift-image-registry/node-ca-nn2j5","openshift-multus/multus-additional-cni-plugins-w6h2r","openshift-network-operator/iptables-alerter-mdt4z","kube-system/konnectivity-agent-9kkfc","openshift-dns/node-resolver-ftftv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal","openshift-multus/multus-5xnh7","openshift-multus/network-metrics-daemon-5cmlj","openshift-network-diagnostics/network-check-target-4bz9l","openshift-ovn-kubernetes/ovnkube-node-ftgn9","kube-system/global-pull-secret-syncer-fjrb2"]
Jul 17 18:44:42.349480 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.349454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:44:42.352683 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.352660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.354942 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.354460    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 18:44:42.355239 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.355198    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.358129 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.357798    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.361792 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.361695    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.362264 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.362181    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 18:44:42.362394 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.362354    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 18:44:42.362394 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.362380    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 18:44:42.362572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.362554    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 18:44:42.363662 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.363498    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 18:44:42.363662 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.363539    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 18:44:42.363662 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.363555    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhvpt\""
Jul 17 18:44:42.364377 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.364353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.365947 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.365926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-sysconfig\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366055 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.365962    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-var-lib-kubelet\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366055 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.365985    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adcd2d17-7d84-4e23-a462-095dfca572fa-tmp\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366055 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z242t\" (UniqueName: \"kubernetes.io/projected/adcd2d17-7d84-4e23-a462-095dfca572fa-kube-api-access-z242t\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366055 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b99890e-d27a-4aa7-8c31-b0572eba43dc-konnectivity-ca\") pod \"konnectivity-agent-9kkfc\" (UID: \"0b99890e-d27a-4aa7-8c31-b0572eba43dc\") " pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-etc-openvswitch\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-run-systemd\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-ovnkube-config\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc9fn\" (UniqueName: \"kubernetes.io/projected/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-kube-api-access-kc9fn\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-systemd\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-run\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-sys\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366228    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-tuned\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-kubelet\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-run-openvswitch\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-run-netns\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-run-ovn\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-cni-netd\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-lib-modules\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-systemd-units\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-slash\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-node-log\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-env-overrides\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-ovn-node-metrics-cert\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-kubernetes\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-sysctl-d\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-sysctl-conf\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-host\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b99890e-d27a-4aa7-8c31-b0572eba43dc-agent-certs\") pod \"konnectivity-agent-9kkfc\" (UID: \"0b99890e-d27a-4aa7-8c31-b0572eba43dc\") " pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-cni-bin\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.366911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-log-socket\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.367698 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-ovnkube-script-lib\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.367698 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-modprobe-d\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.367698 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-var-lib-openvswitch\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.367698 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.366874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-run-ovn-kubernetes\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.367698 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.367321    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:42.367698 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.367404    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:44:42.368007 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.367813    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-425pv\""
Jul 17 18:44:42.368007 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.367972    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 18:44:42.368111 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.368043    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 18:44:42.369037 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.369020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.373244 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.373224    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.376480 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.376460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.379561 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.379122    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:42.379561 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.379195    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:44:42.380903 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.380593    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 18:44:42.380903 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.380764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 18:44:42.380903 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.380783    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 18:44:42.381704 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.381446    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 18:44:42.381704 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.381475    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 18:44:42.381704 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.381574    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 18:44:42.381902 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.381809    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 18:44:42.381902 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.381835    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 18:44:42.382014 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.381927    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 18:44:42.382014 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.381835    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 18:44:42.382111 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.382023    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:42.382111 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.382087    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:44:42.382236 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.382210    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 18:44:42.382317 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.382301    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hm8g7\""
Jul 17 18:44:42.382375 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.382331    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dwgm4\""
Jul 17 18:44:42.382375 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.382365    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 18:44:42.382479 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.382460    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 18:44:42.382570 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.382550    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 18:44:42.382631 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.382615    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 18:44:42.383566 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.383546    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 18:44:42.383831 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.383812    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hh542\""
Jul 17 18:44:42.386608 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.386589    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tm5vz\""
Jul 17 18:44:42.386891 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.386875    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-plzgx\""
Jul 17 18:44:42.386891 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.386882    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 18:44:42.393480 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.393447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vrj5m\""
Jul 17 18:44:42.393669 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.393649    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rzt9w\""
Jul 17 18:44:42.393751 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.393687    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 18:44:42.393751 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.393656    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 18:44:42.412019 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.411967    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 18:44:42.438983 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.438961    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dncnx"
Jul 17 18:44:42.456157 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.456136    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 18:44:42.456350 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.456333    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dncnx"
Jul 17 18:44:42.468093 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-run\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.468093 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-tuned\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.468253 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-kubelet\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468253 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-run-openvswitch\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468253 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01-tmp-dir\") pod \"node-resolver-ftftv\" (UID: \"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01\") " pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.468253 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-cnibin\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.468253 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d9b4081-ec83-493a-9086-2edad4dea1aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.468253 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-cnibin\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.468492 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-run-ovn\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468492 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-run\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.468492 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468409    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-kubelet\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468492 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-cni-netd\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468492 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-run-openvswitch\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468490    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-cni-netd\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-run-ovn\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fea7de92-7c33-4085-99cd-5960f46575ba-serviceca\") pod \"node-ca-nn2j5\" (UID: \"fea7de92-7c33-4085-99cd-5960f46575ba\") " pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-system-cni-dir\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d9b4081-ec83-493a-9086-2edad4dea1aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-var-lib-cni-multus\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-systemd-units\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-node-log\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-env-overrides\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468698    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-systemd-units\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-ovn-node-metrics-cert\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.468754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468729    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da80c192-a756-4851-b383-af89b28f3eb2-host-slash\") pod \"iptables-alerter-mdt4z\" (UID: \"da80c192-a756-4851-b383-af89b28f3eb2\") " pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.468772    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-sys-fs\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vczmc\" (UniqueName: \"kubernetes.io/projected/fea7de92-7c33-4085-99cd-5960f46575ba-kube-api-access-vczmc\") pod \"node-ca-nn2j5\" (UID: \"fea7de92-7c33-4085-99cd-5960f46575ba\") " pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469159    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-env-overrides\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469170    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-os-release\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-kubernetes\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-sysctl-d\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-sysctl-conf\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469295    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-node-log\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-host\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-sysctl-d\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3950912b-a457-4769-9d09-a5f1b30f3eec-dbus\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-var-lib-cni-bin\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469428    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-kubernetes\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-log-socket\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-sysctl-conf\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469516    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-ovnkube-script-lib\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469540    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-device-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-444gp\" (UniqueName: \"kubernetes.io/projected/db957346-b831-471f-888d-54604789709a-kube-api-access-444gp\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-host\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwg9w\" (UniqueName: \"kubernetes.io/projected/77b611d5-c01a-4599-b7d3-406f526c1d4b-kube-api-access-wwg9w\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-var-lib-kubelet\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-etc-kubernetes\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-modprobe-d\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-sysconfig\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adcd2d17-7d84-4e23-a462-095dfca572fa-tmp\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.469919 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z242t\" (UniqueName: \"kubernetes.io/projected/adcd2d17-7d84-4e23-a462-095dfca572fa-kube-api-access-z242t\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b99890e-d27a-4aa7-8c31-b0572eba43dc-konnectivity-ca\") pod \"konnectivity-agent-9kkfc\" (UID: \"0b99890e-d27a-4aa7-8c31-b0572eba43dc\") " pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469892    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxvjh\" (UniqueName: \"kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh\") pod \"network-check-target-4bz9l\" (UID: \"4edccd7e-159b-4909-afe4-42de245cf5f6\") " pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01-hosts-file\") pod \"node-resolver-ftftv\" (UID: \"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01\") " pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fea7de92-7c33-4085-99cd-5960f46575ba-host\") pod \"node-ca-nn2j5\" (UID: \"fea7de92-7c33-4085-99cd-5960f46575ba\") " pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.469978    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-ovnkube-config\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc9fn\" (UniqueName: \"kubernetes.io/projected/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-kube-api-access-kc9fn\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470060    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-ovnkube-script-lib\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470115    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-log-socket\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-socket-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-os-release\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-run-netns\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470322    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83189e4b-5828-49a1-b477-19a05516e02b-multus-daemon-config\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9v8t\" (UniqueName: \"kubernetes.io/projected/83189e4b-5828-49a1-b477-19a05516e02b-kube-api-access-h9v8t\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-systemd\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-sys\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-sysconfig\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.470714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf8gf\" (UniqueName: \"kubernetes.io/projected/da80c192-a756-4851-b383-af89b28f3eb2-kube-api-access-mf8gf\") pod \"iptables-alerter-mdt4z\" (UID: \"da80c192-a756-4851-b383-af89b28f3eb2\") " pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-multus-socket-dir-parent\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-run-multus-certs\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-run-netns\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da80c192-a756-4851-b383-af89b28f3eb2-iptables-alerter-script\") pod \"iptables-alerter-mdt4z\" (UID: \"da80c192-a756-4851-b383-af89b28f3eb2\") " pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82sfq\" (UniqueName: \"kubernetes.io/projected/3d9b4081-ec83-493a-9086-2edad4dea1aa-kube-api-access-82sfq\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470648    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-system-cni-dir\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-lib-modules\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470721    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-slash\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhfhf\" (UniqueName: \"kubernetes.io/projected/f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01-kube-api-access-nhfhf\") pod \"node-resolver-ftftv\" (UID: \"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01\") " pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b99890e-d27a-4aa7-8c31-b0572eba43dc-agent-certs\") pod \"konnectivity-agent-9kkfc\" (UID: \"0b99890e-d27a-4aa7-8c31-b0572eba43dc\") " pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-cni-bin\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470849    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-ovnkube-config\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470864    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-run-k8s-cni-cncf-io\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d9b4081-ec83-493a-9086-2edad4dea1aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-systemd\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.471197 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-var-lib-openvswitch\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470951    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-sys\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470956    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-run-ovn-kubernetes\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.470989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-hostroot\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-multus-conf-dir\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-var-lib-kubelet\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-etc-openvswitch\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-registration-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3950912b-a457-4769-9d09-a5f1b30f3eec-kubelet-config\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471329    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-run-ovn-kubernetes\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-run-systemd\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-run-netns\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471401    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-modprobe-d\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-multus-cni-dir\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83189e4b-5828-49a1-b477-19a05516e02b-cni-binary-copy\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.472033 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471455    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-etc-openvswitch\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472915 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.471481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-var-lib-kubelet\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.472915 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.472085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-slash\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472915 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.472129    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-host-cni-bin\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472915 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.472175    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-run-systemd\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472915 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.472216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-var-lib-openvswitch\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.472915 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.472215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b99890e-d27a-4aa7-8c31-b0572eba43dc-konnectivity-ca\") pod \"konnectivity-agent-9kkfc\" (UID: \"0b99890e-d27a-4aa7-8c31-b0572eba43dc\") " pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:44:42.472915 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.472332    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adcd2d17-7d84-4e23-a462-095dfca572fa-lib-modules\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.479302 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.474152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adcd2d17-7d84-4e23-a462-095dfca572fa-tmp\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.479302 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.474720    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b99890e-d27a-4aa7-8c31-b0572eba43dc-agent-certs\") pod \"konnectivity-agent-9kkfc\" (UID: \"0b99890e-d27a-4aa7-8c31-b0572eba43dc\") " pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:44:42.479302 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.476394    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-ovn-node-metrics-cert\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.479302 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.477298    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/adcd2d17-7d84-4e23-a462-095dfca572fa-etc-tuned\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.484618 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.484592    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z242t\" (UniqueName: \"kubernetes.io/projected/adcd2d17-7d84-4e23-a462-095dfca572fa-kube-api-access-z242t\") pod \"tuned-mgd5c\" (UID: \"adcd2d17-7d84-4e23-a462-095dfca572fa\") " pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.485334 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.485101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal" event={"ID":"f0b6aa9c2776624cde641ff04a58f3d9","Type":"ContainerStarted","Data":"eac218f32a15c38182bbe662da8335ea4bf85ffe3a315319184a4451ec7358bc"}
Jul 17 18:44:42.486756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.486729    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal" event={"ID":"c2a5ff74c2e0abc48546d1716910f233","Type":"ContainerStarted","Data":"8c16663ae4e014480a58e526770f94f17ec26cb44dd66ff95bf3fc1d76958253"}
Jul 17 18:44:42.489106 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.489036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc9fn\" (UniqueName: \"kubernetes.io/projected/1c764a1b-0be7-4676-9951-5c8ad7b18ee8-kube-api-access-kc9fn\") pod \"ovnkube-node-ftgn9\" (UID: \"1c764a1b-0be7-4676-9951-5c8ad7b18ee8\") " pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.571736 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvjh\" (UniqueName: \"kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh\") pod \"network-check-target-4bz9l\" (UID: \"4edccd7e-159b-4909-afe4-42de245cf5f6\") " pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:42.571736 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01-hosts-file\") pod \"node-resolver-ftftv\" (UID: \"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01\") " pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.571736 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fea7de92-7c33-4085-99cd-5960f46575ba-host\") pod \"node-ca-nn2j5\" (UID: \"fea7de92-7c33-4085-99cd-5960f46575ba\") " pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.571736 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-socket-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-os-release\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571795    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-run-netns\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83189e4b-5828-49a1-b477-19a05516e02b-multus-daemon-config\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9v8t\" (UniqueName: \"kubernetes.io/projected/83189e4b-5828-49a1-b477-19a05516e02b-kube-api-access-h9v8t\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf8gf\" (UniqueName: \"kubernetes.io/projected/da80c192-a756-4851-b383-af89b28f3eb2-kube-api-access-mf8gf\") pod \"iptables-alerter-mdt4z\" (UID: \"da80c192-a756-4851-b383-af89b28f3eb2\") " pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571869    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-multus-socket-dir-parent\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-run-multus-certs\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da80c192-a756-4851-b383-af89b28f3eb2-iptables-alerter-script\") pod \"iptables-alerter-mdt4z\" (UID: \"da80c192-a756-4851-b383-af89b28f3eb2\") " pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571919    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82sfq\" (UniqueName: \"kubernetes.io/projected/3d9b4081-ec83-493a-9086-2edad4dea1aa-kube-api-access-82sfq\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-system-cni-dir\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhfhf\" (UniqueName: \"kubernetes.io/projected/f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01-kube-api-access-nhfhf\") pod \"node-resolver-ftftv\" (UID: \"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01\") " pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.571983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-run-k8s-cni-cncf-io\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d9b4081-ec83-493a-9086-2edad4dea1aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-hostroot\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-multus-conf-dir\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-registration-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3950912b-a457-4769-9d09-a5f1b30f3eec-kubelet-config\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572172    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-multus-cni-dir\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83189e4b-5828-49a1-b477-19a05516e02b-cni-binary-copy\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01-tmp-dir\") pod \"node-resolver-ftftv\" (UID: \"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01\") " pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-cnibin\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d9b4081-ec83-493a-9086-2edad4dea1aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-cnibin\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fea7de92-7c33-4085-99cd-5960f46575ba-serviceca\") pod \"node-ca-nn2j5\" (UID: \"fea7de92-7c33-4085-99cd-5960f46575ba\") " pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-system-cni-dir\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d9b4081-ec83-493a-9086-2edad4dea1aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-var-lib-cni-multus\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da80c192-a756-4851-b383-af89b28f3eb2-host-slash\") pod \"iptables-alerter-mdt4z\" (UID: \"da80c192-a756-4851-b383-af89b28f3eb2\") " pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-sys-fs\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.572732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vczmc\" (UniqueName: \"kubernetes.io/projected/fea7de92-7c33-4085-99cd-5960f46575ba-kube-api-access-vczmc\") pod \"node-ca-nn2j5\" (UID: \"fea7de92-7c33-4085-99cd-5960f46575ba\") " pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-os-release\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3950912b-a457-4769-9d09-a5f1b30f3eec-dbus\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-var-lib-cni-bin\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-device-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-444gp\" (UniqueName: \"kubernetes.io/projected/db957346-b831-471f-888d-54604789709a-kube-api-access-444gp\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwg9w\" (UniqueName: \"kubernetes.io/projected/77b611d5-c01a-4599-b7d3-406f526c1d4b-kube-api-access-wwg9w\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-var-lib-kubelet\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-etc-kubernetes\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.572863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-etc-kubernetes\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01-hosts-file\") pod \"node-resolver-ftftv\" (UID: \"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01\") " pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573200    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fea7de92-7c33-4085-99cd-5960f46575ba-host\") pod \"node-ca-nn2j5\" (UID: \"fea7de92-7c33-4085-99cd-5960f46575ba\") " pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573329    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-system-cni-dir\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-socket-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573375    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-multus-cni-dir\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.573439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-multus-socket-dir-parent\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574031 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-run-multus-certs\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574031 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-os-release\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574031 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573619    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-run-netns\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574031 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573694    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01-tmp-dir\") pod \"node-resolver-ftftv\" (UID: \"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01\") " pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.574031 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-cnibin\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.574031 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.573981    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83189e4b-5828-49a1-b477-19a05516e02b-cni-binary-copy\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574209 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83189e4b-5828-49a1-b477-19a05516e02b-multus-daemon-config\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574209 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da80c192-a756-4851-b383-af89b28f3eb2-iptables-alerter-script\") pod \"iptables-alerter-mdt4z\" (UID: \"da80c192-a756-4851-b383-af89b28f3eb2\") " pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.574297 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-hostroot\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574356 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d9b4081-ec83-493a-9086-2edad4dea1aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.574356 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-run-k8s-cni-cncf-io\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574511 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-registration-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.574511 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.574511 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574425    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3950912b-a457-4769-9d09-a5f1b30f3eec-kubelet-config\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:42.574511 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-etc-selinux\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.574511 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574475    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-cnibin\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574766 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574556    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-var-lib-cni-multus\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574766 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574588    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da80c192-a756-4851-b383-af89b28f3eb2-host-slash\") pod \"iptables-alerter-mdt4z\" (UID: \"da80c192-a756-4851-b383-af89b28f3eb2\") " pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.574766 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-system-cni-dir\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.574920 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.574920 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574799    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fea7de92-7c33-4085-99cd-5960f46575ba-serviceca\") pod \"node-ca-nn2j5\" (UID: \"fea7de92-7c33-4085-99cd-5960f46575ba\") " pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.574920 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d9b4081-ec83-493a-9086-2edad4dea1aa-os-release\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.574920 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d9b4081-ec83-493a-9086-2edad4dea1aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.574920 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3950912b-a457-4769-9d09-a5f1b30f3eec-dbus\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:42.574920 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-var-lib-kubelet\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.574920 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-sys-fs\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.575268 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.574306    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:42.575268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.574957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db957346-b831-471f-888d-54604789709a-device-dir\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.575268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.575008    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-host-var-lib-cni-bin\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.575268 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.575054    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret podName:3950912b-a457-4769-9d09-a5f1b30f3eec nodeName:}" failed. No retries permitted until 2026-07-17 18:44:43.075029413 +0000 UTC m=+3.069395426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret") pod "global-pull-secret-syncer-fjrb2" (UID: "3950912b-a457-4769-9d09-a5f1b30f3eec") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:42.575268 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.574550    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:42.575268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.575066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83189e4b-5828-49a1-b477-19a05516e02b-multus-conf-dir\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.575268 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.575098    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs podName:77b611d5-c01a-4599-b7d3-406f526c1d4b nodeName:}" failed. No retries permitted until 2026-07-17 18:44:43.075086515 +0000 UTC m=+3.069452537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs") pod "network-metrics-daemon-5cmlj" (UID: "77b611d5-c01a-4599-b7d3-406f526c1d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:42.575268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.575202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d9b4081-ec83-493a-9086-2edad4dea1aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.609125 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.609093    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9v8t\" (UniqueName: \"kubernetes.io/projected/83189e4b-5828-49a1-b477-19a05516e02b-kube-api-access-h9v8t\") pod \"multus-5xnh7\" (UID: \"83189e4b-5828-49a1-b477-19a05516e02b\") " pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:42.614556 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.614527    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:44:42.614686 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.614562    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:44:42.614686 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.614579    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xxvjh for pod openshift-network-diagnostics/network-check-target-4bz9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:42.614686 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:42.614661    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh podName:4edccd7e-159b-4909-afe4-42de245cf5f6 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:43.114640237 +0000 UTC m=+3.109006254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xxvjh" (UniqueName: "kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh") pod "network-check-target-4bz9l" (UID: "4edccd7e-159b-4909-afe4-42de245cf5f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:42.616316 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.616265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-444gp\" (UniqueName: \"kubernetes.io/projected/db957346-b831-471f-888d-54604789709a-kube-api-access-444gp\") pod \"aws-ebs-csi-driver-node-mq6v5\" (UID: \"db957346-b831-471f-888d-54604789709a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.617831 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.617804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhfhf\" (UniqueName: \"kubernetes.io/projected/f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01-kube-api-access-nhfhf\") pod \"node-resolver-ftftv\" (UID: \"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01\") " pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.618845 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.618821    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82sfq\" (UniqueName: \"kubernetes.io/projected/3d9b4081-ec83-493a-9086-2edad4dea1aa-kube-api-access-82sfq\") pod \"multus-additional-cni-plugins-w6h2r\" (UID: \"3d9b4081-ec83-493a-9086-2edad4dea1aa\") " pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.620889 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.620842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vczmc\" (UniqueName: \"kubernetes.io/projected/fea7de92-7c33-4085-99cd-5960f46575ba-kube-api-access-vczmc\") pod \"node-ca-nn2j5\" (UID: \"fea7de92-7c33-4085-99cd-5960f46575ba\") " pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.621872 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.621842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf8gf\" (UniqueName: \"kubernetes.io/projected/da80c192-a756-4851-b383-af89b28f3eb2-kube-api-access-mf8gf\") pod \"iptables-alerter-mdt4z\" (UID: \"da80c192-a756-4851-b383-af89b28f3eb2\") " pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.629437 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.629413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwg9w\" (UniqueName: \"kubernetes.io/projected/77b611d5-c01a-4599-b7d3-406f526c1d4b-kube-api-access-wwg9w\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:42.670958 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.670932    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:44:42.680429 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.680406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:44:42.687611 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:42.687583    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b99890e_d27a_4aa7_8c31_b0572eba43dc.slice/crio-f74595943d6551664968abbb2e7f2ede63c9f1082b2912f7f6bc184318c310be WatchSource:0}: Error finding container f74595943d6551664968abbb2e7f2ede63c9f1082b2912f7f6bc184318c310be: Status 404 returned error can't find the container with id f74595943d6551664968abbb2e7f2ede63c9f1082b2912f7f6bc184318c310be
Jul 17 18:44:42.692075 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.692053    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mgd5c"
Jul 17 18:44:42.694108 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:42.694065    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c764a1b_0be7_4676_9951_5c8ad7b18ee8.slice/crio-f45dceafaf99d9af8b2bb4704bcf2219bf3918b83f0ed9ea39d47358262aacd5 WatchSource:0}: Error finding container f45dceafaf99d9af8b2bb4704bcf2219bf3918b83f0ed9ea39d47358262aacd5: Status 404 returned error can't find the container with id f45dceafaf99d9af8b2bb4704bcf2219bf3918b83f0ed9ea39d47358262aacd5
Jul 17 18:44:42.700713 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.700617    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nn2j5"
Jul 17 18:44:42.703762 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:42.703736    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadcd2d17_7d84_4e23_a462_095dfca572fa.slice/crio-c67a9f10056845acc10745352bf7757d7339571b00c1a35258f4948d29874d04 WatchSource:0}: Error finding container c67a9f10056845acc10745352bf7757d7339571b00c1a35258f4948d29874d04: Status 404 returned error can't find the container with id c67a9f10056845acc10745352bf7757d7339571b00c1a35258f4948d29874d04
Jul 17 18:44:42.714303 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.714245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w6h2r"
Jul 17 18:44:42.717765 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:42.717594    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea7de92_7c33_4085_99cd_5960f46575ba.slice/crio-4e715079e2490b47395f0f530c4737f806660a98136ab4bfa57cbeb287e62829 WatchSource:0}: Error finding container 4e715079e2490b47395f0f530c4737f806660a98136ab4bfa57cbeb287e62829: Status 404 returned error can't find the container with id 4e715079e2490b47395f0f530c4737f806660a98136ab4bfa57cbeb287e62829
Jul 17 18:44:42.723488 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.723467    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mdt4z"
Jul 17 18:44:42.731307 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:42.731253    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d9b4081_ec83_493a_9086_2edad4dea1aa.slice/crio-5b9fbe3edec34af9277155e52bf33ac0430ab471369488e49d8133ed52111ca9 WatchSource:0}: Error finding container 5b9fbe3edec34af9277155e52bf33ac0430ab471369488e49d8133ed52111ca9: Status 404 returned error can't find the container with id 5b9fbe3edec34af9277155e52bf33ac0430ab471369488e49d8133ed52111ca9
Jul 17 18:44:42.732305 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.732287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ftftv"
Jul 17 18:44:42.735401 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:42.735366    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda80c192_a756_4851_b383_af89b28f3eb2.slice/crio-d12c88a2cb7e0fe6b9fb5955a9c9b787b32c784855a7f8bbe5e294aa9d9620d9 WatchSource:0}: Error finding container d12c88a2cb7e0fe6b9fb5955a9c9b787b32c784855a7f8bbe5e294aa9d9620d9: Status 404 returned error can't find the container with id d12c88a2cb7e0fe6b9fb5955a9c9b787b32c784855a7f8bbe5e294aa9d9620d9
Jul 17 18:44:42.741670 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.741607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5"
Jul 17 18:44:42.743974 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:42.743943    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c6d7b5_2b6b_4fb2_9799_0f9d8684cc01.slice/crio-50acedbd7dbcd9f7c80f44524db94cc8878c08be7e52dec6073f86d0fb5fef4d WatchSource:0}: Error finding container 50acedbd7dbcd9f7c80f44524db94cc8878c08be7e52dec6073f86d0fb5fef4d: Status 404 returned error can't find the container with id 50acedbd7dbcd9f7c80f44524db94cc8878c08be7e52dec6073f86d0fb5fef4d
Jul 17 18:44:42.746627 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:42.746610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5xnh7"
Jul 17 18:44:43.075924 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.075821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:43.076096 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.075889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:43.076096 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.076009    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:43.076096 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.076024    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:43.076096 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.076093    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret podName:3950912b-a457-4769-9d09-a5f1b30f3eec nodeName:}" failed. No retries permitted until 2026-07-17 18:44:44.076068462 +0000 UTC m=+4.070434459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret") pod "global-pull-secret-syncer-fjrb2" (UID: "3950912b-a457-4769-9d09-a5f1b30f3eec") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:43.076343 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.076115    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs podName:77b611d5-c01a-4599-b7d3-406f526c1d4b nodeName:}" failed. No retries permitted until 2026-07-17 18:44:44.076104206 +0000 UTC m=+4.070470201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs") pod "network-metrics-daemon-5cmlj" (UID: "77b611d5-c01a-4599-b7d3-406f526c1d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:43.177314 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.177270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvjh\" (UniqueName: \"kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh\") pod \"network-check-target-4bz9l\" (UID: \"4edccd7e-159b-4909-afe4-42de245cf5f6\") " pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:43.177495 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.177408    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:44:43.177495 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.177437    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:44:43.177495 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.177449    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xxvjh for pod openshift-network-diagnostics/network-check-target-4bz9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:43.177648 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.177508    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh podName:4edccd7e-159b-4909-afe4-42de245cf5f6 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:44.177491901 +0000 UTC m=+4.171857895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxvjh" (UniqueName: "kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh") pod "network-check-target-4bz9l" (UID: "4edccd7e-159b-4909-afe4-42de245cf5f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:43.459912 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.459821    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 18:39:43 +0000 UTC" deadline="2027-12-14 05:20:19.839830428 +0000 UTC"
Jul 17 18:44:43.459912 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.459864    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12346h35m36.379971405s"
Jul 17 18:44:43.480680 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.480641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:43.480680 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.480672    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:43.480962 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.480690    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:43.480962 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.480796    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:44:43.480962 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.480910    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:44:43.481115 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:43.480988    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:44:43.490623 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.490554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" event={"ID":"3d9b4081-ec83-493a-9086-2edad4dea1aa","Type":"ContainerStarted","Data":"5b9fbe3edec34af9277155e52bf33ac0430ab471369488e49d8133ed52111ca9"}
Jul 17 18:44:43.492286 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.492229    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nn2j5" event={"ID":"fea7de92-7c33-4085-99cd-5960f46575ba","Type":"ContainerStarted","Data":"4e715079e2490b47395f0f530c4737f806660a98136ab4bfa57cbeb287e62829"}
Jul 17 18:44:43.493804 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.493774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mgd5c" event={"ID":"adcd2d17-7d84-4e23-a462-095dfca572fa","Type":"ContainerStarted","Data":"c67a9f10056845acc10745352bf7757d7339571b00c1a35258f4948d29874d04"}
Jul 17 18:44:43.496097 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.496066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9" event={"ID":"1c764a1b-0be7-4676-9951-5c8ad7b18ee8","Type":"ContainerStarted","Data":"f45dceafaf99d9af8b2bb4704bcf2219bf3918b83f0ed9ea39d47358262aacd5"}
Jul 17 18:44:43.497632 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.497606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mdt4z" event={"ID":"da80c192-a756-4851-b383-af89b28f3eb2","Type":"ContainerStarted","Data":"d12c88a2cb7e0fe6b9fb5955a9c9b787b32c784855a7f8bbe5e294aa9d9620d9"}
Jul 17 18:44:43.499339 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.499268    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9kkfc" event={"ID":"0b99890e-d27a-4aa7-8c31-b0572eba43dc","Type":"ContainerStarted","Data":"f74595943d6551664968abbb2e7f2ede63c9f1082b2912f7f6bc184318c310be"}
Jul 17 18:44:43.500412 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:43.500390    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ftftv" event={"ID":"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01","Type":"ContainerStarted","Data":"50acedbd7dbcd9f7c80f44524db94cc8878c08be7e52dec6073f86d0fb5fef4d"}
Jul 17 18:44:44.091902 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:44.091815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:44.092089 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:44.092015    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:44.092161 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:44.092102    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs podName:77b611d5-c01a-4599-b7d3-406f526c1d4b nodeName:}" failed. No retries permitted until 2026-07-17 18:44:46.092079867 +0000 UTC m=+6.086445878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs") pod "network-metrics-daemon-5cmlj" (UID: "77b611d5-c01a-4599-b7d3-406f526c1d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:44.092571 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:44.092546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:44.092712 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:44.092695    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:44.092779 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:44.092750    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret podName:3950912b-a457-4769-9d09-a5f1b30f3eec nodeName:}" failed. No retries permitted until 2026-07-17 18:44:46.092734556 +0000 UTC m=+6.087100557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret") pod "global-pull-secret-syncer-fjrb2" (UID: "3950912b-a457-4769-9d09-a5f1b30f3eec") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:44.193953 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:44.193251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvjh\" (UniqueName: \"kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh\") pod \"network-check-target-4bz9l\" (UID: \"4edccd7e-159b-4909-afe4-42de245cf5f6\") " pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:44.193953 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:44.193496    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:44:44.193953 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:44.193522    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:44:44.193953 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:44.193537    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xxvjh for pod openshift-network-diagnostics/network-check-target-4bz9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:44.193953 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:44.193598    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh podName:4edccd7e-159b-4909-afe4-42de245cf5f6 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:46.193579228 +0000 UTC m=+6.187945239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxvjh" (UniqueName: "kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh") pod "network-check-target-4bz9l" (UID: "4edccd7e-159b-4909-afe4-42de245cf5f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:44.460880 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:44.460751    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 18:39:43 +0000 UTC" deadline="2027-12-20 00:18:16.567074668 +0000 UTC"
Jul 17 18:44:44.460880 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:44.460816    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12485h33m32.106263735s"
Jul 17 18:44:44.485118 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:44.485084    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb957346_b831_471f_888d_54604789709a.slice/crio-88edd4f4aa3c438d3a534761e9eb0c4d56b93b9f5679e8c688e8ed458979eb1b WatchSource:0}: Error finding container 88edd4f4aa3c438d3a534761e9eb0c4d56b93b9f5679e8c688e8ed458979eb1b: Status 404 returned error can't find the container with id 88edd4f4aa3c438d3a534761e9eb0c4d56b93b9f5679e8c688e8ed458979eb1b
Jul 17 18:44:44.504708 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:44.504672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5" event={"ID":"db957346-b831-471f-888d-54604789709a","Type":"ContainerStarted","Data":"88edd4f4aa3c438d3a534761e9eb0c4d56b93b9f5679e8c688e8ed458979eb1b"}
Jul 17 18:44:44.512067 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:44:44.512036    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83189e4b_5828_49a1_b477_19a05516e02b.slice/crio-2acfb212a01b06c246bbb336347f9806a55706fa9bebdd8d368a5c6775b429a0 WatchSource:0}: Error finding container 2acfb212a01b06c246bbb336347f9806a55706fa9bebdd8d368a5c6775b429a0: Status 404 returned error can't find the container with id 2acfb212a01b06c246bbb336347f9806a55706fa9bebdd8d368a5c6775b429a0
Jul 17 18:44:45.480331 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:45.479960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:45.480717 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:45.480364    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:44:45.480799 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:45.480719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:45.480855 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:45.480822    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:44:45.480911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:45.480887    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:45.481706 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:45.480958    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:44:45.516443 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:45.516403    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5xnh7" event={"ID":"83189e4b-5828-49a1-b477-19a05516e02b","Type":"ContainerStarted","Data":"2acfb212a01b06c246bbb336347f9806a55706fa9bebdd8d368a5c6775b429a0"}
Jul 17 18:44:45.533581 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:45.533434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal" event={"ID":"f0b6aa9c2776624cde641ff04a58f3d9","Type":"ContainerStarted","Data":"c97d42a70257d79bc35e438e8f89d4a6d58e9d9f8092124e02bebade930bb885"}
Jul 17 18:44:45.547434 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:45.546736    2581 generic.go:356] "Generic (PLEG): container finished" podID="c2a5ff74c2e0abc48546d1716910f233" containerID="0e310c205994ce623f10248e7eed6e8be3611ec8b0c31114df6015c74cfe79b0" exitCode=0
Jul 17 18:44:45.547434 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:45.546812    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal" event={"ID":"c2a5ff74c2e0abc48546d1716910f233","Type":"ContainerDied","Data":"0e310c205994ce623f10248e7eed6e8be3611ec8b0c31114df6015c74cfe79b0"}
Jul 17 18:44:45.562413 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:45.562350    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-97.ec2.internal" podStartSLOduration=3.562328 podStartE2EDuration="3.562328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:44:45.561376925 +0000 UTC m=+5.555742945" watchObservedRunningTime="2026-07-17 18:44:45.562328 +0000 UTC m=+5.556694019"
Jul 17 18:44:46.110687 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:46.110481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:46.110687 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:46.110575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:46.110969 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:46.110745    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:46.110969 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:46.110816    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret podName:3950912b-a457-4769-9d09-a5f1b30f3eec nodeName:}" failed. No retries permitted until 2026-07-17 18:44:50.110794426 +0000 UTC m=+10.105160425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret") pod "global-pull-secret-syncer-fjrb2" (UID: "3950912b-a457-4769-9d09-a5f1b30f3eec") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:46.111288 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:46.111225    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:46.111381 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:46.111304    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs podName:77b611d5-c01a-4599-b7d3-406f526c1d4b nodeName:}" failed. No retries permitted until 2026-07-17 18:44:50.111268082 +0000 UTC m=+10.105634093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs") pod "network-metrics-daemon-5cmlj" (UID: "77b611d5-c01a-4599-b7d3-406f526c1d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:46.211474 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:46.211429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvjh\" (UniqueName: \"kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh\") pod \"network-check-target-4bz9l\" (UID: \"4edccd7e-159b-4909-afe4-42de245cf5f6\") " pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:46.211650 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:46.211616    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:44:46.211650 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:46.211640    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:44:46.211762 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:46.211653    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xxvjh for pod openshift-network-diagnostics/network-check-target-4bz9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:46.211762 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:46.211719    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh podName:4edccd7e-159b-4909-afe4-42de245cf5f6 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:50.211698518 +0000 UTC m=+10.206064534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxvjh" (UniqueName: "kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh") pod "network-check-target-4bz9l" (UID: "4edccd7e-159b-4909-afe4-42de245cf5f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:47.480081 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:47.480042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:47.480594 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:47.480189    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:44:47.480594 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:47.480311    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:47.480594 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:47.480339    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:47.480594 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:47.480432    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:44:47.480594 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:47.480507    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:44:49.481085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:49.481008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:49.481609 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:49.481291    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:44:49.481609 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:49.481378    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:49.481609 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:49.481472    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:44:49.481609 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:49.481523    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:49.481609 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:49.481593    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:44:50.147027 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:50.146983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:50.147285 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:50.147070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:50.147368 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:50.147323    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:50.147424 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:50.147383    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs podName:77b611d5-c01a-4599-b7d3-406f526c1d4b nodeName:}" failed. No retries permitted until 2026-07-17 18:44:58.14736763 +0000 UTC m=+18.141733624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs") pod "network-metrics-daemon-5cmlj" (UID: "77b611d5-c01a-4599-b7d3-406f526c1d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:50.147638 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:50.147606    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:50.147766 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:50.147687    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret podName:3950912b-a457-4769-9d09-a5f1b30f3eec nodeName:}" failed. No retries permitted until 2026-07-17 18:44:58.147669873 +0000 UTC m=+18.142035884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret") pod "global-pull-secret-syncer-fjrb2" (UID: "3950912b-a457-4769-9d09-a5f1b30f3eec") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:50.248158 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:50.248123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvjh\" (UniqueName: \"kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh\") pod \"network-check-target-4bz9l\" (UID: \"4edccd7e-159b-4909-afe4-42de245cf5f6\") " pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:50.248348 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:50.248279    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:44:50.248348 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:50.248294    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:44:50.248348 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:50.248304    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xxvjh for pod openshift-network-diagnostics/network-check-target-4bz9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:50.248483 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:50.248349    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh podName:4edccd7e-159b-4909-afe4-42de245cf5f6 nodeName:}" failed. No retries permitted until 2026-07-17 18:44:58.248335259 +0000 UTC m=+18.242701253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxvjh" (UniqueName: "kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh") pod "network-check-target-4bz9l" (UID: "4edccd7e-159b-4909-afe4-42de245cf5f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:51.481054 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:51.480227    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:51.481054 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:51.480373    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:44:51.481054 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:51.480753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:51.481054 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:51.480865    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:44:51.481054 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:51.480914    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:51.481054 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:51.480990    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:44:53.480522 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:53.480491    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:53.480999 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:53.480532    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:53.480999 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:53.480615    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:53.480999 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:53.480630    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:44:53.480999 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:53.480718    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:44:53.480999 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:53.480780    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:44:55.480374 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:55.480334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:55.480766 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:55.480377    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:55.480766 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:55.480452    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:55.480766 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:55.480478    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:44:55.480766 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:55.480554    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:44:55.480766 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:55.480640    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:44:57.480271 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:57.480233    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:57.480271 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:57.480253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:57.480271 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:57.480259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:57.480867 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:57.480379    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:44:57.480867 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:57.480441    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:44:57.480867 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:57.480539    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:44:58.210755 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:58.210718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:58.210948 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:58.210799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:58.210948 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:58.210914    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:58.211040 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:58.210963    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs podName:77b611d5-c01a-4599-b7d3-406f526c1d4b nodeName:}" failed. No retries permitted until 2026-07-17 18:45:14.210948534 +0000 UTC m=+34.205314527 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs") pod "network-metrics-daemon-5cmlj" (UID: "77b611d5-c01a-4599-b7d3-406f526c1d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:44:58.211294 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:58.211183    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:58.211294 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:58.211274    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret podName:3950912b-a457-4769-9d09-a5f1b30f3eec nodeName:}" failed. No retries permitted until 2026-07-17 18:45:14.211255175 +0000 UTC m=+34.205621187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret") pod "global-pull-secret-syncer-fjrb2" (UID: "3950912b-a457-4769-9d09-a5f1b30f3eec") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:44:58.311678 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:58.311637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvjh\" (UniqueName: \"kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh\") pod \"network-check-target-4bz9l\" (UID: \"4edccd7e-159b-4909-afe4-42de245cf5f6\") " pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:58.311849 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:58.311823    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:44:58.311849 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:58.311847    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:44:58.311937 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:58.311856    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xxvjh for pod openshift-network-diagnostics/network-check-target-4bz9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:58.311937 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:58.311919    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh podName:4edccd7e-159b-4909-afe4-42de245cf5f6 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:14.311901044 +0000 UTC m=+34.306267041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxvjh" (UniqueName: "kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh") pod "network-check-target-4bz9l" (UID: "4edccd7e-159b-4909-afe4-42de245cf5f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:44:59.480109 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:59.480069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:44:59.480572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:59.480086    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:44:59.480572 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:59.480192    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:44:59.480572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:44:59.480225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:44:59.480572 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:59.480284    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:44:59.480572 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:44:59.480370    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:45:01.480640 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:01.480603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:01.481077 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:01.480604    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:01.481077 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:01.480735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:01.481077 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:01.480727    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:45:01.481077 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:01.480832    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:45:01.481077 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:01.480934    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:45:03.480625 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.480328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:03.481372 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.480334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:03.481372 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:03.480727    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:45:03.481372 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.480365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:03.481372 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:03.480801    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:45:03.481372 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:03.480865    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:45:03.584211 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.584116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal" event={"ID":"c2a5ff74c2e0abc48546d1716910f233","Type":"ContainerStarted","Data":"bd3196d0d231dd04be1f384e34fddd090a5a00bfad0809a4ee539d5fe5145c64"}
Jul 17 18:45:03.585611 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.585577    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9kkfc" event={"ID":"0b99890e-d27a-4aa7-8c31-b0572eba43dc","Type":"ContainerStarted","Data":"6f53545c176f42ca7b755a5feef4700761796b1f2054e57b24330e9491e22b51"}
Jul 17 18:45:03.586787 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.586769    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5" event={"ID":"db957346-b831-471f-888d-54604789709a","Type":"ContainerStarted","Data":"1820fc61d3b10337291929830f4b1b73660732d52a1e05a7feac701e49c2d9a5"}
Jul 17 18:45:03.588099 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.588081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ftftv" event={"ID":"f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01","Type":"ContainerStarted","Data":"2af5418b7300c177dd943597b89eac4c18d5c167317d5a40d996fdbb9cfa7f8e"}
Jul 17 18:45:03.589618 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.589599    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d9b4081-ec83-493a-9086-2edad4dea1aa" containerID="f60a7268fef051555d1909fdabc9a89c9dc82f58b4ff0356d5a7684e79ca941f" exitCode=0
Jul 17 18:45:03.589692 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.589657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" event={"ID":"3d9b4081-ec83-493a-9086-2edad4dea1aa","Type":"ContainerDied","Data":"f60a7268fef051555d1909fdabc9a89c9dc82f58b4ff0356d5a7684e79ca941f"}
Jul 17 18:45:03.591171 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.591144    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nn2j5" event={"ID":"fea7de92-7c33-4085-99cd-5960f46575ba","Type":"ContainerStarted","Data":"17bbb376298e0158051ca10ee19228b826b6cab067b5ae50093c33dc8d189917"}
Jul 17 18:45:03.592663 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.592640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mgd5c" event={"ID":"adcd2d17-7d84-4e23-a462-095dfca572fa","Type":"ContainerStarted","Data":"0fab2387fd9204bc892b1a023ca5f4f1629cba2205edd33de09a10f3ea388be5"}
Jul 17 18:45:03.595464 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.595443    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9" event={"ID":"1c764a1b-0be7-4676-9951-5c8ad7b18ee8","Type":"ContainerStarted","Data":"ee4af8ec8af669093b2776af7f7f6ead93e9e8fb324c657cb077dbc2f95af15e"}
Jul 17 18:45:03.595547 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.595498    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9" event={"ID":"1c764a1b-0be7-4676-9951-5c8ad7b18ee8","Type":"ContainerStarted","Data":"5e4b226f95e9e521de955bdde3f1caf401673c082bf912ba8dce442d12f3ef08"}
Jul 17 18:45:03.595547 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.595530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9" event={"ID":"1c764a1b-0be7-4676-9951-5c8ad7b18ee8","Type":"ContainerStarted","Data":"310e80a5d0abff3261cf09ea8e1e5f37740005c2e270a8ec2746c1be05a30290"}
Jul 17 18:45:03.595628 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.595573    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9" event={"ID":"1c764a1b-0be7-4676-9951-5c8ad7b18ee8","Type":"ContainerStarted","Data":"2518e6d99abd46f15a48b8bff0ee2601500df88cfaae73d7ce08f1258b826e4e"}
Jul 17 18:45:03.595628 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.595601    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9" event={"ID":"1c764a1b-0be7-4676-9951-5c8ad7b18ee8","Type":"ContainerStarted","Data":"5a17b91737c46406c215beb9261c1385e62b39c6cdb29d8fc66dc920da133ada"}
Jul 17 18:45:03.595713 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.595643    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9" event={"ID":"1c764a1b-0be7-4676-9951-5c8ad7b18ee8","Type":"ContainerStarted","Data":"9be2efdea0c5bcfc66be4fc77cf1c8075090223c18e26f59cdad00751dbd37bc"}
Jul 17 18:45:03.597242 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.597224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5xnh7" event={"ID":"83189e4b-5828-49a1-b477-19a05516e02b","Type":"ContainerStarted","Data":"07bb03842bf0107853ca7396493c81f78f5843389be2b034be51eb15c34e74d0"}
Jul 17 18:45:03.601605 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.601562    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-97.ec2.internal" podStartSLOduration=21.601552161 podStartE2EDuration="21.601552161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:03.601449845 +0000 UTC m=+23.595815859" watchObservedRunningTime="2026-07-17 18:45:03.601552161 +0000 UTC m=+23.595918175"
Jul 17 18:45:03.618022 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.617979    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ftftv" podStartSLOduration=2.609858941 podStartE2EDuration="22.617965408s" totalImagesPullingTime="20.008106467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:03.617674424 +0000 UTC m=+23.612040461" watchObservedRunningTime="2026-07-17 18:45:03.617965408 +0000 UTC m=+23.612331423"
Jul 17 18:45:03.638498 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.638453    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5xnh7" podStartSLOduration=4.347181054 podStartE2EDuration="22.63844295s" totalImagesPullingTime="18.291261896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:03.638358269 +0000 UTC m=+23.632724296" watchObservedRunningTime="2026-07-17 18:45:03.63844295 +0000 UTC m=+23.632808964"
Jul 17 18:45:03.655831 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.655787    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mgd5c" podStartSLOduration=2.6110160159999998 podStartE2EDuration="22.655769955s" totalImagesPullingTime="20.044753939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:03.655359807 +0000 UTC m=+23.649725821" watchObservedRunningTime="2026-07-17 18:45:03.655769955 +0000 UTC m=+23.650135975"
Jul 17 18:45:03.670434 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.670397    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9kkfc" podStartSLOduration=2.609202477 podStartE2EDuration="22.67038448s" totalImagesPullingTime="20.061182003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:03.67010069 +0000 UTC m=+23.664466702" watchObservedRunningTime="2026-07-17 18:45:03.67038448 +0000 UTC m=+23.664750494"
Jul 17 18:45:03.686325 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:03.686271    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nn2j5" podStartSLOduration=2.652356815 podStartE2EDuration="22.686233295s" totalImagesPullingTime="20.03387648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:03.685565985 +0000 UTC m=+23.679932000" watchObservedRunningTime="2026-07-17 18:45:03.686233295 +0000 UTC m=+23.680599312"
Jul 17 18:45:04.501326 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:04.501265    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 18:45:04.600870 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:04.600828    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5" event={"ID":"db957346-b831-471f-888d-54604789709a","Type":"ContainerStarted","Data":"46d25775b1f83da8cd576ffd7f03a00b72bc2d7601263111ba809f49fc76ffc6"}
Jul 17 18:45:04.602137 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:04.602103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mdt4z" event={"ID":"da80c192-a756-4851-b383-af89b28f3eb2","Type":"ContainerStarted","Data":"473e07f488d570b606d70a02628aab3b8a8446788b48c9cfc2785efd62c7a7cb"}
Jul 17 18:45:04.619135 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:04.619055    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mdt4z" podStartSLOduration=3.60675791 podStartE2EDuration="23.61903927s" totalImagesPullingTime="20.01228136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:04.618910299 +0000 UTC m=+24.613276314" watchObservedRunningTime="2026-07-17 18:45:04.61903927 +0000 UTC m=+24.613405285"
Jul 17 18:45:04.629104 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:04.629076    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:45:04.629696 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:04.629679    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:45:05.429883 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:05.429782    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T18:45:04.501288935Z","UUID":"61532d90-bc53-406d-b429-c532c925f803","Handler":null,"Name":"","Endpoint":""}
Jul 17 18:45:05.433075 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:05.433051    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 18:45:05.433227 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:05.433093    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 18:45:05.480490 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:05.480466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:05.480643 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:05.480477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:05.480643 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:05.480592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:05.480643 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:05.480584    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:45:05.480797 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:05.480684    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:45:05.480797 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:05.480750    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:45:05.604160 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:05.604130    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:45:05.604747 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:05.604722    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9kkfc"
Jul 17 18:45:06.609476 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:06.609428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9" event={"ID":"1c764a1b-0be7-4676-9951-5c8ad7b18ee8","Type":"ContainerStarted","Data":"2d86fa9d80957a15ebdef1242cdd0a45997d540ac2aeb7706d97087ab1a75554"}
Jul 17 18:45:06.611539 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:06.611510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5" event={"ID":"db957346-b831-471f-888d-54604789709a","Type":"ContainerStarted","Data":"7bb69c77937cfd91eeb93b54a9d665e6cd08b3ce67c0ba31fe3417f61184a6d6"}
Jul 17 18:45:07.480874 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:07.480614    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:07.481055 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:07.480647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:07.481055 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:07.480987    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:45:07.481055 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:07.480648    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:07.481055 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:07.481033    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:45:07.481250 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:07.481108    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:45:08.619512 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:08.619476    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9" event={"ID":"1c764a1b-0be7-4676-9951-5c8ad7b18ee8","Type":"ContainerStarted","Data":"4d16281e05ad03e9c577768bcee54f099e97348161af8ca8df4f1e3f2055dcee"}
Jul 17 18:45:08.620213 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:08.619758    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:45:08.620213 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:08.619839    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:45:08.621563 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:08.621543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" event={"ID":"3d9b4081-ec83-493a-9086-2edad4dea1aa","Type":"ContainerStarted","Data":"770ce8de76316c04400d5d642b17084752b745876a9f28ae10bfdb9bb615fb0e"}
Jul 17 18:45:08.637286 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:08.637227    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:45:08.653645 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:08.653479    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9" podStartSLOduration=7.534175728 podStartE2EDuration="27.653464238s" totalImagesPullingTime="20.11928851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:08.651863994 +0000 UTC m=+28.646230011" watchObservedRunningTime="2026-07-17 18:45:08.653464238 +0000 UTC m=+28.647830252"
Jul 17 18:45:08.653751 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:08.653725    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mq6v5" podStartSLOduration=6.854541249 podStartE2EDuration="27.653717773s" totalImagesPullingTime="20.799176524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:06.651855909 +0000 UTC m=+26.646221948" watchObservedRunningTime="2026-07-17 18:45:08.653717773 +0000 UTC m=+28.648083790"
Jul 17 18:45:09.480233 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:09.480025    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:09.480411 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:09.480029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:09.480411 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:09.480314    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:45:09.480496 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:09.480411    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:45:09.480496 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:09.480072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:09.480562 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:09.480525    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:45:09.625702 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:09.625668    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d9b4081-ec83-493a-9086-2edad4dea1aa" containerID="770ce8de76316c04400d5d642b17084752b745876a9f28ae10bfdb9bb615fb0e" exitCode=0
Jul 17 18:45:09.627170 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:09.625761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" event={"ID":"3d9b4081-ec83-493a-9086-2edad4dea1aa","Type":"ContainerDied","Data":"770ce8de76316c04400d5d642b17084752b745876a9f28ae10bfdb9bb615fb0e"}
Jul 17 18:45:09.627170 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:09.626176    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:45:09.643138 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:09.643119    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:45:10.846392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:10.846365    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjrb2"]
Jul 17 18:45:10.846748 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:10.846472    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:10.846748 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:10.846555    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:45:10.850731 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:10.850642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4bz9l"]
Jul 17 18:45:10.850866 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:10.850766    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:10.850913 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:10.850859    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:45:10.851268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:10.851246    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5cmlj"]
Jul 17 18:45:10.851375 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:10.851361    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:10.851503 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:10.851477    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:45:11.632093 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:11.632063    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d9b4081-ec83-493a-9086-2edad4dea1aa" containerID="c24ff8cb715e25f411a80202ed228711e4d2e22fda02a7cf960b5dc0a747b587" exitCode=0
Jul 17 18:45:11.632274 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:11.632140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" event={"ID":"3d9b4081-ec83-493a-9086-2edad4dea1aa","Type":"ContainerDied","Data":"c24ff8cb715e25f411a80202ed228711e4d2e22fda02a7cf960b5dc0a747b587"}
Jul 17 18:45:11.933659 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:11.933627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kkfc_0b99890e-d27a-4aa7-8c31-b0572eba43dc/konnectivity-agent/0.log" limit=1024
Jul 17 18:45:12.034230 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:12.034170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kkfc_0b99890e-d27a-4aa7-8c31-b0572eba43dc/konnectivity-agent/0.log" limit=1024
Jul 17 18:45:12.480837 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:12.480806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:12.481018 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:12.480814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:12.481018 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:12.480809    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:12.481018 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:12.481006    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:45:12.481173 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:12.480947    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:45:12.481173 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:12.481084    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:45:13.641520 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:13.641483    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d9b4081-ec83-493a-9086-2edad4dea1aa" containerID="9627a9334239507f0235cc19ef120e9803d8a11f7a4f5dafef45af6037d04c34" exitCode=0
Jul 17 18:45:13.641876 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:13.641534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" event={"ID":"3d9b4081-ec83-493a-9086-2edad4dea1aa","Type":"ContainerDied","Data":"9627a9334239507f0235cc19ef120e9803d8a11f7a4f5dafef45af6037d04c34"}
Jul 17 18:45:14.229394 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:14.229356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:14.229579 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:14.229428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:14.229579 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.229516    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 18:45:14.229579 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.229541    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:45:14.229579 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.229570    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret podName:3950912b-a457-4769-9d09-a5f1b30f3eec nodeName:}" failed. No retries permitted until 2026-07-17 18:45:46.229556834 +0000 UTC m=+66.223922831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret") pod "global-pull-secret-syncer-fjrb2" (UID: "3950912b-a457-4769-9d09-a5f1b30f3eec") : object "kube-system"/"original-pull-secret" not registered
Jul 17 18:45:14.229776 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.229598    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs podName:77b611d5-c01a-4599-b7d3-406f526c1d4b nodeName:}" failed. No retries permitted until 2026-07-17 18:45:46.229577983 +0000 UTC m=+66.223943990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs") pod "network-metrics-daemon-5cmlj" (UID: "77b611d5-c01a-4599-b7d3-406f526c1d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 18:45:14.330721 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:14.330683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvjh\" (UniqueName: \"kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh\") pod \"network-check-target-4bz9l\" (UID: \"4edccd7e-159b-4909-afe4-42de245cf5f6\") " pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:14.330906 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.330855    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 18:45:14.330906 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.330880    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 18:45:14.330906 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.330892    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xxvjh for pod openshift-network-diagnostics/network-check-target-4bz9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:45:14.331054 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.330959    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh podName:4edccd7e-159b-4909-afe4-42de245cf5f6 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:46.330938973 +0000 UTC m=+66.325304983 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxvjh" (UniqueName: "kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh") pod "network-check-target-4bz9l" (UID: "4edccd7e-159b-4909-afe4-42de245cf5f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 18:45:14.480455 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:14.480375    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:14.480601 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:14.480496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:14.480601 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.480504    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:45:14.480601 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:14.480380    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:14.480749 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.480670    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:45:14.480806 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:14.480758    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:45:16.480844 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.480805    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:16.481293 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.480811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:16.481293 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.480948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:16.481293 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:16.480945    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cmlj" podUID="77b611d5-c01a-4599-b7d3-406f526c1d4b"
Jul 17 18:45:16.481293 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:16.481072    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjrb2" podUID="3950912b-a457-4769-9d09-a5f1b30f3eec"
Jul 17 18:45:16.481293 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:16.481162    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bz9l" podUID="4edccd7e-159b-4909-afe4-42de245cf5f6"
Jul 17 18:45:16.848871 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.848844    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-97.ec2.internal" event="NodeReady"
Jul 17 18:45:16.849046 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.848974    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 18:45:16.904683 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.904641    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df75d5666-dhrbj"]
Jul 17 18:45:16.909553 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.909529    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:16.914038 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.914015    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 18:45:16.914911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.914731    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4m4h7\""
Jul 17 18:45:16.914911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.914785    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 18:45:16.914911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.914854    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 18:45:16.918774 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.918752    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xn4lr"]
Jul 17 18:45:16.922383 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.922363    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:16.923513 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.923497    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wqjbd"]
Jul 17 18:45:16.925529 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.925507    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 18:45:16.926417 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.926404    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zt9vq\""
Jul 17 18:45:16.926517 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.926436    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 18:45:16.926889 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.926871    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wqjbd"
Jul 17 18:45:16.928461 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.928445    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 18:45:16.929961 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.929937    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 18:45:16.930585 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.930562    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 18:45:16.930683 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.930620    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 18:45:16.935332 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.935309    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2pjb8\""
Jul 17 18:45:16.938982 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.938775    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df75d5666-dhrbj"]
Jul 17 18:45:16.938982 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.938859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xn4lr"]
Jul 17 18:45:16.939720 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:16.939702    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wqjbd"]
Jul 17 18:45:17.049826 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.049793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.050014 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.049836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-certificates\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.050014 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.049863    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.050014 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.049911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-ca-trust-extracted\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.050014 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.049938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9mnx\" (UniqueName: \"kubernetes.io/projected/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-kube-api-access-k9mnx\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.050014 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.050001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-image-registry-private-configuration\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.050325 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.050031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da03649e-9174-41e4-ab07-1769081c3209-cert\") pod \"ingress-canary-wqjbd\" (UID: \"da03649e-9174-41e4-ab07-1769081c3209\") " pod="openshift-ingress-canary/ingress-canary-wqjbd"
Jul 17 18:45:17.050325 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.050054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-installation-pull-secrets\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.050325 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.050107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-trusted-ca\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.050325 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.050133    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rndhg\" (UniqueName: \"kubernetes.io/projected/da03649e-9174-41e4-ab07-1769081c3209-kube-api-access-rndhg\") pod \"ingress-canary-wqjbd\" (UID: \"da03649e-9174-41e4-ab07-1769081c3209\") " pod="openshift-ingress-canary/ingress-canary-wqjbd"
Jul 17 18:45:17.050325 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.050151    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-bound-sa-token\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.050325 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.050167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-config-volume\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.050325 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.050184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-tmp-dir\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.050325 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.050246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z5cg\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-kube-api-access-8z5cg\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.151182 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-ca-trust-extracted\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.151358 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9mnx\" (UniqueName: \"kubernetes.io/projected/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-kube-api-access-k9mnx\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.151358 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-image-registry-private-configuration\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.151358 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da03649e-9174-41e4-ab07-1769081c3209-cert\") pod \"ingress-canary-wqjbd\" (UID: \"da03649e-9174-41e4-ab07-1769081c3209\") " pod="openshift-ingress-canary/ingress-canary-wqjbd"
Jul 17 18:45:17.151358 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-installation-pull-secrets\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.151572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-trusted-ca\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.151572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rndhg\" (UniqueName: \"kubernetes.io/projected/da03649e-9174-41e4-ab07-1769081c3209-kube-api-access-rndhg\") pod \"ingress-canary-wqjbd\" (UID: \"da03649e-9174-41e4-ab07-1769081c3209\") " pod="openshift-ingress-canary/ingress-canary-wqjbd"
Jul 17 18:45:17.151572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-bound-sa-token\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.151572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-config-volume\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.151572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151482    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-tmp-dir\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.151572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z5cg\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-kube-api-access-8z5cg\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.151572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.151572 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-certificates\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.151891 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.151891 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.151585    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-ca-trust-extracted\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.152024 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.152005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-certificates\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.152082 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.152020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-config-volume\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.152082 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:17.152074    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:45:17.152171 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.152092    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-tmp-dir\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.152171 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:17.152102    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:45:17.152171 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:17.152120    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df75d5666-dhrbj: secret "image-registry-tls" not found
Jul 17 18:45:17.152347 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:17.152125    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls podName:6eef5af9-ca64-4b9d-ba2a-f92daeac138a nodeName:}" failed. No retries permitted until 2026-07-17 18:45:17.652106729 +0000 UTC m=+37.646472736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls") pod "dns-default-xn4lr" (UID: "6eef5af9-ca64-4b9d-ba2a-f92daeac138a") : secret "dns-default-metrics-tls" not found
Jul 17 18:45:17.152347 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:17.152314    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls podName:19bd80cd-8e56-44b4-9ce3-edb59e4fbe88 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:17.652297159 +0000 UTC m=+37.646663151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls") pod "image-registry-7df75d5666-dhrbj" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88") : secret "image-registry-tls" not found
Jul 17 18:45:17.152973 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.152907    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-trusted-ca\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.156173 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.156153    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-image-registry-private-configuration\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.156277 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.156161    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-installation-pull-secrets\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.156277 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.156218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da03649e-9174-41e4-ab07-1769081c3209-cert\") pod \"ingress-canary-wqjbd\" (UID: \"da03649e-9174-41e4-ab07-1769081c3209\") " pod="openshift-ingress-canary/ingress-canary-wqjbd"
Jul 17 18:45:17.169124 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.169101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9mnx\" (UniqueName: \"kubernetes.io/projected/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-kube-api-access-k9mnx\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.171188 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.171163    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-bound-sa-token\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.171426 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.171404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z5cg\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-kube-api-access-8z5cg\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.172636 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.172619    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rndhg\" (UniqueName: \"kubernetes.io/projected/da03649e-9174-41e4-ab07-1769081c3209-kube-api-access-rndhg\") pod \"ingress-canary-wqjbd\" (UID: \"da03649e-9174-41e4-ab07-1769081c3209\") " pod="openshift-ingress-canary/ingress-canary-wqjbd"
Jul 17 18:45:17.240499 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.240465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wqjbd"
Jul 17 18:45:17.655881 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.655847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:17.656488 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:17.655896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:17.656488 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:17.656003    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:45:17.656488 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:17.656031    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:45:17.656488 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:17.656050    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df75d5666-dhrbj: secret "image-registry-tls" not found
Jul 17 18:45:17.656488 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:17.656062    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls podName:6eef5af9-ca64-4b9d-ba2a-f92daeac138a nodeName:}" failed. No retries permitted until 2026-07-17 18:45:18.656044722 +0000 UTC m=+38.650410716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls") pod "dns-default-xn4lr" (UID: "6eef5af9-ca64-4b9d-ba2a-f92daeac138a") : secret "dns-default-metrics-tls" not found
Jul 17 18:45:17.656488 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:17.656104    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls podName:19bd80cd-8e56-44b4-9ce3-edb59e4fbe88 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:18.65608607 +0000 UTC m=+38.650452063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls") pod "image-registry-7df75d5666-dhrbj" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88") : secret "image-registry-tls" not found
Jul 17 18:45:18.483159 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.482053    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:18.483159 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.482661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:18.484059 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.483436    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:18.485961 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.485740    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 18:45:18.485961 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.485771    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqp7v\""
Jul 17 18:45:18.486786 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.486573    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 18:45:18.486786 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.486612    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ktbms\""
Jul 17 18:45:18.486786 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.486676    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 18:45:18.486786 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.486756    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 18:45:18.519676 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.519613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wqjbd"]
Jul 17 18:45:18.523022 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:45:18.522996    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda03649e_9174_41e4_ab07_1769081c3209.slice/crio-77c88c923315d1630dfa3db476f3ea053c567a8c2a4b70e9809e3d0f8803838c WatchSource:0}: Error finding container 77c88c923315d1630dfa3db476f3ea053c567a8c2a4b70e9809e3d0f8803838c: Status 404 returned error can't find the container with id 77c88c923315d1630dfa3db476f3ea053c567a8c2a4b70e9809e3d0f8803838c
Jul 17 18:45:18.655852 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.655820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" event={"ID":"3d9b4081-ec83-493a-9086-2edad4dea1aa","Type":"ContainerStarted","Data":"3cc56d0d1f8e079b2861ff9ebc144a6aefdd105c3a69e46c64dc364a5681dd4e"}
Jul 17 18:45:18.657492 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.657466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wqjbd" event={"ID":"da03649e-9174-41e4-ab07-1769081c3209","Type":"ContainerStarted","Data":"77c88c923315d1630dfa3db476f3ea053c567a8c2a4b70e9809e3d0f8803838c"}
Jul 17 18:45:18.664320 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.664300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:18.664490 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:18.664470    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:45:18.664552 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:18.664540    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls podName:6eef5af9-ca64-4b9d-ba2a-f92daeac138a nodeName:}" failed. No retries permitted until 2026-07-17 18:45:20.664519163 +0000 UTC m=+40.658885176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls") pod "dns-default-xn4lr" (UID: "6eef5af9-ca64-4b9d-ba2a-f92daeac138a") : secret "dns-default-metrics-tls" not found
Jul 17 18:45:18.664618 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:18.664600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:18.664705 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:18.664694    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:45:18.664738 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:18.664707    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df75d5666-dhrbj: secret "image-registry-tls" not found
Jul 17 18:45:18.664776 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:18.664751    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls podName:19bd80cd-8e56-44b4-9ce3-edb59e4fbe88 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:20.664735412 +0000 UTC m=+40.659101424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls") pod "image-registry-7df75d5666-dhrbj" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88") : secret "image-registry-tls" not found
Jul 17 18:45:19.663385 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:19.663346    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d9b4081-ec83-493a-9086-2edad4dea1aa" containerID="3cc56d0d1f8e079b2861ff9ebc144a6aefdd105c3a69e46c64dc364a5681dd4e" exitCode=0
Jul 17 18:45:19.663877 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:19.663429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" event={"ID":"3d9b4081-ec83-493a-9086-2edad4dea1aa","Type":"ContainerDied","Data":"3cc56d0d1f8e079b2861ff9ebc144a6aefdd105c3a69e46c64dc364a5681dd4e"}
Jul 17 18:45:20.670036 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:20.669999    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d9b4081-ec83-493a-9086-2edad4dea1aa" containerID="2a96cd7b6ba9b89130003d8444b4d130937c48d551b1e209b5a24c656e9ef3ae" exitCode=0
Jul 17 18:45:20.670471 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:20.670089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" event={"ID":"3d9b4081-ec83-493a-9086-2edad4dea1aa","Type":"ContainerDied","Data":"2a96cd7b6ba9b89130003d8444b4d130937c48d551b1e209b5a24c656e9ef3ae"}
Jul 17 18:45:20.682230 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:20.682189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:20.682344 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:20.682270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:20.682401 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:20.682336    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:45:20.682401 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:20.682356    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df75d5666-dhrbj: secret "image-registry-tls" not found
Jul 17 18:45:20.682503 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:20.682411    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls podName:19bd80cd-8e56-44b4-9ce3-edb59e4fbe88 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:24.682391787 +0000 UTC m=+44.676757801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls") pod "image-registry-7df75d5666-dhrbj" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88") : secret "image-registry-tls" not found
Jul 17 18:45:20.682503 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:20.682435    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:45:20.682503 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:20.682492    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls podName:6eef5af9-ca64-4b9d-ba2a-f92daeac138a nodeName:}" failed. No retries permitted until 2026-07-17 18:45:24.682473787 +0000 UTC m=+44.676839797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls") pod "dns-default-xn4lr" (UID: "6eef5af9-ca64-4b9d-ba2a-f92daeac138a") : secret "dns-default-metrics-tls" not found
Jul 17 18:45:21.675649 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:21.675619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" event={"ID":"3d9b4081-ec83-493a-9086-2edad4dea1aa","Type":"ContainerStarted","Data":"6e7af1e8701f84b2d793255a331a7f7ad3ed1a4ce4fd727f2a0de683e2b3f034"}
Jul 17 18:45:21.677037 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:21.677014    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wqjbd" event={"ID":"da03649e-9174-41e4-ab07-1769081c3209","Type":"ContainerStarted","Data":"a8ae530d1564be8a503abf50fb0c5b4a804a3e5374b28631caa3d7e6bb72b56e"}
Jul 17 18:45:21.703992 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:21.703956    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w6h2r" podStartSLOduration=8.980306877 podStartE2EDuration="40.703943786s" totalImagesPullingTime="31.723636909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:21.702745614 +0000 UTC m=+41.697111628" watchObservedRunningTime="2026-07-17 18:45:21.703943786 +0000 UTC m=+41.698309791"
Jul 17 18:45:21.727153 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:21.727105    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wqjbd" podStartSLOduration=3.018576156 podStartE2EDuration="5.72709333s" totalImagesPullingTime="2.708517174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:21.726391388 +0000 UTC m=+41.720757404" watchObservedRunningTime="2026-07-17 18:45:21.72709333 +0000 UTC m=+41.721459421"
Jul 17 18:45:23.475723 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.475688    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d8kxm"]
Jul 17 18:45:23.512082 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.512051    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d8kxm"]
Jul 17 18:45:23.512235 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.512167    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.514763 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.514745    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 18:45:23.514763 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.514751    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 18:45:23.514911 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.514751    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 18:45:23.515448 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.515431    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 18:45:23.515798 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.515786    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-htzm6\""
Jul 17 18:45:23.529745 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.529721    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs"]
Jul 17 18:45:23.550030 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.550011    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs"]
Jul 17 18:45:23.550107 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.550093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs"
Jul 17 18:45:23.552987 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.552970    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-778px\""
Jul 17 18:45:23.553128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.553113    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 17 18:45:23.553673 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.553659    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 17 18:45:23.605151 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.605122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3fb781a-3188-4e0e-b0ab-66086575e954-data-volume\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.605295 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.605155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.605295 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.605285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9f8c\" (UniqueName: \"kubernetes.io/projected/feb6b6c0-5042-45cd-ae72-6605a3ee272b-kube-api-access-r9f8c\") pod \"migrator-7cc9c7ffd7-c5khs\" (UID: \"feb6b6c0-5042-45cd-ae72-6605a3ee272b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs"
Jul 17 18:45:23.605373 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.605327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.605373 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.605369    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3fb781a-3188-4e0e-b0ab-66086575e954-crio-socket\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.605465 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.605395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tkfw\" (UniqueName: \"kubernetes.io/projected/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-api-access-5tkfw\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.706426 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.706401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9f8c\" (UniqueName: \"kubernetes.io/projected/feb6b6c0-5042-45cd-ae72-6605a3ee272b-kube-api-access-r9f8c\") pod \"migrator-7cc9c7ffd7-c5khs\" (UID: \"feb6b6c0-5042-45cd-ae72-6605a3ee272b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs"
Jul 17 18:45:23.706594 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.706447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.706594 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.706474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3fb781a-3188-4e0e-b0ab-66086575e954-crio-socket\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.706594 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.706491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tkfw\" (UniqueName: \"kubernetes.io/projected/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-api-access-5tkfw\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.706594 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.706511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3fb781a-3188-4e0e-b0ab-66086575e954-data-volume\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.706594 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.706565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.706594 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:23.706584    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:45:23.706855 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:23.706660    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 18:45:23.706855 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.706680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3fb781a-3188-4e0e-b0ab-66086575e954-crio-socket\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.706855 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:23.706665    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls podName:b3fb781a-3188-4e0e-b0ab-66086575e954 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:24.206644132 +0000 UTC m=+44.201010147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d8kxm" (UID: "b3fb781a-3188-4e0e-b0ab-66086575e954") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:45:23.706855 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:23.706731    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm podName:b3fb781a-3188-4e0e-b0ab-66086575e954 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:24.206714364 +0000 UTC m=+44.201080370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d8kxm" (UID: "b3fb781a-3188-4e0e-b0ab-66086575e954") : configmap "kube-rbac-proxy" not found
Jul 17 18:45:23.706855 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.706806    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3fb781a-3188-4e0e-b0ab-66086575e954-data-volume\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.721432 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.721406    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tkfw\" (UniqueName: \"kubernetes.io/projected/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-api-access-5tkfw\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:23.721527 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.721483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9f8c\" (UniqueName: \"kubernetes.io/projected/feb6b6c0-5042-45cd-ae72-6605a3ee272b-kube-api-access-r9f8c\") pod \"migrator-7cc9c7ffd7-c5khs\" (UID: \"feb6b6c0-5042-45cd-ae72-6605a3ee272b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs"
Jul 17 18:45:23.858222 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.858136    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs"
Jul 17 18:45:23.997831 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:23.997792    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs"]
Jul 17 18:45:24.000290 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:45:24.000269    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb6b6c0_5042_45cd_ae72_6605a3ee272b.slice/crio-93769aed259ef26c02bcca3e3970dcc0173bb2635e709b84abd834ec12ba5b04 WatchSource:0}: Error finding container 93769aed259ef26c02bcca3e3970dcc0173bb2635e709b84abd834ec12ba5b04: Status 404 returned error can't find the container with id 93769aed259ef26c02bcca3e3970dcc0173bb2635e709b84abd834ec12ba5b04
Jul 17 18:45:24.210362 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:24.210333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:24.210540 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:24.210386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:24.210540 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:24.210461    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 18:45:24.210540 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:24.210488    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:45:24.210540 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:24.210514    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm podName:b3fb781a-3188-4e0e-b0ab-66086575e954 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:25.210500364 +0000 UTC m=+45.204866375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d8kxm" (UID: "b3fb781a-3188-4e0e-b0ab-66086575e954") : configmap "kube-rbac-proxy" not found
Jul 17 18:45:24.210540 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:24.210537    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls podName:b3fb781a-3188-4e0e-b0ab-66086575e954 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:25.210524969 +0000 UTC m=+45.204890962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d8kxm" (UID: "b3fb781a-3188-4e0e-b0ab-66086575e954") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:45:24.686290 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:24.686251    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs" event={"ID":"feb6b6c0-5042-45cd-ae72-6605a3ee272b","Type":"ContainerStarted","Data":"93769aed259ef26c02bcca3e3970dcc0173bb2635e709b84abd834ec12ba5b04"}
Jul 17 18:45:24.713816 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:24.713790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:24.713965 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:24.713829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:24.713965 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:24.713943    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:45:24.713965 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:24.713959    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df75d5666-dhrbj: secret "image-registry-tls" not found
Jul 17 18:45:24.713965 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:24.713958    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:45:24.714084 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:24.714010    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls podName:19bd80cd-8e56-44b4-9ce3-edb59e4fbe88 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:32.713994031 +0000 UTC m=+52.708360024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls") pod "image-registry-7df75d5666-dhrbj" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88") : secret "image-registry-tls" not found
Jul 17 18:45:24.714084 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:24.714021    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls podName:6eef5af9-ca64-4b9d-ba2a-f92daeac138a nodeName:}" failed. No retries permitted until 2026-07-17 18:45:32.714015959 +0000 UTC m=+52.708381952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls") pod "dns-default-xn4lr" (UID: "6eef5af9-ca64-4b9d-ba2a-f92daeac138a") : secret "dns-default-metrics-tls" not found
Jul 17 18:45:24.820436 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:24.820411    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ftftv_f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01/dns-node-resolver/0.log"
Jul 17 18:45:25.219210 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.219174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:25.219376 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.219243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:25.219376 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:25.219335    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 18:45:25.219376 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:25.219349    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:45:25.219556 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:25.219403    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm podName:b3fb781a-3188-4e0e-b0ab-66086575e954 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:27.219386642 +0000 UTC m=+47.213752635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d8kxm" (UID: "b3fb781a-3188-4e0e-b0ab-66086575e954") : configmap "kube-rbac-proxy" not found
Jul 17 18:45:25.219556 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:25.219422    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls podName:b3fb781a-3188-4e0e-b0ab-66086575e954 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:27.219412878 +0000 UTC m=+47.213778874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d8kxm" (UID: "b3fb781a-3188-4e0e-b0ab-66086575e954") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:45:25.290958 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.290931    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-w27kr"]
Jul 17 18:45:25.313366 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.313335    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-w27kr"]
Jul 17 18:45:25.313517 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.313438    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.316743 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.316722    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 17 18:45:25.317136 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.317116    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 17 18:45:25.317738 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.317714    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-d7whw\""
Jul 17 18:45:25.317738 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.317725    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 17 18:45:25.317738 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.317730    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 17 18:45:25.420841 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.420802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nwfn\" (UniqueName: \"kubernetes.io/projected/878df08a-1521-4aaf-b87c-21f231b0496c-kube-api-access-4nwfn\") pod \"service-ca-58598695f7-w27kr\" (UID: \"878df08a-1521-4aaf-b87c-21f231b0496c\") " pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.421019 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.420939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/878df08a-1521-4aaf-b87c-21f231b0496c-signing-key\") pod \"service-ca-58598695f7-w27kr\" (UID: \"878df08a-1521-4aaf-b87c-21f231b0496c\") " pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.421019 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.420966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/878df08a-1521-4aaf-b87c-21f231b0496c-signing-cabundle\") pod \"service-ca-58598695f7-w27kr\" (UID: \"878df08a-1521-4aaf-b87c-21f231b0496c\") " pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.522418 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.522321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/878df08a-1521-4aaf-b87c-21f231b0496c-signing-key\") pod \"service-ca-58598695f7-w27kr\" (UID: \"878df08a-1521-4aaf-b87c-21f231b0496c\") " pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.522418 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.522372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/878df08a-1521-4aaf-b87c-21f231b0496c-signing-cabundle\") pod \"service-ca-58598695f7-w27kr\" (UID: \"878df08a-1521-4aaf-b87c-21f231b0496c\") " pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.522633 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.522475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nwfn\" (UniqueName: \"kubernetes.io/projected/878df08a-1521-4aaf-b87c-21f231b0496c-kube-api-access-4nwfn\") pod \"service-ca-58598695f7-w27kr\" (UID: \"878df08a-1521-4aaf-b87c-21f231b0496c\") " pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.523216 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.523179    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/878df08a-1521-4aaf-b87c-21f231b0496c-signing-cabundle\") pod \"service-ca-58598695f7-w27kr\" (UID: \"878df08a-1521-4aaf-b87c-21f231b0496c\") " pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.525278 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.525256    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/878df08a-1521-4aaf-b87c-21f231b0496c-signing-key\") pod \"service-ca-58598695f7-w27kr\" (UID: \"878df08a-1521-4aaf-b87c-21f231b0496c\") " pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.532146 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.532122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nwfn\" (UniqueName: \"kubernetes.io/projected/878df08a-1521-4aaf-b87c-21f231b0496c-kube-api-access-4nwfn\") pod \"service-ca-58598695f7-w27kr\" (UID: \"878df08a-1521-4aaf-b87c-21f231b0496c\") " pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.622148 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.622103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-w27kr"
Jul 17 18:45:25.837130 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:25.837088    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-w27kr"]
Jul 17 18:45:25.938955 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:45:25.938920    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878df08a_1521_4aaf_b87c_21f231b0496c.slice/crio-5abdbbf03171792c4b373a84d6034cd782dd2f20359dd8fb662cc888e94d3bdd WatchSource:0}: Error finding container 5abdbbf03171792c4b373a84d6034cd782dd2f20359dd8fb662cc888e94d3bdd: Status 404 returned error can't find the container with id 5abdbbf03171792c4b373a84d6034cd782dd2f20359dd8fb662cc888e94d3bdd
Jul 17 18:45:26.021377 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:26.021359    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nn2j5_fea7de92-7c33-4085-99cd-5960f46575ba/node-ca/0.log"
Jul 17 18:45:26.624589 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:26.624552    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wqjbd_da03649e-9174-41e4-ab07-1769081c3209/serve-healthcheck-canary/0.log"
Jul 17 18:45:26.692677 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:26.692635    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-w27kr" event={"ID":"878df08a-1521-4aaf-b87c-21f231b0496c","Type":"ContainerStarted","Data":"5abdbbf03171792c4b373a84d6034cd782dd2f20359dd8fb662cc888e94d3bdd"}
Jul 17 18:45:26.694702 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:26.694670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs" event={"ID":"feb6b6c0-5042-45cd-ae72-6605a3ee272b","Type":"ContainerStarted","Data":"420f6df5c8f65fe6ae0cadc423ae661e18325394b5e603aa8b06f1b28af7da90"}
Jul 17 18:45:26.694840 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:26.694723    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs" event={"ID":"feb6b6c0-5042-45cd-ae72-6605a3ee272b","Type":"ContainerStarted","Data":"9fb6fb32153930977e7887c3a6c49c82a803620a5689ab09213390d78fa300cf"}
Jul 17 18:45:26.722689 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:26.722643    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-c5khs" podStartSLOduration=1.76315825 podStartE2EDuration="3.722630648s" totalImagesPullingTime="1.959472398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:26.721350987 +0000 UTC m=+46.715717000" watchObservedRunningTime="2026-07-17 18:45:26.722630648 +0000 UTC m=+46.716996662"
Jul 17 18:45:27.238671 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:27.238632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:27.239066 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:27.238686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:27.239066 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:27.238786    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:45:27.239066 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:27.238855    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls podName:b3fb781a-3188-4e0e-b0ab-66086575e954 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:31.238839764 +0000 UTC m=+51.233205757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d8kxm" (UID: "b3fb781a-3188-4e0e-b0ab-66086575e954") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:45:27.239232 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:27.239141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fb781a-3188-4e0e-b0ab-66086575e954-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:29.703822 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:29.703781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-w27kr" event={"ID":"878df08a-1521-4aaf-b87c-21f231b0496c","Type":"ContainerStarted","Data":"5c69149031c24692d4b9e74ae4d9d25498fd67e390b130c8cbf138492f7f2d50"}
Jul 17 18:45:29.722582 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:29.722540    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-w27kr" podStartSLOduration=1.6991000550000002 podStartE2EDuration="4.722525313s" totalImagesPullingTime="3.023425258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:29.721513185 +0000 UTC m=+49.715879201" watchObservedRunningTime="2026-07-17 18:45:29.722525313 +0000 UTC m=+49.716891364"
Jul 17 18:45:31.269892 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:31.269852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:31.270394 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:31.270014    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 18:45:31.270394 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:31.270097    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls podName:b3fb781a-3188-4e0e-b0ab-66086575e954 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:39.27007715 +0000 UTC m=+59.264443158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d8kxm" (UID: "b3fb781a-3188-4e0e-b0ab-66086575e954") : secret "insights-runtime-extractor-tls" not found
Jul 17 18:45:32.782361 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:32.782325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:32.782361 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:32.782366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:32.782818 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:32.782486    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 18:45:32.782818 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:32.782505    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df75d5666-dhrbj: secret "image-registry-tls" not found
Jul 17 18:45:32.782818 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:32.782521    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 18:45:32.782818 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:32.782563    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls podName:19bd80cd-8e56-44b4-9ce3-edb59e4fbe88 nodeName:}" failed. No retries permitted until 2026-07-17 18:45:48.782542969 +0000 UTC m=+68.776908977 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls") pod "image-registry-7df75d5666-dhrbj" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88") : secret "image-registry-tls" not found
Jul 17 18:45:32.782818 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:45:32.782581    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls podName:6eef5af9-ca64-4b9d-ba2a-f92daeac138a nodeName:}" failed. No retries permitted until 2026-07-17 18:45:48.782571846 +0000 UTC m=+68.776937845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls") pod "dns-default-xn4lr" (UID: "6eef5af9-ca64-4b9d-ba2a-f92daeac138a") : secret "dns-default-metrics-tls" not found
Jul 17 18:45:39.333271 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:39.333231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:39.335614 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:39.335593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fb781a-3188-4e0e-b0ab-66086575e954-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8kxm\" (UID: \"b3fb781a-3188-4e0e-b0ab-66086575e954\") " pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:39.420761 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:39.420727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d8kxm"
Jul 17 18:45:39.554283 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:39.554254    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d8kxm"]
Jul 17 18:45:39.557472 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:45:39.557447    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3fb781a_3188_4e0e_b0ab_66086575e954.slice/crio-a0952f586576feb44aad6d91231254ce185b3dc7233c0fe777f9763d7fa7c167 WatchSource:0}: Error finding container a0952f586576feb44aad6d91231254ce185b3dc7233c0fe777f9763d7fa7c167: Status 404 returned error can't find the container with id a0952f586576feb44aad6d91231254ce185b3dc7233c0fe777f9763d7fa7c167
Jul 17 18:45:39.729042 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:39.729007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d8kxm" event={"ID":"b3fb781a-3188-4e0e-b0ab-66086575e954","Type":"ContainerStarted","Data":"a0952f586576feb44aad6d91231254ce185b3dc7233c0fe777f9763d7fa7c167"}
Jul 17 18:45:41.649081 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:41.649055    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ftgn9"
Jul 17 18:45:45.748308 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.748259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d8kxm" event={"ID":"b3fb781a-3188-4e0e-b0ab-66086575e954","Type":"ContainerStarted","Data":"0d1a5e17a1a3009c1443013912368360b9f9c4d21e25b91492a7805164907441"}
Jul 17 18:45:45.912673 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.911890    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"]
Jul 17 18:45:45.913829 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.913802    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"]
Jul 17 18:45:45.914069 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.914036    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:45.915589 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.915570    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"]
Jul 17 18:45:45.915755 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.915739    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"
Jul 17 18:45:45.917368 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.917352    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:45.920565 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.920547    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 18:45:45.920792 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.920774    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 18:45:45.921716 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.921692    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 18:45:45.924268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.922161    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 18:45:45.924268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.922695    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 17 18:45:45.924268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.922986    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 18:45:45.924268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.923466    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 17 18:45:45.924268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.923474    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 18:45:45.924268 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.923920    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 18:45:45.926055 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.926030    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-l2t98\""
Jul 17 18:45:45.929888 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.929869    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"]
Jul 17 18:45:45.933782 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.933521    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"]
Jul 17 18:45:45.937756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.937738    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"]
Jul 17 18:45:45.987898 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.987872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:45.988020 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.987920    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb29b136-c088-4e35-b232-61dff5a3fd10-tmp\") pod \"klusterlet-addon-workmgr-77fd4fdd77-2vj2c\" (UID: \"cb29b136-c088-4e35-b232-61dff5a3fd10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:45.988089 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.988067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb7fx\" (UniqueName: \"kubernetes.io/projected/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-kube-api-access-jb7fx\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:45.988146 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.988104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-hub\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:45.988146 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.988131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cb29b136-c088-4e35-b232-61dff5a3fd10-klusterlet-config\") pod \"klusterlet-addon-workmgr-77fd4fdd77-2vj2c\" (UID: \"cb29b136-c088-4e35-b232-61dff5a3fd10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:45.988265 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.988251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:45.988307 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.988286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdtp9\" (UniqueName: \"kubernetes.io/projected/1a86d181-2045-4c1e-b5f3-31fa8819284e-kube-api-access-vdtp9\") pod \"managed-serviceaccount-addon-agent-5785c4799b-qq9dd\" (UID: \"1a86d181-2045-4c1e-b5f3-31fa8819284e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"
Jul 17 18:45:45.988391 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.988320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a86d181-2045-4c1e-b5f3-31fa8819284e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5785c4799b-qq9dd\" (UID: \"1a86d181-2045-4c1e-b5f3-31fa8819284e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"
Jul 17 18:45:45.988391 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.988336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-ca\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:45.988391 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.988370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:45.988606 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:45.988423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj5hm\" (UniqueName: \"kubernetes.io/projected/cb29b136-c088-4e35-b232-61dff5a3fd10-kube-api-access-fj5hm\") pod \"klusterlet-addon-workmgr-77fd4fdd77-2vj2c\" (UID: \"cb29b136-c088-4e35-b232-61dff5a3fd10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:46.088934 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.088865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.088934 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.088913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb29b136-c088-4e35-b232-61dff5a3fd10-tmp\") pod \"klusterlet-addon-workmgr-77fd4fdd77-2vj2c\" (UID: \"cb29b136-c088-4e35-b232-61dff5a3fd10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:46.089128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.088990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb7fx\" (UniqueName: \"kubernetes.io/projected/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-kube-api-access-jb7fx\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.089128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.089018    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-hub\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.089128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.089035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cb29b136-c088-4e35-b232-61dff5a3fd10-klusterlet-config\") pod \"klusterlet-addon-workmgr-77fd4fdd77-2vj2c\" (UID: \"cb29b136-c088-4e35-b232-61dff5a3fd10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:46.089128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.089060    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.089128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.089081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdtp9\" (UniqueName: \"kubernetes.io/projected/1a86d181-2045-4c1e-b5f3-31fa8819284e-kube-api-access-vdtp9\") pod \"managed-serviceaccount-addon-agent-5785c4799b-qq9dd\" (UID: \"1a86d181-2045-4c1e-b5f3-31fa8819284e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"
Jul 17 18:45:46.089128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.089122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a86d181-2045-4c1e-b5f3-31fa8819284e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5785c4799b-qq9dd\" (UID: \"1a86d181-2045-4c1e-b5f3-31fa8819284e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"
Jul 17 18:45:46.089463 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.089144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-ca\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.089463 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.089181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.089463 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.089219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj5hm\" (UniqueName: \"kubernetes.io/projected/cb29b136-c088-4e35-b232-61dff5a3fd10-kube-api-access-fj5hm\") pod \"klusterlet-addon-workmgr-77fd4fdd77-2vj2c\" (UID: \"cb29b136-c088-4e35-b232-61dff5a3fd10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:46.090304 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.089761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.090304 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.089838    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb29b136-c088-4e35-b232-61dff5a3fd10-tmp\") pod \"klusterlet-addon-workmgr-77fd4fdd77-2vj2c\" (UID: \"cb29b136-c088-4e35-b232-61dff5a3fd10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:46.093078 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.093052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.093394 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.093370    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-hub\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.093525 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.093502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.093632 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.093554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-ca\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.093833 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.093813    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cb29b136-c088-4e35-b232-61dff5a3fd10-klusterlet-config\") pod \"klusterlet-addon-workmgr-77fd4fdd77-2vj2c\" (UID: \"cb29b136-c088-4e35-b232-61dff5a3fd10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:46.094333 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.094314    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a86d181-2045-4c1e-b5f3-31fa8819284e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5785c4799b-qq9dd\" (UID: \"1a86d181-2045-4c1e-b5f3-31fa8819284e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"
Jul 17 18:45:46.125868 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.125841    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdtp9\" (UniqueName: \"kubernetes.io/projected/1a86d181-2045-4c1e-b5f3-31fa8819284e-kube-api-access-vdtp9\") pod \"managed-serviceaccount-addon-agent-5785c4799b-qq9dd\" (UID: \"1a86d181-2045-4c1e-b5f3-31fa8819284e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"
Jul 17 18:45:46.129186 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.129167    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj5hm\" (UniqueName: \"kubernetes.io/projected/cb29b136-c088-4e35-b232-61dff5a3fd10-kube-api-access-fj5hm\") pod \"klusterlet-addon-workmgr-77fd4fdd77-2vj2c\" (UID: \"cb29b136-c088-4e35-b232-61dff5a3fd10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:46.130693 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.130671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb7fx\" (UniqueName: \"kubernetes.io/projected/2dc18809-9d61-44f9-b6bd-8f52e6d1291a-kube-api-access-jb7fx\") pod \"cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp\" (UID: \"2dc18809-9d61-44f9-b6bd-8f52e6d1291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.230160 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.230134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:45:46.249996 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.249963    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"
Jul 17 18:45:46.256550 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.256524    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"
Jul 17 18:45:46.293229 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.291681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:46.293229 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.291743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:46.297095 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.296616    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 18:45:46.297095 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.296894    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 18:45:46.305026 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.304990    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77b611d5-c01a-4599-b7d3-406f526c1d4b-metrics-certs\") pod \"network-metrics-daemon-5cmlj\" (UID: \"77b611d5-c01a-4599-b7d3-406f526c1d4b\") " pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:46.311261 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.308872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3950912b-a457-4769-9d09-a5f1b30f3eec-original-pull-secret\") pod \"global-pull-secret-syncer-fjrb2\" (UID: \"3950912b-a457-4769-9d09-a5f1b30f3eec\") " pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:46.393099 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.392982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvjh\" (UniqueName: \"kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh\") pod \"network-check-target-4bz9l\" (UID: \"4edccd7e-159b-4909-afe4-42de245cf5f6\") " pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:46.396061 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.396016    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 18:45:46.401625 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.401586    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqp7v\""
Jul 17 18:45:46.403754 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.403730    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"]
Jul 17 18:45:46.407156 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.407085    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjrb2"
Jul 17 18:45:46.407525 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.407487    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 18:45:46.408877 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.408858    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cmlj"
Jul 17 18:45:46.416622 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.416601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxvjh\" (UniqueName: \"kubernetes.io/projected/4edccd7e-159b-4909-afe4-42de245cf5f6-kube-api-access-xxvjh\") pod \"network-check-target-4bz9l\" (UID: \"4edccd7e-159b-4909-afe4-42de245cf5f6\") " pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:46.425158 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.425128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd"]
Jul 17 18:45:46.431894 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.431879    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ktbms\""
Jul 17 18:45:46.439297 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.439263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:45:46.448742 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:46.448719    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp"]
Jul 17 18:45:47.570023 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:45:47.569992    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dc18809_9d61_44f9_b6bd_8f52e6d1291a.slice/crio-a9a0a162e390558c6f1b5ef8a0613f565490c129102834577a43de7b9f86e01d WatchSource:0}: Error finding container a9a0a162e390558c6f1b5ef8a0613f565490c129102834577a43de7b9f86e01d: Status 404 returned error can't find the container with id a9a0a162e390558c6f1b5ef8a0613f565490c129102834577a43de7b9f86e01d
Jul 17 18:45:47.607358 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:45:47.607326    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb29b136_c088_4e35_b232_61dff5a3fd10.slice/crio-9aca017457ffd1089fdd3c24c3dd3e39c983007d7d9e03edb42dce7cd2add23a WatchSource:0}: Error finding container 9aca017457ffd1089fdd3c24c3dd3e39c983007d7d9e03edb42dce7cd2add23a: Status 404 returned error can't find the container with id 9aca017457ffd1089fdd3c24c3dd3e39c983007d7d9e03edb42dce7cd2add23a
Jul 17 18:45:47.607703 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:45:47.607681    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a86d181_2045_4c1e_b5f3_31fa8819284e.slice/crio-78d679fc9cb8abf27b40510b35fdef3d3db0ccad643b0f7d9ab14fa1cbc6774a WatchSource:0}: Error finding container 78d679fc9cb8abf27b40510b35fdef3d3db0ccad643b0f7d9ab14fa1cbc6774a: Status 404 returned error can't find the container with id 78d679fc9cb8abf27b40510b35fdef3d3db0ccad643b0f7d9ab14fa1cbc6774a
Jul 17 18:45:47.756410 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:47.756372    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd" event={"ID":"1a86d181-2045-4c1e-b5f3-31fa8819284e","Type":"ContainerStarted","Data":"78d679fc9cb8abf27b40510b35fdef3d3db0ccad643b0f7d9ab14fa1cbc6774a"}
Jul 17 18:45:47.758258 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:47.758215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp" event={"ID":"2dc18809-9d61-44f9-b6bd-8f52e6d1291a","Type":"ContainerStarted","Data":"a9a0a162e390558c6f1b5ef8a0613f565490c129102834577a43de7b9f86e01d"}
Jul 17 18:45:47.759577 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:47.759546    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c" event={"ID":"cb29b136-c088-4e35-b232-61dff5a3fd10","Type":"ContainerStarted","Data":"9aca017457ffd1089fdd3c24c3dd3e39c983007d7d9e03edb42dce7cd2add23a"}
Jul 17 18:45:48.315968 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.315933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5cmlj"]
Jul 17 18:45:48.321710 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:45:48.321672    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b611d5_c01a_4599_b7d3_406f526c1d4b.slice/crio-9391982f2bcfa6179441245c2846564b87b8c2cdacbb5132a2028d98a2e2ce6e WatchSource:0}: Error finding container 9391982f2bcfa6179441245c2846564b87b8c2cdacbb5132a2028d98a2e2ce6e: Status 404 returned error can't find the container with id 9391982f2bcfa6179441245c2846564b87b8c2cdacbb5132a2028d98a2e2ce6e
Jul 17 18:45:48.466743 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.465557    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjrb2"]
Jul 17 18:45:48.496615 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.496438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4bz9l"]
Jul 17 18:45:48.501288 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:45:48.501249    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4edccd7e_159b_4909_afe4_42de245cf5f6.slice/crio-9ff8d6b0fa7ca5625f60fae3a35319420447c2f7abd0a7dd79ddf5ced36925a7 WatchSource:0}: Error finding container 9ff8d6b0fa7ca5625f60fae3a35319420447c2f7abd0a7dd79ddf5ced36925a7: Status 404 returned error can't find the container with id 9ff8d6b0fa7ca5625f60fae3a35319420447c2f7abd0a7dd79ddf5ced36925a7
Jul 17 18:45:48.767278 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.767130    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5cmlj" event={"ID":"77b611d5-c01a-4599-b7d3-406f526c1d4b","Type":"ContainerStarted","Data":"9391982f2bcfa6179441245c2846564b87b8c2cdacbb5132a2028d98a2e2ce6e"}
Jul 17 18:45:48.769916 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.769863    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d8kxm" event={"ID":"b3fb781a-3188-4e0e-b0ab-66086575e954","Type":"ContainerStarted","Data":"846669b5602a8241aafb28561f8ee20682ba3ae6e6e1c7b585d48229e55551a3"}
Jul 17 18:45:48.771522 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.771495    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4bz9l" event={"ID":"4edccd7e-159b-4909-afe4-42de245cf5f6","Type":"ContainerStarted","Data":"9ff8d6b0fa7ca5625f60fae3a35319420447c2f7abd0a7dd79ddf5ced36925a7"}
Jul 17 18:45:48.775575 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.775515    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjrb2" event={"ID":"3950912b-a457-4769-9d09-a5f1b30f3eec","Type":"ContainerStarted","Data":"dfdc8ed3ca44d53115edfac2f708e0c7c1bac69a8dd3f9b729e0c53823fbe7ac"}
Jul 17 18:45:48.820262 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.819591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:48.820262 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.819696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:48.833530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.833459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eef5af9-ca64-4b9d-ba2a-f92daeac138a-metrics-tls\") pod \"dns-default-xn4lr\" (UID: \"6eef5af9-ca64-4b9d-ba2a-f92daeac138a\") " pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:48.833530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:48.833468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") pod \"image-registry-7df75d5666-dhrbj\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") " pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:49.026372 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:49.026064    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4m4h7\""
Jul 17 18:45:49.032817 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:49.032528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:49.036934 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:49.036614    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zt9vq\""
Jul 17 18:45:49.044224 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:49.044182    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:45:49.258926 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:49.258892    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df75d5666-dhrbj"]
Jul 17 18:45:49.262723 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:45:49.262684    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19bd80cd_8e56_44b4_9ce3_edb59e4fbe88.slice/crio-90d1cadd80a119b0b57b4ec925f1f2fb52c6e1aee0244465f3fd0440ef898caa WatchSource:0}: Error finding container 90d1cadd80a119b0b57b4ec925f1f2fb52c6e1aee0244465f3fd0440ef898caa: Status 404 returned error can't find the container with id 90d1cadd80a119b0b57b4ec925f1f2fb52c6e1aee0244465f3fd0440ef898caa
Jul 17 18:45:49.309192 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:49.309161    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xn4lr"]
Jul 17 18:45:49.786717 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:49.785812    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj" event={"ID":"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88","Type":"ContainerStarted","Data":"8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab"}
Jul 17 18:45:49.786717 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:49.785878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj" event={"ID":"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88","Type":"ContainerStarted","Data":"90d1cadd80a119b0b57b4ec925f1f2fb52c6e1aee0244465f3fd0440ef898caa"}
Jul 17 18:45:49.786717 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:49.786659    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:45:49.799301 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:45:49.799222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xn4lr" event={"ID":"6eef5af9-ca64-4b9d-ba2a-f92daeac138a","Type":"ContainerStarted","Data":"6f16337ebb3512ee437807146b07c41143569c18cc0c9169d560a2a168217501"}
Jul 17 18:46:00.848509 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.848418    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4bz9l" event={"ID":"4edccd7e-159b-4909-afe4-42de245cf5f6","Type":"ContainerStarted","Data":"45bf745d0802c8f0ddfc53e1085191355d001bd37ac4450a6d0899d31b8eeb5f"}
Jul 17 18:46:00.848925 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.848524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:46:00.849848 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.849825    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjrb2" event={"ID":"3950912b-a457-4769-9d09-a5f1b30f3eec","Type":"ContainerStarted","Data":"14265c52e259f33a8591b454a42c83fb706db8893c9a07198f0bd6d118dfb68d"}
Jul 17 18:46:00.851688 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.851669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5cmlj" event={"ID":"77b611d5-c01a-4599-b7d3-406f526c1d4b","Type":"ContainerStarted","Data":"573c9ca9ae1fcb69a06652d5f584701114eefa95c7db869f5c6694c6af64a285"}
Jul 17 18:46:00.851773 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.851704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5cmlj" event={"ID":"77b611d5-c01a-4599-b7d3-406f526c1d4b","Type":"ContainerStarted","Data":"f9bfc2690e9a46e3d4d82aafa12944de947f1ca8e42054c1f7fcdf1408f55378"}
Jul 17 18:46:00.853762 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.853733    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d8kxm" event={"ID":"b3fb781a-3188-4e0e-b0ab-66086575e954","Type":"ContainerStarted","Data":"1863c2ef8f5ad25217b2d032b790c492f2615229aa95c50a9c1bf827b1f4f219"}
Jul 17 18:46:00.855123 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.855104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd" event={"ID":"1a86d181-2045-4c1e-b5f3-31fa8819284e","Type":"ContainerStarted","Data":"b64265cff5331c095721286e7ae2c1152803abb64f2f7e9c3460fd8412bf0d51"}
Jul 17 18:46:00.857075 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.857052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp" event={"ID":"2dc18809-9d61-44f9-b6bd-8f52e6d1291a","Type":"ContainerStarted","Data":"1a510472c8d2015875b109a8dd171272be552521e4b23192d210270e176fa727"}
Jul 17 18:46:00.857155 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.857086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp" event={"ID":"2dc18809-9d61-44f9-b6bd-8f52e6d1291a","Type":"ContainerStarted","Data":"a0562e2ffb17c59941f4ad27e8c022e191439e1274d11ae71f21fa0cf2ac780a"}
Jul 17 18:46:00.857155 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.857103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp" event={"ID":"2dc18809-9d61-44f9-b6bd-8f52e6d1291a","Type":"ContainerStarted","Data":"ebc89c967231d0b7831166c1821178e6f71b0793591964a333c4ea72d608500a"}
Jul 17 18:46:00.858373 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.858356    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c" event={"ID":"cb29b136-c088-4e35-b232-61dff5a3fd10","Type":"ContainerStarted","Data":"cb477fd7ff0f718db46ad23e8a8ce5734a2df0cd472ad84bf7b434ca7ed225c6"}
Jul 17 18:46:00.858455 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.858398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:46:00.860077 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.860046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xn4lr" event={"ID":"6eef5af9-ca64-4b9d-ba2a-f92daeac138a","Type":"ContainerStarted","Data":"0419fa92b4a8cefa0f97907a82ed87cbc15aaf9a39c1dacf2e67486d4aec78fa"}
Jul 17 18:46:00.860142 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.860087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xn4lr" event={"ID":"6eef5af9-ca64-4b9d-ba2a-f92daeac138a","Type":"ContainerStarted","Data":"8d03a867f2481de1c73b468a544c5961cd22c51e6973284c25ea8b774c52ba92"}
Jul 17 18:46:00.860252 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.860239    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c"
Jul 17 18:46:00.860294 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.860268    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:46:00.868333 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.868298    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj" podStartSLOduration=72.868285758 podStartE2EDuration="1m12.868285758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:45:49.812492789 +0000 UTC m=+69.806858807" watchObservedRunningTime="2026-07-17 18:46:00.868285758 +0000 UTC m=+80.862651772"
Jul 17 18:46:00.868440 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.868422    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4bz9l" podStartSLOduration=67.994105283 podStartE2EDuration="1m19.868417069s" totalImagesPullingTime="11.874311786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:00.86682583 +0000 UTC m=+80.861191845" watchObservedRunningTime="2026-07-17 18:46:00.868417069 +0000 UTC m=+80.862783062"
Jul 17 18:46:00.889694 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.889653    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xn4lr" podStartSLOduration=33.839410496 podStartE2EDuration="44.889640011s" totalImagesPullingTime="11.050229515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:00.889301726 +0000 UTC m=+80.883667741" watchObservedRunningTime="2026-07-17 18:46:00.889640011 +0000 UTC m=+80.884006026"
Jul 17 18:46:00.935848 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.935803    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d8kxm" podStartSLOduration=17.290768671 podStartE2EDuration="37.935785884s" totalImagesPullingTime="20.645017213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:45:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:00.912870469 +0000 UTC m=+80.907236485" watchObservedRunningTime="2026-07-17 18:46:00.935785884 +0000 UTC m=+80.930151901"
Jul 17 18:46:00.936527 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.936492    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5cmlj" podStartSLOduration=67.90113994 podStartE2EDuration="1m19.936480631s" totalImagesPullingTime="12.035340691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:00.93425254 +0000 UTC m=+80.928618554" watchObservedRunningTime="2026-07-17 18:46:00.936480631 +0000 UTC m=+80.930846648"
Jul 17 18:46:00.956549 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.956501    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77fd4fdd77-2vj2c" podStartSLOduration=3.166015144 podStartE2EDuration="15.956488339s" totalImagesPullingTime="12.790473195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:00.955776008 +0000 UTC m=+80.950142022" watchObservedRunningTime="2026-07-17 18:46:00.956488339 +0000 UTC m=+80.950854353"
Jul 17 18:46:00.974296 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:00.974249    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5785c4799b-qq9dd" podStartSLOduration=3.209375923 podStartE2EDuration="15.974233747s" totalImagesPullingTime="12.764857824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:00.972307519 +0000 UTC m=+80.966673535" watchObservedRunningTime="2026-07-17 18:46:00.974233747 +0000 UTC m=+80.968599811"
Jul 17 18:46:01.003513 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:01.003474    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b79f9fcc4-cwrpp" podStartSLOduration=3.180612596 podStartE2EDuration="16.003460467s" totalImagesPullingTime="12.822847871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:01.001994594 +0000 UTC m=+80.996360608" watchObservedRunningTime="2026-07-17 18:46:01.003460467 +0000 UTC m=+80.997826481"
Jul 17 18:46:01.028898 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:01.028637    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fjrb2" podStartSLOduration=68.090839796 podStartE2EDuration="1m20.028621393s" totalImagesPullingTime="11.937781597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:01.028448798 +0000 UTC m=+81.022814812" watchObservedRunningTime="2026-07-17 18:46:01.028621393 +0000 UTC m=+81.022987409"
Jul 17 18:46:09.037237 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:09.037183    2581 patch_prober.go:28] interesting pod/image-registry-7df75d5666-dhrbj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 17 18:46:09.037697 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:09.037265    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj" podUID="19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 18:46:09.269538 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:09.269503    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df75d5666-dhrbj"]
Jul 17 18:46:09.273939 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:09.273897    2581 patch_prober.go:28] interesting pod/image-registry-7df75d5666-dhrbj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 17 18:46:09.274079 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:09.273956    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj" podUID="19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 18:46:10.867415 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:10.867388    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xn4lr"
Jul 17 18:46:17.738780 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:17.738744    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fntx7"]
Jul 17 18:46:18.109933 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.109857    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.114129 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.113962    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 18:46:18.114129 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.113994    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 18:46:18.114129 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.114008    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 18:46:18.114129 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.114021    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 18:46:18.114129 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.114054    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 18:46:18.114129 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.114097    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 18:46:18.114446 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.114349    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p9fbf\""
Jul 17 18:46:18.153996 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.153966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4f3abf3-cf58-4820-81e6-d165979a05e7-sys\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.153996 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.153997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.154235 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.154017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-textfile\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.154235 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.154033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.154235 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.154138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4f3abf3-cf58-4820-81e6-d165979a05e7-metrics-client-ca\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.154235 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.154182    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-wtmp\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.154430 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.154240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-tls\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.154430 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.154269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4f3abf3-cf58-4820-81e6-d165979a05e7-root\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.154430 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.154308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5vfk\" (UniqueName: \"kubernetes.io/projected/a4f3abf3-cf58-4820-81e6-d165979a05e7-kube-api-access-p5vfk\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255371 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4f3abf3-cf58-4820-81e6-d165979a05e7-sys\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255532 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255532 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-textfile\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255532 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255532 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4f3abf3-cf58-4820-81e6-d165979a05e7-metrics-client-ca\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255532 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4f3abf3-cf58-4820-81e6-d165979a05e7-sys\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255532 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-wtmp\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255836 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-tls\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255836 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4f3abf3-cf58-4820-81e6-d165979a05e7-root\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255836 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-wtmp\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255836 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vfk\" (UniqueName: \"kubernetes.io/projected/a4f3abf3-cf58-4820-81e6-d165979a05e7-kube-api-access-p5vfk\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255836 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255670    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4f3abf3-cf58-4820-81e6-d165979a05e7-root\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.255836 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.255755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-textfile\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.256129 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.256037    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4f3abf3-cf58-4820-81e6-d165979a05e7-metrics-client-ca\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.256184 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.256143    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.258546 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.258524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-tls\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.258633 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.258545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4f3abf3-cf58-4820-81e6-d165979a05e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.268950 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.268932    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5vfk\" (UniqueName: \"kubernetes.io/projected/a4f3abf3-cf58-4820-81e6-d165979a05e7-kube-api-access-p5vfk\") pod \"node-exporter-fntx7\" (UID: \"a4f3abf3-cf58-4820-81e6-d165979a05e7\") " pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.421784 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.421746    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fntx7"
Jul 17 18:46:18.455182 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:46:18.455159    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f3abf3_cf58_4820_81e6_d165979a05e7.slice/crio-68a6310683df7163fa7a4d10b1ac5dc462b168c9513dc0be3bc419f66c49f0c6 WatchSource:0}: Error finding container 68a6310683df7163fa7a4d10b1ac5dc462b168c9513dc0be3bc419f66c49f0c6: Status 404 returned error can't find the container with id 68a6310683df7163fa7a4d10b1ac5dc462b168c9513dc0be3bc419f66c49f0c6
Jul 17 18:46:18.931173 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:18.931134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fntx7" event={"ID":"a4f3abf3-cf58-4820-81e6-d165979a05e7","Type":"ContainerStarted","Data":"68a6310683df7163fa7a4d10b1ac5dc462b168c9513dc0be3bc419f66c49f0c6"}
Jul 17 18:46:19.275849 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:19.275776    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:46:19.936752 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:19.936713    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fntx7" event={"ID":"a4f3abf3-cf58-4820-81e6-d165979a05e7","Type":"ContainerStarted","Data":"1f74c39da7f606cdc4ebd24f98cdefe4660ae440efd5d189910406c990e17b19"}
Jul 17 18:46:20.941469 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:20.941422    2581 generic.go:356] "Generic (PLEG): container finished" podID="a4f3abf3-cf58-4820-81e6-d165979a05e7" containerID="1f74c39da7f606cdc4ebd24f98cdefe4660ae440efd5d189910406c990e17b19" exitCode=0
Jul 17 18:46:20.941856 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:20.941505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fntx7" event={"ID":"a4f3abf3-cf58-4820-81e6-d165979a05e7","Type":"ContainerDied","Data":"1f74c39da7f606cdc4ebd24f98cdefe4660ae440efd5d189910406c990e17b19"}
Jul 17 18:46:21.947751 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:21.947716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fntx7" event={"ID":"a4f3abf3-cf58-4820-81e6-d165979a05e7","Type":"ContainerStarted","Data":"cadc0051fa9197fa8fdd9eb1f1b0b946f265a3bf2822d8e567be17cf044c59d2"}
Jul 17 18:46:21.948134 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:21.947768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fntx7" event={"ID":"a4f3abf3-cf58-4820-81e6-d165979a05e7","Type":"ContainerStarted","Data":"66d1f9e7995c9e3b9b9f7d5b113e9a17e1a743cc67161b9aada6fbf09e48b3c7"}
Jul 17 18:46:21.998060 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:21.998009    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fntx7" podStartSLOduration=3.610697057 podStartE2EDuration="4.997993677s" totalImagesPullingTime="1.287362127s" totalInitContainerRuntime="99.934493ms" isStatefulPod=true podCreationTimestamp="2026-07-17 18:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:46:21.997427533 +0000 UTC m=+101.991793549" watchObservedRunningTime="2026-07-17 18:46:21.997993677 +0000 UTC m=+101.992359691"
Jul 17 18:46:31.866255 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:31.866227    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4bz9l"
Jul 17 18:46:34.289611 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.289564    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj" podUID="19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" containerName="registry" containerID="cri-o://8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab" gracePeriod=30
Jul 17 18:46:34.537279 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.537254    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:46:34.572025 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.571961    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-certificates\") pod \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") "
Jul 17 18:46:34.572025 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.571996    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-installation-pull-secrets\") pod \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") "
Jul 17 18:46:34.572241 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.572037    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-ca-trust-extracted\") pod \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") "
Jul 17 18:46:34.572241 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.572077    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z5cg\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-kube-api-access-8z5cg\") pod \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") "
Jul 17 18:46:34.572241 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.572129    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") pod \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") "
Jul 17 18:46:34.572241 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.572182    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-image-registry-private-configuration\") pod \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") "
Jul 17 18:46:34.572450 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.572263    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-trusted-ca\") pod \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") "
Jul 17 18:46:34.572450 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.572310    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-bound-sa-token\") pod \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\" (UID: \"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88\") "
Jul 17 18:46:34.572450 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.572373    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:46:34.572648 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.572537    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-certificates\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:46:34.573279 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.573251    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:46:34.575140 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.575096    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:46:34.575292 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.575264    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:46:34.575361 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.575284    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-kube-api-access-8z5cg" (OuterVolumeSpecName: "kube-api-access-8z5cg") pod "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88"). InnerVolumeSpecName "kube-api-access-8z5cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:46:34.575434 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.575412    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:46:34.575534 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.575511    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:46:34.582060 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.582031    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" (UID: "19bd80cd-8e56-44b4-9ce3-edb59e4fbe88"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:46:34.672844 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.672815    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-trusted-ca\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:46:34.672844 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.672839    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-bound-sa-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:46:34.672844 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.672847    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-installation-pull-secrets\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:46:34.673039 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.672858    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-ca-trust-extracted\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:46:34.673039 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.672866    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z5cg\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-kube-api-access-8z5cg\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:46:34.673039 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.672874    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-registry-tls\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:46:34.673039 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.672884    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88-image-registry-private-configuration\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:46:34.994103 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.994067    2581 generic.go:356] "Generic (PLEG): container finished" podID="19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" containerID="8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab" exitCode=0
Jul 17 18:46:34.994291 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.994114    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj"
Jul 17 18:46:34.994291 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.994151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj" event={"ID":"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88","Type":"ContainerDied","Data":"8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab"}
Jul 17 18:46:34.994291 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.994221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df75d5666-dhrbj" event={"ID":"19bd80cd-8e56-44b4-9ce3-edb59e4fbe88","Type":"ContainerDied","Data":"90d1cadd80a119b0b57b4ec925f1f2fb52c6e1aee0244465f3fd0440ef898caa"}
Jul 17 18:46:34.994291 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:34.994244    2581 scope.go:117] "RemoveContainer" containerID="8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab"
Jul 17 18:46:35.002987 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:35.002968    2581 scope.go:117] "RemoveContainer" containerID="8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab"
Jul 17 18:46:35.003233 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:46:35.003193    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab\": container with ID starting with 8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab not found: ID does not exist" containerID="8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab"
Jul 17 18:46:35.003294 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:35.003245    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab"} err="failed to get container status \"8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab\": rpc error: code = NotFound desc = could not find container \"8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab\": container with ID starting with 8aa1516479b2f932dcad2f6ca7ea3431b080e9495aa0673608b0ee60a6ecb6ab not found: ID does not exist"
Jul 17 18:46:35.022084 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:35.022056    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df75d5666-dhrbj"]
Jul 17 18:46:35.039421 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:35.039401    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7df75d5666-dhrbj"]
Jul 17 18:46:36.486169 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:46:36.486136    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" path="/var/lib/kubelet/pods/19bd80cd-8e56-44b4-9ce3-edb59e4fbe88/volumes"
Jul 17 18:49:40.375316 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:49:40.375285    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 18:51:08.812006 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.811969    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"]
Jul 17 18:51:08.812497 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.812218    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" containerName="registry"
Jul 17 18:51:08.812497 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.812231    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" containerName="registry"
Jul 17 18:51:08.812497 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.812291    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="19bd80cd-8e56-44b4-9ce3-edb59e4fbe88" containerName="registry"
Jul 17 18:51:08.815062 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.815046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.819335 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.819311    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 18:51:08.819488 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.819467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mb6px\""
Jul 17 18:51:08.819563 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.819468    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 18:51:08.819619 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.819596    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 18:51:08.819670 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.819556    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 18:51:08.831702 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.831683    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"]
Jul 17 18:51:08.845058 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.845037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9b71fbf1-06b3-4e7c-85a0-94375ed14697-manifests\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.845166 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.845070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b71fbf1-06b3-4e7c-85a0-94375ed14697-webhook-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.845166 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.845094    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b71fbf1-06b3-4e7c-85a0-94375ed14697-tmp\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.845166 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.845140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsgfk\" (UniqueName: \"kubernetes.io/projected/9b71fbf1-06b3-4e7c-85a0-94375ed14697-kube-api-access-zsgfk\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.845289 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.845224    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9b71fbf1-06b3-4e7c-85a0-94375ed14697-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.945849 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.945822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsgfk\" (UniqueName: \"kubernetes.io/projected/9b71fbf1-06b3-4e7c-85a0-94375ed14697-kube-api-access-zsgfk\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.946042 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.945873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9b71fbf1-06b3-4e7c-85a0-94375ed14697-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.946042 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.945910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9b71fbf1-06b3-4e7c-85a0-94375ed14697-manifests\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.946042 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.945942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b71fbf1-06b3-4e7c-85a0-94375ed14697-webhook-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.946042 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.945973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b71fbf1-06b3-4e7c-85a0-94375ed14697-tmp\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.946349 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.946329    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9b71fbf1-06b3-4e7c-85a0-94375ed14697-manifests\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.948512 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.948489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b71fbf1-06b3-4e7c-85a0-94375ed14697-tmp\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.948625 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.948594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9b71fbf1-06b3-4e7c-85a0-94375ed14697-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.948695 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.948679    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b71fbf1-06b3-4e7c-85a0-94375ed14697-webhook-cert\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:08.955769 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:08.955741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsgfk\" (UniqueName: \"kubernetes.io/projected/9b71fbf1-06b3-4e7c-85a0-94375ed14697-kube-api-access-zsgfk\") pod \"opendatahub-operator-controller-manager-68969b7c46-6sgfl\" (UID: \"9b71fbf1-06b3-4e7c-85a0-94375ed14697\") " pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:09.125015 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:09.124951    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:09.256057 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:09.255916    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"]
Jul 17 18:51:09.258693 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:51:09.258664    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b71fbf1_06b3_4e7c_85a0_94375ed14697.slice/crio-3d8d708bca2309aa6ceea6eac801da3a43cbed01a782ff548ec2774b00de9f45 WatchSource:0}: Error finding container 3d8d708bca2309aa6ceea6eac801da3a43cbed01a782ff548ec2774b00de9f45: Status 404 returned error can't find the container with id 3d8d708bca2309aa6ceea6eac801da3a43cbed01a782ff548ec2774b00de9f45
Jul 17 18:51:09.260412 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:09.260397    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:51:09.880342 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:09.880302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl" event={"ID":"9b71fbf1-06b3-4e7c-85a0-94375ed14697","Type":"ContainerStarted","Data":"3d8d708bca2309aa6ceea6eac801da3a43cbed01a782ff548ec2774b00de9f45"}
Jul 17 18:51:12.894567 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:12.894529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl" event={"ID":"9b71fbf1-06b3-4e7c-85a0-94375ed14697","Type":"ContainerStarted","Data":"83b2c4d6c9225709163636060332ae795a15646276f595c831b736dd16d250b0"}
Jul 17 18:51:13.899304 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:13.899271    2581 generic.go:356] "Generic (PLEG): container finished" podID="9b71fbf1-06b3-4e7c-85a0-94375ed14697" containerID="83b2c4d6c9225709163636060332ae795a15646276f595c831b736dd16d250b0" exitCode=0
Jul 17 18:51:13.899678 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:13.899335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl" event={"ID":"9b71fbf1-06b3-4e7c-85a0-94375ed14697","Type":"ContainerDied","Data":"83b2c4d6c9225709163636060332ae795a15646276f595c831b736dd16d250b0"}
Jul 17 18:51:14.904008 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:14.903972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl" event={"ID":"9b71fbf1-06b3-4e7c-85a0-94375ed14697","Type":"ContainerStarted","Data":"c01dd5567c68e20c4fa352e1e0cf92d49aca29b06a9af9db000abe4d7e4ccca8"}
Jul 17 18:51:14.904453 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:14.904093    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:14.935458 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:14.935414    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl" podStartSLOduration=2.5596050569999997 podStartE2EDuration="6.935390949s" totalImagesPullingTime="3.366771146s" totalInitContainerRuntime="1.009014746s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:14.933626128 +0000 UTC m=+394.927992154" watchObservedRunningTime="2026-07-17 18:51:14.935390949 +0000 UTC m=+394.929756963"
Jul 17 18:51:25.910674 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:25.910644    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68969b7c46-6sgfl"
Jul 17 18:51:29.073316 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.073284    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58f857f879-xflcc"]
Jul 17 18:51:29.081531 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.081511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.086464 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.086440    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 18:51:29.086591 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.086484    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 18:51:29.087398 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.087379    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 18:51:29.089568 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.089548    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 18:51:29.104119 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.104099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58f857f879-xflcc"]
Jul 17 18:51:29.191558 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.191525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-tmp\") pod \"kube-auth-proxy-58f857f879-xflcc\" (UID: \"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.191694 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.191582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-tls-certs\") pod \"kube-auth-proxy-58f857f879-xflcc\" (UID: \"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.191694 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.191650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtqmh\" (UniqueName: \"kubernetes.io/projected/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-kube-api-access-dtqmh\") pod \"kube-auth-proxy-58f857f879-xflcc\" (UID: \"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.280269 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.280243    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xnjqq"]
Jul 17 18:51:29.282242 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.282225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:29.284759 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.284737    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 17 18:51:29.284888 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.284826    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-75nf8\""
Jul 17 18:51:29.291952 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.291932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtqmh\" (UniqueName: \"kubernetes.io/projected/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-kube-api-access-dtqmh\") pod \"kube-auth-proxy-58f857f879-xflcc\" (UID: \"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.292068 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.292007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-tmp\") pod \"kube-auth-proxy-58f857f879-xflcc\" (UID: \"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.292068 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.292043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-tls-certs\") pod \"kube-auth-proxy-58f857f879-xflcc\" (UID: \"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.292185 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:51:29.292142    2581 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 17 18:51:29.292262 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:51:29.292192    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-tls-certs podName:83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9 nodeName:}" failed. No retries permitted until 2026-07-17 18:51:29.792174495 +0000 UTC m=+409.786540502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-tls-certs") pod "kube-auth-proxy-58f857f879-xflcc" (UID: "83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9") : secret "kube-auth-proxy-tls" not found
Jul 17 18:51:29.294333 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.294310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-tmp\") pod \"kube-auth-proxy-58f857f879-xflcc\" (UID: \"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.299951 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.299927    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xnjqq"]
Jul 17 18:51:29.304832 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.304807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtqmh\" (UniqueName: \"kubernetes.io/projected/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-kube-api-access-dtqmh\") pod \"kube-auth-proxy-58f857f879-xflcc\" (UID: \"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.392599 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.392519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg5zz\" (UniqueName: \"kubernetes.io/projected/1b614c3d-09b4-4244-aacb-d4a4cc04506d-kube-api-access-pg5zz\") pod \"odh-model-controller-7998c67dc4-xnjqq\" (UID: \"1b614c3d-09b4-4244-aacb-d4a4cc04506d\") " pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:29.392599 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.392586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b614c3d-09b4-4244-aacb-d4a4cc04506d-cert\") pod \"odh-model-controller-7998c67dc4-xnjqq\" (UID: \"1b614c3d-09b4-4244-aacb-d4a4cc04506d\") " pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:29.493161 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.493129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg5zz\" (UniqueName: \"kubernetes.io/projected/1b614c3d-09b4-4244-aacb-d4a4cc04506d-kube-api-access-pg5zz\") pod \"odh-model-controller-7998c67dc4-xnjqq\" (UID: \"1b614c3d-09b4-4244-aacb-d4a4cc04506d\") " pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:29.493348 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.493258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b614c3d-09b4-4244-aacb-d4a4cc04506d-cert\") pod \"odh-model-controller-7998c67dc4-xnjqq\" (UID: \"1b614c3d-09b4-4244-aacb-d4a4cc04506d\") " pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:29.493420 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:51:29.493374    2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 17 18:51:29.493485 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:51:29.493431    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b614c3d-09b4-4244-aacb-d4a4cc04506d-cert podName:1b614c3d-09b4-4244-aacb-d4a4cc04506d nodeName:}" failed. No retries permitted until 2026-07-17 18:51:29.993412282 +0000 UTC m=+409.987778295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b614c3d-09b4-4244-aacb-d4a4cc04506d-cert") pod "odh-model-controller-7998c67dc4-xnjqq" (UID: "1b614c3d-09b4-4244-aacb-d4a4cc04506d") : secret "odh-model-controller-webhook-cert" not found
Jul 17 18:51:29.510267 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.510244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg5zz\" (UniqueName: \"kubernetes.io/projected/1b614c3d-09b4-4244-aacb-d4a4cc04506d-kube-api-access-pg5zz\") pod \"odh-model-controller-7998c67dc4-xnjqq\" (UID: \"1b614c3d-09b4-4244-aacb-d4a4cc04506d\") " pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:29.795500 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.795465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-tls-certs\") pod \"kube-auth-proxy-58f857f879-xflcc\" (UID: \"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.797885 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.797857    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9-tls-certs\") pod \"kube-auth-proxy-58f857f879-xflcc\" (UID: \"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9\") " pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.991261 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.991233    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc"
Jul 17 18:51:29.996873 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.996845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b614c3d-09b4-4244-aacb-d4a4cc04506d-cert\") pod \"odh-model-controller-7998c67dc4-xnjqq\" (UID: \"1b614c3d-09b4-4244-aacb-d4a4cc04506d\") " pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:29.999248 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:29.999225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b614c3d-09b4-4244-aacb-d4a4cc04506d-cert\") pod \"odh-model-controller-7998c67dc4-xnjqq\" (UID: \"1b614c3d-09b4-4244-aacb-d4a4cc04506d\") " pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:30.138148 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:30.138116    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58f857f879-xflcc"]
Jul 17 18:51:30.140770 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:51:30.140746    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e7e1e6_24e2_4e41_b69e_af9ffd3d3fb9.slice/crio-141505bdfb7da31d3b0b70e29b0939b61cf66808264f404f7c33f02d4cc8b287 WatchSource:0}: Error finding container 141505bdfb7da31d3b0b70e29b0939b61cf66808264f404f7c33f02d4cc8b287: Status 404 returned error can't find the container with id 141505bdfb7da31d3b0b70e29b0939b61cf66808264f404f7c33f02d4cc8b287
Jul 17 18:51:30.191393 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:30.191363    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:30.330598 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:30.330529    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xnjqq"]
Jul 17 18:51:30.333259 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:51:30.333230    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b614c3d_09b4_4244_aacb_d4a4cc04506d.slice/crio-08de52fafff03b30fe8a57cd1ac2b899aa55afb22b1aa2e25456a9ca16d7d68a WatchSource:0}: Error finding container 08de52fafff03b30fe8a57cd1ac2b899aa55afb22b1aa2e25456a9ca16d7d68a: Status 404 returned error can't find the container with id 08de52fafff03b30fe8a57cd1ac2b899aa55afb22b1aa2e25456a9ca16d7d68a
Jul 17 18:51:30.902093 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:30.902061    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z9wc7"]
Jul 17 18:51:30.908685 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:30.908650    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:30.916586 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:30.916560    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 17 18:51:30.931895 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:30.931870    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z9wc7"]
Jul 17 18:51:30.959533 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:30.959497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq" event={"ID":"1b614c3d-09b4-4244-aacb-d4a4cc04506d","Type":"ContainerStarted","Data":"08de52fafff03b30fe8a57cd1ac2b899aa55afb22b1aa2e25456a9ca16d7d68a"}
Jul 17 18:51:30.961054 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:30.961023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc" event={"ID":"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9","Type":"ContainerStarted","Data":"141505bdfb7da31d3b0b70e29b0939b61cf66808264f404f7c33f02d4cc8b287"}
Jul 17 18:51:31.003728 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.003699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2cqw\" (UniqueName: \"kubernetes.io/projected/9b041fd2-82b4-4fb8-9969-59f093c99ec2-kube-api-access-p2cqw\") pod \"model-serving-api-54d89bd5fc-z9wc7\" (UID: \"9b041fd2-82b4-4fb8-9969-59f093c99ec2\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:31.003883 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.003802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b041fd2-82b4-4fb8-9969-59f093c99ec2-tls-certs\") pod \"model-serving-api-54d89bd5fc-z9wc7\" (UID: \"9b041fd2-82b4-4fb8-9969-59f093c99ec2\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:31.104906 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.104158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b041fd2-82b4-4fb8-9969-59f093c99ec2-tls-certs\") pod \"model-serving-api-54d89bd5fc-z9wc7\" (UID: \"9b041fd2-82b4-4fb8-9969-59f093c99ec2\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:31.104906 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.104248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2cqw\" (UniqueName: \"kubernetes.io/projected/9b041fd2-82b4-4fb8-9969-59f093c99ec2-kube-api-access-p2cqw\") pod \"model-serving-api-54d89bd5fc-z9wc7\" (UID: \"9b041fd2-82b4-4fb8-9969-59f093c99ec2\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:31.104906 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:51:31.104655    2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 17 18:51:31.104906 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:51:31.104716    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b041fd2-82b4-4fb8-9969-59f093c99ec2-tls-certs podName:9b041fd2-82b4-4fb8-9969-59f093c99ec2 nodeName:}" failed. No retries permitted until 2026-07-17 18:51:31.604695811 +0000 UTC m=+411.599061807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9b041fd2-82b4-4fb8-9969-59f093c99ec2-tls-certs") pod "model-serving-api-54d89bd5fc-z9wc7" (UID: "9b041fd2-82b4-4fb8-9969-59f093c99ec2") : secret "model-serving-api-tls" not found
Jul 17 18:51:31.122002 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.121975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2cqw\" (UniqueName: \"kubernetes.io/projected/9b041fd2-82b4-4fb8-9969-59f093c99ec2-kube-api-access-p2cqw\") pod \"model-serving-api-54d89bd5fc-z9wc7\" (UID: \"9b041fd2-82b4-4fb8-9969-59f093c99ec2\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:31.432459 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.432423    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"]
Jul 17 18:51:31.435957 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.435929    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.439314 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.439291    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 18:51:31.440726 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.440556    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 18:51:31.440944 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.440894    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 18:51:31.441085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.441004    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 18:51:31.441243 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.441217    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8rg78\""
Jul 17 18:51:31.457313 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.457288    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"]
Jul 17 18:51:31.507741 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.507712    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.507909 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.507746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gmjh\" (UniqueName: \"kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-kube-api-access-7gmjh\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.507909 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.507800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.508021 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.507930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-token\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.508021 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.507957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.508111 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.508098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7fca56c-9c73-4a30-adbd-44295162b72b-local-certs\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.508261 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.508236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-cacerts\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.609530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.608698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7fca56c-9c73-4a30-adbd-44295162b72b-local-certs\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.609530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.608740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-cacerts\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.609530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.608788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.609530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.608814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gmjh\" (UniqueName: \"kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-kube-api-access-7gmjh\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.609530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.608841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.609530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.608890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-token\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.609530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.608918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.609530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.608952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b041fd2-82b4-4fb8-9969-59f093c99ec2-tls-certs\") pod \"model-serving-api-54d89bd5fc-z9wc7\" (UID: \"9b041fd2-82b4-4fb8-9969-59f093c99ec2\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:31.610794 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.610742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.614792 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.614763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.615256 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.615233    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b041fd2-82b4-4fb8-9969-59f093c99ec2-tls-certs\") pod \"model-serving-api-54d89bd5fc-z9wc7\" (UID: \"9b041fd2-82b4-4fb8-9969-59f093c99ec2\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:31.615340 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.615239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-cacerts\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.615517 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.615497    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7fca56c-9c73-4a30-adbd-44295162b72b-local-certs\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.617401 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.617376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.628871 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.628848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-token\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.632265 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.632191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gmjh\" (UniqueName: \"kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-kube-api-access-7gmjh\") pod \"istiod-openshift-gateway-7574459656-r4gpk\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.748364 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.748236    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:31.822170 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.822143    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:31.945533 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.945447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"]
Jul 17 18:51:31.948741 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:51:31.948707    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fca56c_9c73_4a30_adbd_44295162b72b.slice/crio-c4d3c0f9a4789806dc6f787ea7386510d43d370c124ba066a6f520db7778e692 WatchSource:0}: Error finding container c4d3c0f9a4789806dc6f787ea7386510d43d370c124ba066a6f520db7778e692: Status 404 returned error can't find the container with id c4d3c0f9a4789806dc6f787ea7386510d43d370c124ba066a6f520db7778e692
Jul 17 18:51:31.970032 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:31.969989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk" event={"ID":"b7fca56c-9c73-4a30-adbd-44295162b72b","Type":"ContainerStarted","Data":"c4d3c0f9a4789806dc6f787ea7386510d43d370c124ba066a6f520db7778e692"}
Jul 17 18:51:32.008862 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:32.008731    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z9wc7"]
Jul 17 18:51:32.012288 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:51:32.012253    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b041fd2_82b4_4fb8_9969_59f093c99ec2.slice/crio-b18fba33321b7ac2fd9cf2ab7f2b928a4c13e6715f54e3b199ebe440b23f888c WatchSource:0}: Error finding container b18fba33321b7ac2fd9cf2ab7f2b928a4c13e6715f54e3b199ebe440b23f888c: Status 404 returned error can't find the container with id b18fba33321b7ac2fd9cf2ab7f2b928a4c13e6715f54e3b199ebe440b23f888c
Jul 17 18:51:32.975633 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:32.975599    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7" event={"ID":"9b041fd2-82b4-4fb8-9969-59f093c99ec2","Type":"ContainerStarted","Data":"b18fba33321b7ac2fd9cf2ab7f2b928a4c13e6715f54e3b199ebe440b23f888c"}
Jul 17 18:51:34.988643 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:34.988611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq" event={"ID":"1b614c3d-09b4-4244-aacb-d4a4cc04506d","Type":"ContainerStarted","Data":"f1dc2931b52942a72cf1451d4b65e8feb590804b9dae23feeb3f1989991149e9"}
Jul 17 18:51:34.989064 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:34.988726    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:34.990403 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:34.990363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc" event={"ID":"83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9","Type":"ContainerStarted","Data":"d5c1d3f4776fc8833c5b01caa613edd4f7c3d2e52a8d706be3238c0f4f333877"}
Jul 17 18:51:34.991769 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:34.991745    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7" event={"ID":"9b041fd2-82b4-4fb8-9969-59f093c99ec2","Type":"ContainerStarted","Data":"22359bb80b7c2cbe1c2b412fd7185c2a5a7a7506ac0d4e79fc9f0e45858b1556"}
Jul 17 18:51:34.991892 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:34.991874    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:35.007924 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:35.007876    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq" podStartSLOduration=2.263801907 podStartE2EDuration="6.007860774s" totalImagesPullingTime="3.744058867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:35.006150344 +0000 UTC m=+415.000516359" watchObservedRunningTime="2026-07-17 18:51:35.007860774 +0000 UTC m=+415.002226791"
Jul 17 18:51:35.066247 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:35.066171    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7" podStartSLOduration=2.182961596 podStartE2EDuration="5.066149396s" totalImagesPullingTime="2.8831878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:35.064414418 +0000 UTC m=+415.058780435" watchObservedRunningTime="2026-07-17 18:51:35.066149396 +0000 UTC m=+415.060515413"
Jul 17 18:51:35.067215 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:35.067170    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58f857f879-xflcc" podStartSLOduration=2.130077161 podStartE2EDuration="6.067162028s" totalImagesPullingTime="3.937084867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:35.032466752 +0000 UTC m=+415.026832767" watchObservedRunningTime="2026-07-17 18:51:35.067162028 +0000 UTC m=+415.061528043"
Jul 17 18:51:36.122475 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:36.122436    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:51:36.122752 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:36.122507    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:51:37.007109 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:37.007074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk" event={"ID":"b7fca56c-9c73-4a30-adbd-44295162b72b","Type":"ContainerStarted","Data":"d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f"}
Jul 17 18:51:37.007303 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:37.007270    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:37.008648 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:37.008625    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-r4gpk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 18:51:37.008733 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:37.008668    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk" podUID="b7fca56c-9c73-4a30-adbd-44295162b72b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 18:51:37.034332 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:37.034289    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk" podStartSLOduration=1.863904098 podStartE2EDuration="6.034276469s" totalImagesPullingTime="4.170372371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:37.032590178 +0000 UTC m=+417.026956198" watchObservedRunningTime="2026-07-17 18:51:37.034276469 +0000 UTC m=+417.028642484"
Jul 17 18:51:38.012087 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.012041    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-r4gpk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 18:51:38.012548 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.012122    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk" podUID="b7fca56c-9c73-4a30-adbd-44295162b72b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 18:51:38.042121 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.042096    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"]
Jul 17 18:51:38.045299 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.045283    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.054712 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.054693    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nsdwg\""
Jul 17 18:51:38.064729 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.064701    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"]
Jul 17 18:51:38.163360 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.163332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.163360 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.163362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.163604 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.163391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac788fc-b861-47d0-a419-30e8ac40b183-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.163604 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.163412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq65r\" (UniqueName: \"kubernetes.io/projected/2ac788fc-b861-47d0-a419-30e8ac40b183-kube-api-access-rq65r\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.163604 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.163437    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.163604 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.163552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.163604 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.163596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.163799 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.163621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.163799 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.163648    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.264742 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.264646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.264742 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.264687    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.264742 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.264720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.264742 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.264743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.265062 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.264782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.265062 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.264797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.265062 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.264831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac788fc-b861-47d0-a419-30e8ac40b183-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.265062 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.264854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq65r\" (UniqueName: \"kubernetes.io/projected/2ac788fc-b861-47d0-a419-30e8ac40b183-kube-api-access-rq65r\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.265062 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.264904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.265316 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.265173    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.265316 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.265190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.265316 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.265259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.265316 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.265294    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.265639 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.265617    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ac788fc-b861-47d0-a419-30e8ac40b183-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.267358 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.267326    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.267513 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.267498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.290453 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.290431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ac788fc-b861-47d0-a419-30e8ac40b183-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.324764 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.324733    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq65r\" (UniqueName: \"kubernetes.io/projected/2ac788fc-b861-47d0-a419-30e8ac40b183-kube-api-access-rq65r\") pod \"data-science-gateway-data-science-gateway-class-6576859cf49hp6s\" (UID: \"2ac788fc-b861-47d0-a419-30e8ac40b183\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.355827 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.355800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:38.558750 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:38.558669    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"]
Jul 17 18:51:38.561258 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:51:38.561233    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac788fc_b861_47d0_a419_30e8ac40b183.slice/crio-97744153bb7f26beaf47c41a3ca901892c3ca5f7b2f87dbe8559730dd7923e15 WatchSource:0}: Error finding container 97744153bb7f26beaf47c41a3ca901892c3ca5f7b2f87dbe8559730dd7923e15: Status 404 returned error can't find the container with id 97744153bb7f26beaf47c41a3ca901892c3ca5f7b2f87dbe8559730dd7923e15
Jul 17 18:51:39.019122 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:39.019081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s" event={"ID":"2ac788fc-b861-47d0-a419-30e8ac40b183","Type":"ContainerStarted","Data":"97744153bb7f26beaf47c41a3ca901892c3ca5f7b2f87dbe8559730dd7923e15"}
Jul 17 18:51:41.012973 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.012937    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:41.711177 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.711138    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:51:41.711291 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.711231    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:51:41.711291 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.711264    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:51:41.810656 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.810628    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xv658"]
Jul 17 18:51:41.813901 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.813881    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658"
Jul 17 18:51:41.818601 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.818580    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 17 18:51:41.818601 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.818594    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sjm7j\""
Jul 17 18:51:41.832958 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.832933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xv658"]
Jul 17 18:51:41.840242 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.840190    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"]
Jul 17 18:51:41.843739 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.843718    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"
Jul 17 18:51:41.846920 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:51:41.846885    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"llmisvc-controller-manager-dockercfg-xqpd5\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xqpd5\"" type="*v1.Secret"
Jul 17 18:51:41.846920 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:51:41.846903    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"llmisvc-webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" type="*v1.Secret"
Jul 17 18:51:41.895239 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.895186    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"]
Jul 17 18:51:41.903506 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.903481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33fc2e02-02eb-4def-8d52-925a5fca89ed-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r4xtq\" (UID: \"33fc2e02-02eb-4def-8d52-925a5fca89ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"
Jul 17 18:51:41.903670 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.903541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p46dm\" (UniqueName: \"kubernetes.io/projected/ede9e12e-7711-420f-a38f-8bde4fb2465c-kube-api-access-p46dm\") pod \"kserve-controller-manager-d6f4b65b8-xv658\" (UID: \"ede9e12e-7711-420f-a38f-8bde4fb2465c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658"
Jul 17 18:51:41.903670 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.903647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ede9e12e-7711-420f-a38f-8bde4fb2465c-cert\") pod \"kserve-controller-manager-d6f4b65b8-xv658\" (UID: \"ede9e12e-7711-420f-a38f-8bde4fb2465c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658"
Jul 17 18:51:41.903760 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:41.903710    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzrpx\" (UniqueName: \"kubernetes.io/projected/33fc2e02-02eb-4def-8d52-925a5fca89ed-kube-api-access-zzrpx\") pod \"llmisvc-controller-manager-777c6bd7d5-r4xtq\" (UID: \"33fc2e02-02eb-4def-8d52-925a5fca89ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"
Jul 17 18:51:42.004935 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.004852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33fc2e02-02eb-4def-8d52-925a5fca89ed-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r4xtq\" (UID: \"33fc2e02-02eb-4def-8d52-925a5fca89ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"
Jul 17 18:51:42.004935 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.004912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p46dm\" (UniqueName: \"kubernetes.io/projected/ede9e12e-7711-420f-a38f-8bde4fb2465c-kube-api-access-p46dm\") pod \"kserve-controller-manager-d6f4b65b8-xv658\" (UID: \"ede9e12e-7711-420f-a38f-8bde4fb2465c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658"
Jul 17 18:51:42.005154 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.004950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ede9e12e-7711-420f-a38f-8bde4fb2465c-cert\") pod \"kserve-controller-manager-d6f4b65b8-xv658\" (UID: \"ede9e12e-7711-420f-a38f-8bde4fb2465c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658"
Jul 17 18:51:42.005154 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.004991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzrpx\" (UniqueName: \"kubernetes.io/projected/33fc2e02-02eb-4def-8d52-925a5fca89ed-kube-api-access-zzrpx\") pod \"llmisvc-controller-manager-777c6bd7d5-r4xtq\" (UID: \"33fc2e02-02eb-4def-8d52-925a5fca89ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"
Jul 17 18:51:42.007596 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.007569    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ede9e12e-7711-420f-a38f-8bde4fb2465c-cert\") pod \"kserve-controller-manager-d6f4b65b8-xv658\" (UID: \"ede9e12e-7711-420f-a38f-8bde4fb2465c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658"
Jul 17 18:51:42.024004 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.023970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p46dm\" (UniqueName: \"kubernetes.io/projected/ede9e12e-7711-420f-a38f-8bde4fb2465c-kube-api-access-p46dm\") pod \"kserve-controller-manager-d6f4b65b8-xv658\" (UID: \"ede9e12e-7711-420f-a38f-8bde4fb2465c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658"
Jul 17 18:51:42.027477 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.027448    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzrpx\" (UniqueName: \"kubernetes.io/projected/33fc2e02-02eb-4def-8d52-925a5fca89ed-kube-api-access-zzrpx\") pod \"llmisvc-controller-manager-777c6bd7d5-r4xtq\" (UID: \"33fc2e02-02eb-4def-8d52-925a5fca89ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"
Jul 17 18:51:42.034900 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.034383    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s" event={"ID":"2ac788fc-b861-47d0-a419-30e8ac40b183","Type":"ContainerStarted","Data":"2d7f6fcc8bfbe6a0127f0b98d095ba4ed1b83fbf84f3a718b756102092bc20ba"}
Jul 17 18:51:42.067287 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.067236    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s" podStartSLOduration=0.91939693 podStartE2EDuration="4.067220845s" totalImagesPullingTime="3.147823915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:42.066987886 +0000 UTC m=+422.061353901" watchObservedRunningTime="2026-07-17 18:51:42.067220845 +0000 UTC m=+422.061586857"
Jul 17 18:51:42.125768 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.125738    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658"
Jul 17 18:51:42.283255 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.283158    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xv658"]
Jul 17 18:51:42.285665 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:51:42.285637    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede9e12e_7711_420f_a38f_8bde4fb2465c.slice/crio-7a080ba25c572343328641dec2f2a0b3b6c58afccef652ce57624d44e9ca50cf WatchSource:0}: Error finding container 7a080ba25c572343328641dec2f2a0b3b6c58afccef652ce57624d44e9ca50cf: Status 404 returned error can't find the container with id 7a080ba25c572343328641dec2f2a0b3b6c58afccef652ce57624d44e9ca50cf
Jul 17 18:51:42.356770 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.356737    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:42.358070 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.358034    2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf49hp6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Jul 17 18:51:42.358219 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.358090    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s" podUID="2ac788fc-b861-47d0-a419-30e8ac40b183" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Jul 17 18:51:42.805628 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.805597    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 17 18:51:42.817810 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:42.817786    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33fc2e02-02eb-4def-8d52-925a5fca89ed-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r4xtq\" (UID: \"33fc2e02-02eb-4def-8d52-925a5fca89ed\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"
Jul 17 18:51:43.039734 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:43.039698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658" event={"ID":"ede9e12e-7711-420f-a38f-8bde4fb2465c","Type":"ContainerStarted","Data":"7a080ba25c572343328641dec2f2a0b3b6c58afccef652ce57624d44e9ca50cf"}
Jul 17 18:51:43.126537 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:43.126463    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xqpd5\""
Jul 17 18:51:43.136837 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:43.136812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"
Jul 17 18:51:43.303708 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:43.303679    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"]
Jul 17 18:51:43.306553 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:51:43.306526    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod33fc2e02_02eb_4def_8d52_925a5fca89ed.slice/crio-b78b82cb0f664ff2785e39f1651807d2870fe9cb6a60834f77997c44af5603c6 WatchSource:0}: Error finding container b78b82cb0f664ff2785e39f1651807d2870fe9cb6a60834f77997c44af5603c6: Status 404 returned error can't find the container with id b78b82cb0f664ff2785e39f1651807d2870fe9cb6a60834f77997c44af5603c6
Jul 17 18:51:43.360833 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:43.360804    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:44.046183 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:44.046143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq" event={"ID":"33fc2e02-02eb-4def-8d52-925a5fca89ed","Type":"ContainerStarted","Data":"b78b82cb0f664ff2785e39f1651807d2870fe9cb6a60834f77997c44af5603c6"}
Jul 17 18:51:44.046607 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:44.046495    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:44.047481 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:44.047461    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf49hp6s"
Jul 17 18:51:45.758056 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:45.758021    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"]
Jul 17 18:51:45.758566 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:45.758214    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk" podUID="b7fca56c-9c73-4a30-adbd-44295162b72b" containerName="discovery" containerID="cri-o://d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f" gracePeriod=30
Jul 17 18:51:46.003576 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.003549    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xnjqq"
Jul 17 18:51:46.006076 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.006057    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-z9wc7"
Jul 17 18:51:46.006313 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.006294    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:46.060372 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.060296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658" event={"ID":"ede9e12e-7711-420f-a38f-8bde4fb2465c","Type":"ContainerStarted","Data":"39f14ad43d670a74b5d05107b0f1f3f337a630ab8cd8f2ebc6c96fe96b90c47e"}
Jul 17 18:51:46.060498 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.060382    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658"
Jul 17 18:51:46.061607 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.061590    2581 generic.go:356] "Generic (PLEG): container finished" podID="b7fca56c-9c73-4a30-adbd-44295162b72b" containerID="d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f" exitCode=0
Jul 17 18:51:46.061662 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.061625    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"
Jul 17 18:51:46.061662 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.061645    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk" event={"ID":"b7fca56c-9c73-4a30-adbd-44295162b72b","Type":"ContainerDied","Data":"d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f"}
Jul 17 18:51:46.061737 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.061672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk" event={"ID":"b7fca56c-9c73-4a30-adbd-44295162b72b","Type":"ContainerDied","Data":"c4d3c0f9a4789806dc6f787ea7386510d43d370c124ba066a6f520db7778e692"}
Jul 17 18:51:46.061737 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.061691    2581 scope.go:117] "RemoveContainer" containerID="d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f"
Jul 17 18:51:46.069925 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.069911    2581 scope.go:117] "RemoveContainer" containerID="d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f"
Jul 17 18:51:46.070171 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:51:46.070153    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f\": container with ID starting with d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f not found: ID does not exist" containerID="d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f"
Jul 17 18:51:46.070230 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.070182    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f"} err="failed to get container status \"d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f\": rpc error: code = NotFound desc = could not find container \"d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f\": container with ID starting with d2df74e184270ac3fdfc7eb67e569bb54b846f8d7945014c7299e8559c79066f not found: ID does not exist"
Jul 17 18:51:46.109124 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.109077    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658" podStartSLOduration=2.433844238 podStartE2EDuration="5.109057939s" totalImagesPullingTime="2.675213701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:46.107761439 +0000 UTC m=+426.102127455" watchObservedRunningTime="2026-07-17 18:51:46.109057939 +0000 UTC m=+426.103423954"
Jul 17 18:51:46.140055 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.140029    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-ca-configmap\") pod \"b7fca56c-9c73-4a30-adbd-44295162b72b\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") "
Jul 17 18:51:46.140186 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.140066    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-kubeconfig\") pod \"b7fca56c-9c73-4a30-adbd-44295162b72b\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") "
Jul 17 18:51:46.140186 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.140096    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-cacerts\") pod \"b7fca56c-9c73-4a30-adbd-44295162b72b\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") "
Jul 17 18:51:46.140186 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.140120    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gmjh\" (UniqueName: \"kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-kube-api-access-7gmjh\") pod \"b7fca56c-9c73-4a30-adbd-44295162b72b\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") "
Jul 17 18:51:46.140186 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.140135    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-token\") pod \"b7fca56c-9c73-4a30-adbd-44295162b72b\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") "
Jul 17 18:51:46.140186 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.140174    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7fca56c-9c73-4a30-adbd-44295162b72b-local-certs\") pod \"b7fca56c-9c73-4a30-adbd-44295162b72b\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") "
Jul 17 18:51:46.140457 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.140237    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-dns-cert\") pod \"b7fca56c-9c73-4a30-adbd-44295162b72b\" (UID: \"b7fca56c-9c73-4a30-adbd-44295162b72b\") "
Jul 17 18:51:46.140533 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.140491    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b7fca56c-9c73-4a30-adbd-44295162b72b" (UID: "b7fca56c-9c73-4a30-adbd-44295162b72b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:51:46.141420 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.140627    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-ca-configmap\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:51:46.143084 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.143060    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b7fca56c-9c73-4a30-adbd-44295162b72b" (UID: "b7fca56c-9c73-4a30-adbd-44295162b72b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:51:46.143381 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.143332    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b7fca56c-9c73-4a30-adbd-44295162b72b" (UID: "b7fca56c-9c73-4a30-adbd-44295162b72b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:51:46.143381 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.143356    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b7fca56c-9c73-4a30-adbd-44295162b72b" (UID: "b7fca56c-9c73-4a30-adbd-44295162b72b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:51:46.143495 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.143394    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-cacerts" (OuterVolumeSpecName: "cacerts") pod "b7fca56c-9c73-4a30-adbd-44295162b72b" (UID: "b7fca56c-9c73-4a30-adbd-44295162b72b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:51:46.143544 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.143519    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-kube-api-access-7gmjh" (OuterVolumeSpecName: "kube-api-access-7gmjh") pod "b7fca56c-9c73-4a30-adbd-44295162b72b" (UID: "b7fca56c-9c73-4a30-adbd-44295162b72b"). InnerVolumeSpecName "kube-api-access-7gmjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:51:46.143740 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.143724    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7fca56c-9c73-4a30-adbd-44295162b72b-local-certs" (OuterVolumeSpecName: "local-certs") pod "b7fca56c-9c73-4a30-adbd-44295162b72b" (UID: "b7fca56c-9c73-4a30-adbd-44295162b72b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:51:46.241685 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.241657    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-csr-dns-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:51:46.241685 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.241683    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-kubeconfig\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:51:46.241685 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.241692    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7fca56c-9c73-4a30-adbd-44295162b72b-cacerts\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:51:46.241938 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.241700    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gmjh\" (UniqueName: \"kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-kube-api-access-7gmjh\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:51:46.241938 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.241714    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7fca56c-9c73-4a30-adbd-44295162b72b-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:51:46.241938 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.241724    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7fca56c-9c73-4a30-adbd-44295162b72b-local-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:51:46.395596 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.395554    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"]
Jul 17 18:51:46.403025 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.403000    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r4gpk"]
Jul 17 18:51:46.487824 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:46.487794    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7fca56c-9c73-4a30-adbd-44295162b72b" path="/var/lib/kubelet/pods/b7fca56c-9c73-4a30-adbd-44295162b72b/volumes"
Jul 17 18:51:47.067933 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:47.067897    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq" event={"ID":"33fc2e02-02eb-4def-8d52-925a5fca89ed","Type":"ContainerStarted","Data":"4eb004f612277e56eae214df6aa8f65186e16cb7e770f27cfa3eeb4ada111e60"}
Jul 17 18:51:47.068357 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:47.068032    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"
Jul 17 18:51:47.098746 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:51:47.098701    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq" podStartSLOduration=2.519187436 podStartE2EDuration="6.098682208s" totalImagesPullingTime="3.579494772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:47.097117417 +0000 UTC m=+427.091483433" watchObservedRunningTime="2026-07-17 18:51:47.098682208 +0000 UTC m=+427.093048225"
Jul 17 18:52:17.074596 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:17.074564    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xv658"
Jul 17 18:52:18.074696 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:18.074666    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4xtq"
Jul 17 18:52:29.984921 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:29.984893    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqshk"]
Jul 17 18:52:29.985312 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:29.985170    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7fca56c-9c73-4a30-adbd-44295162b72b" containerName="discovery"
Jul 17 18:52:29.985312 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:29.985181    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7fca56c-9c73-4a30-adbd-44295162b72b" containerName="discovery"
Jul 17 18:52:29.985312 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:29.985243    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7fca56c-9c73-4a30-adbd-44295162b72b" containerName="discovery"
Jul 17 18:52:30.002680 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.002655    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqshk"]
Jul 17 18:52:30.002819 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.002741    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lqshk"
Jul 17 18:52:30.006550 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.006526    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 18:52:30.006802 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.006781    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-msgmv\""
Jul 17 18:52:30.007457 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.007438    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 18:52:30.070445 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.070416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgjbb\" (UniqueName: \"kubernetes.io/projected/4233c2ea-528c-4152-8d0e-38d4d0fd21db-kube-api-access-jgjbb\") pod \"kuadrant-operator-catalog-lqshk\" (UID: \"4233c2ea-528c-4152-8d0e-38d4d0fd21db\") " pod="kuadrant-system/kuadrant-operator-catalog-lqshk"
Jul 17 18:52:30.171785 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.171752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgjbb\" (UniqueName: \"kubernetes.io/projected/4233c2ea-528c-4152-8d0e-38d4d0fd21db-kube-api-access-jgjbb\") pod \"kuadrant-operator-catalog-lqshk\" (UID: \"4233c2ea-528c-4152-8d0e-38d4d0fd21db\") " pod="kuadrant-system/kuadrant-operator-catalog-lqshk"
Jul 17 18:52:30.191261 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.191224    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgjbb\" (UniqueName: \"kubernetes.io/projected/4233c2ea-528c-4152-8d0e-38d4d0fd21db-kube-api-access-jgjbb\") pod \"kuadrant-operator-catalog-lqshk\" (UID: \"4233c2ea-528c-4152-8d0e-38d4d0fd21db\") " pod="kuadrant-system/kuadrant-operator-catalog-lqshk"
Jul 17 18:52:30.312639 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.312543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lqshk"
Jul 17 18:52:30.355871 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.355832    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqshk"]
Jul 17 18:52:30.446063 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.446015    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqshk"]
Jul 17 18:52:30.449913 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:52:30.449880    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4233c2ea_528c_4152_8d0e_38d4d0fd21db.slice/crio-63403c7a233aa351fdce81e1c9a0455fbb178807696f914e48d661a958e8ba80 WatchSource:0}: Error finding container 63403c7a233aa351fdce81e1c9a0455fbb178807696f914e48d661a958e8ba80: Status 404 returned error can't find the container with id 63403c7a233aa351fdce81e1c9a0455fbb178807696f914e48d661a958e8ba80
Jul 17 18:52:30.561395 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.561364    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-489sm"]
Jul 17 18:52:30.565836 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.565791    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-489sm"
Jul 17 18:52:30.573219 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.573175    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-489sm"]
Jul 17 18:52:30.676388 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.676357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97c5d\" (UniqueName: \"kubernetes.io/projected/d9263662-4d16-4701-9871-d3219b8ade7f-kube-api-access-97c5d\") pod \"kuadrant-operator-catalog-489sm\" (UID: \"d9263662-4d16-4701-9871-d3219b8ade7f\") " pod="kuadrant-system/kuadrant-operator-catalog-489sm"
Jul 17 18:52:30.776840 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.776807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97c5d\" (UniqueName: \"kubernetes.io/projected/d9263662-4d16-4701-9871-d3219b8ade7f-kube-api-access-97c5d\") pod \"kuadrant-operator-catalog-489sm\" (UID: \"d9263662-4d16-4701-9871-d3219b8ade7f\") " pod="kuadrant-system/kuadrant-operator-catalog-489sm"
Jul 17 18:52:30.786488 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.786455    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97c5d\" (UniqueName: \"kubernetes.io/projected/d9263662-4d16-4701-9871-d3219b8ade7f-kube-api-access-97c5d\") pod \"kuadrant-operator-catalog-489sm\" (UID: \"d9263662-4d16-4701-9871-d3219b8ade7f\") " pod="kuadrant-system/kuadrant-operator-catalog-489sm"
Jul 17 18:52:30.876630 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:30.876543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-489sm"
Jul 17 18:52:31.005511 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:31.005467    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-489sm"]
Jul 17 18:52:31.009583 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:52:31.009561    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9263662_4d16_4701_9871_d3219b8ade7f.slice/crio-986ee0b54f82f32b40dc6d9a58efe578b48da46cf7c2a0ac1f2c6e01b2f58396 WatchSource:0}: Error finding container 986ee0b54f82f32b40dc6d9a58efe578b48da46cf7c2a0ac1f2c6e01b2f58396: Status 404 returned error can't find the container with id 986ee0b54f82f32b40dc6d9a58efe578b48da46cf7c2a0ac1f2c6e01b2f58396
Jul 17 18:52:31.242070 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:31.242036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lqshk" event={"ID":"4233c2ea-528c-4152-8d0e-38d4d0fd21db","Type":"ContainerStarted","Data":"63403c7a233aa351fdce81e1c9a0455fbb178807696f914e48d661a958e8ba80"}
Jul 17 18:52:31.245704 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:31.243874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-489sm" event={"ID":"d9263662-4d16-4701-9871-d3219b8ade7f","Type":"ContainerStarted","Data":"986ee0b54f82f32b40dc6d9a58efe578b48da46cf7c2a0ac1f2c6e01b2f58396"}
Jul 17 18:52:33.254745 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:33.254700    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lqshk" event={"ID":"4233c2ea-528c-4152-8d0e-38d4d0fd21db","Type":"ContainerStarted","Data":"bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8"}
Jul 17 18:52:33.255292 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:33.254760    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lqshk" podUID="4233c2ea-528c-4152-8d0e-38d4d0fd21db" containerName="registry-server" containerID="cri-o://bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8" gracePeriod=2
Jul 17 18:52:33.256388 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:33.256365    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-489sm" event={"ID":"d9263662-4d16-4701-9871-d3219b8ade7f","Type":"ContainerStarted","Data":"57ecf4fab47bc42aea285df7f96e7e13f0ba137d5f32b3a31ab021c4a0a8e0fd"}
Jul 17 18:52:33.275817 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:33.275777    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lqshk" podStartSLOduration=2.161965611 podStartE2EDuration="4.27576316s" totalImagesPullingTime="2.113797549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:52:33.274334923 +0000 UTC m=+473.268700938" watchObservedRunningTime="2026-07-17 18:52:33.27576316 +0000 UTC m=+473.270129174"
Jul 17 18:52:33.292868 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:33.292826    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-489sm" podStartSLOduration=1.735623403 podStartE2EDuration="3.292807207s" totalImagesPullingTime="1.557183804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:52:33.291982831 +0000 UTC m=+473.286348847" watchObservedRunningTime="2026-07-17 18:52:33.292807207 +0000 UTC m=+473.287173222"
Jul 17 18:52:33.496583 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:33.496560    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lqshk"
Jul 17 18:52:33.601927 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:33.601860    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgjbb\" (UniqueName: \"kubernetes.io/projected/4233c2ea-528c-4152-8d0e-38d4d0fd21db-kube-api-access-jgjbb\") pod \"4233c2ea-528c-4152-8d0e-38d4d0fd21db\" (UID: \"4233c2ea-528c-4152-8d0e-38d4d0fd21db\") "
Jul 17 18:52:33.604097 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:33.604077    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4233c2ea-528c-4152-8d0e-38d4d0fd21db-kube-api-access-jgjbb" (OuterVolumeSpecName: "kube-api-access-jgjbb") pod "4233c2ea-528c-4152-8d0e-38d4d0fd21db" (UID: "4233c2ea-528c-4152-8d0e-38d4d0fd21db"). InnerVolumeSpecName "kube-api-access-jgjbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:52:33.702710 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:33.702685    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgjbb\" (UniqueName: \"kubernetes.io/projected/4233c2ea-528c-4152-8d0e-38d4d0fd21db-kube-api-access-jgjbb\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:52:34.262580 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:34.262545    2581 generic.go:356] "Generic (PLEG): container finished" podID="4233c2ea-528c-4152-8d0e-38d4d0fd21db" containerID="bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8" exitCode=0
Jul 17 18:52:34.263039 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:34.262589    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lqshk"
Jul 17 18:52:34.263039 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:34.262629    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lqshk" event={"ID":"4233c2ea-528c-4152-8d0e-38d4d0fd21db","Type":"ContainerDied","Data":"bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8"}
Jul 17 18:52:34.263039 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:34.262677    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lqshk" event={"ID":"4233c2ea-528c-4152-8d0e-38d4d0fd21db","Type":"ContainerDied","Data":"63403c7a233aa351fdce81e1c9a0455fbb178807696f914e48d661a958e8ba80"}
Jul 17 18:52:34.263039 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:34.262697    2581 scope.go:117] "RemoveContainer" containerID="bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8"
Jul 17 18:52:34.271264 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:34.271247    2581 scope.go:117] "RemoveContainer" containerID="bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8"
Jul 17 18:52:34.271521 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:52:34.271503    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8\": container with ID starting with bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8 not found: ID does not exist" containerID="bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8"
Jul 17 18:52:34.271558 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:34.271530    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8"} err="failed to get container status \"bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8\": rpc error: code = NotFound desc = could not find container \"bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8\": container with ID starting with bd79028b6ca52a50499ae944fd2b8dd77f17b09f5f36bb37ef80b19764661eb8 not found: ID does not exist"
Jul 17 18:52:34.285871 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:34.285850    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqshk"]
Jul 17 18:52:34.291115 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:34.291098    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lqshk"]
Jul 17 18:52:34.485600 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:34.485576    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4233c2ea-528c-4152-8d0e-38d4d0fd21db" path="/var/lib/kubelet/pods/4233c2ea-528c-4152-8d0e-38d4d0fd21db/volumes"
Jul 17 18:52:40.877924 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:40.877830    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-489sm"
Jul 17 18:52:40.878395 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:40.878101    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-489sm"
Jul 17 18:52:40.901127 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:40.901101    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-489sm"
Jul 17 18:52:41.313278 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:52:41.313242    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-489sm"
Jul 17 18:53:01.853466 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:01.853429    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bppl7"]
Jul 17 18:53:01.853926 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:01.853751    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4233c2ea-528c-4152-8d0e-38d4d0fd21db" containerName="registry-server"
Jul 17 18:53:01.853926 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:01.853762    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4233c2ea-528c-4152-8d0e-38d4d0fd21db" containerName="registry-server"
Jul 17 18:53:01.853926 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:01.853818    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4233c2ea-528c-4152-8d0e-38d4d0fd21db" containerName="registry-server"
Jul 17 18:53:01.856542 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:01.856527    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bppl7"
Jul 17 18:53:01.859662 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:01.859641    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-s7rbh\""
Jul 17 18:53:01.873545 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:01.873523    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bppl7"]
Jul 17 18:53:01.925595 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:01.925564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wfb6\" (UniqueName: \"kubernetes.io/projected/ff3c898a-7698-4b63-960b-f4ecfa2b94fe-kube-api-access-6wfb6\") pod \"authorino-operator-75cc8d5cb7-bppl7\" (UID: \"ff3c898a-7698-4b63-960b-f4ecfa2b94fe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bppl7"
Jul 17 18:53:02.026511 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:02.026457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfb6\" (UniqueName: \"kubernetes.io/projected/ff3c898a-7698-4b63-960b-f4ecfa2b94fe-kube-api-access-6wfb6\") pod \"authorino-operator-75cc8d5cb7-bppl7\" (UID: \"ff3c898a-7698-4b63-960b-f4ecfa2b94fe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bppl7"
Jul 17 18:53:02.036904 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:02.036878    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfb6\" (UniqueName: \"kubernetes.io/projected/ff3c898a-7698-4b63-960b-f4ecfa2b94fe-kube-api-access-6wfb6\") pod \"authorino-operator-75cc8d5cb7-bppl7\" (UID: \"ff3c898a-7698-4b63-960b-f4ecfa2b94fe\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bppl7"
Jul 17 18:53:02.165951 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:02.165924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bppl7"
Jul 17 18:53:02.292762 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:02.292737    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bppl7"]
Jul 17 18:53:02.295516 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:53:02.295487    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3c898a_7698_4b63_960b_f4ecfa2b94fe.slice/crio-d56e7aa63c078132993cdad723263bda54d5a5837b9c3937e593311778ae6a32 WatchSource:0}: Error finding container d56e7aa63c078132993cdad723263bda54d5a5837b9c3937e593311778ae6a32: Status 404 returned error can't find the container with id d56e7aa63c078132993cdad723263bda54d5a5837b9c3937e593311778ae6a32
Jul 17 18:53:02.371302 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:02.371278    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bppl7" event={"ID":"ff3c898a-7698-4b63-960b-f4ecfa2b94fe","Type":"ContainerStarted","Data":"d56e7aa63c078132993cdad723263bda54d5a5837b9c3937e593311778ae6a32"}
Jul 17 18:53:04.618475 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:04.618437    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"]
Jul 17 18:53:04.622138 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:04.622111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:04.625215 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:04.625180    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6glqc\""
Jul 17 18:53:04.635079 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:04.635053    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"]
Jul 17 18:53:04.751592 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:04.751565    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scbpx\" (UniqueName: \"kubernetes.io/projected/1630feb1-d46f-4bce-beac-b7761bb2488a-kube-api-access-scbpx\") pod \"limitador-operator-controller-manager-859d7b78bd-2d7bn\" (UID: \"1630feb1-d46f-4bce-beac-b7761bb2488a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:04.852353 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:04.852320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scbpx\" (UniqueName: \"kubernetes.io/projected/1630feb1-d46f-4bce-beac-b7761bb2488a-kube-api-access-scbpx\") pod \"limitador-operator-controller-manager-859d7b78bd-2d7bn\" (UID: \"1630feb1-d46f-4bce-beac-b7761bb2488a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:04.862542 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:04.862520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scbpx\" (UniqueName: \"kubernetes.io/projected/1630feb1-d46f-4bce-beac-b7761bb2488a-kube-api-access-scbpx\") pod \"limitador-operator-controller-manager-859d7b78bd-2d7bn\" (UID: \"1630feb1-d46f-4bce-beac-b7761bb2488a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:04.935185 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:04.935155    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:05.065767 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:05.065748    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"]
Jul 17 18:53:05.067779 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:53:05.067752    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1630feb1_d46f_4bce_beac_b7761bb2488a.slice/crio-001061f8d7607c353ddbe65690c7e9aaede11e7e439b4d21910a90bebb5a92d0 WatchSource:0}: Error finding container 001061f8d7607c353ddbe65690c7e9aaede11e7e439b4d21910a90bebb5a92d0: Status 404 returned error can't find the container with id 001061f8d7607c353ddbe65690c7e9aaede11e7e439b4d21910a90bebb5a92d0
Jul 17 18:53:05.386536 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:05.386434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bppl7" event={"ID":"ff3c898a-7698-4b63-960b-f4ecfa2b94fe","Type":"ContainerStarted","Data":"78b8983759588bc23731a7972fbe28b3eaf50a198d5bd26522eb51e74628441f"}
Jul 17 18:53:05.386696 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:05.386561    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bppl7"
Jul 17 18:53:05.387740 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:05.387713    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn" event={"ID":"1630feb1-d46f-4bce-beac-b7761bb2488a","Type":"ContainerStarted","Data":"001061f8d7607c353ddbe65690c7e9aaede11e7e439b4d21910a90bebb5a92d0"}
Jul 17 18:53:05.411394 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:05.411349    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bppl7" podStartSLOduration=1.988172418 podStartE2EDuration="4.411336385s" totalImagesPullingTime="2.423163967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:53:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:53:05.409762318 +0000 UTC m=+505.404128333" watchObservedRunningTime="2026-07-17 18:53:05.411336385 +0000 UTC m=+505.405702400"
Jul 17 18:53:07.397736 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:07.397696    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn" event={"ID":"1630feb1-d46f-4bce-beac-b7761bb2488a","Type":"ContainerStarted","Data":"f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878"}
Jul 17 18:53:07.398152 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:07.397789    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:07.420496 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:07.420445    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn" podStartSLOduration=1.8125545760000001 podStartE2EDuration="3.420431968s" totalImagesPullingTime="1.607877392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:53:07.418930794 +0000 UTC m=+507.413296810" watchObservedRunningTime="2026-07-17 18:53:07.420431968 +0000 UTC m=+507.414797982"
Jul 17 18:53:08.485888 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.485858    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"]
Jul 17 18:53:08.489296 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.489273    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:08.492014 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.491994    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sfrlg\""
Jul 17 18:53:08.508977 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.508958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"]
Jul 17 18:53:08.585032 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.585007    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ec86eb9-2616-4f51-90c4-545f591f2c8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" (UID: \"6ec86eb9-2616-4f51-90c4-545f591f2c8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:08.585167 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.585039    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfhb2\" (UniqueName: \"kubernetes.io/projected/6ec86eb9-2616-4f51-90c4-545f591f2c8d-kube-api-access-sfhb2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" (UID: \"6ec86eb9-2616-4f51-90c4-545f591f2c8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:08.686076 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.686045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ec86eb9-2616-4f51-90c4-545f591f2c8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" (UID: \"6ec86eb9-2616-4f51-90c4-545f591f2c8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:08.686076 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.686076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfhb2\" (UniqueName: \"kubernetes.io/projected/6ec86eb9-2616-4f51-90c4-545f591f2c8d-kube-api-access-sfhb2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" (UID: \"6ec86eb9-2616-4f51-90c4-545f591f2c8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:08.686464 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.686447    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ec86eb9-2616-4f51-90c4-545f591f2c8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" (UID: \"6ec86eb9-2616-4f51-90c4-545f591f2c8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:08.696023 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.695996    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfhb2\" (UniqueName: \"kubernetes.io/projected/6ec86eb9-2616-4f51-90c4-545f591f2c8d-kube-api-access-sfhb2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" (UID: \"6ec86eb9-2616-4f51-90c4-545f591f2c8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:08.799247 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.799172    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:08.942945 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:08.942917    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"]
Jul 17 18:53:08.946485 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:53:08.946456    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec86eb9_2616_4f51_90c4_545f591f2c8d.slice/crio-28cdd56a9d000899fb5d834190c99337ec24f3e7f53694736157f4e6dbfd90c9 WatchSource:0}: Error finding container 28cdd56a9d000899fb5d834190c99337ec24f3e7f53694736157f4e6dbfd90c9: Status 404 returned error can't find the container with id 28cdd56a9d000899fb5d834190c99337ec24f3e7f53694736157f4e6dbfd90c9
Jul 17 18:53:09.408751 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:09.408717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h" event={"ID":"6ec86eb9-2616-4f51-90c4-545f591f2c8d","Type":"ContainerStarted","Data":"28cdd56a9d000899fb5d834190c99337ec24f3e7f53694736157f4e6dbfd90c9"}
Jul 17 18:53:11.593323 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:11.593291    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz"]
Jul 17 18:53:11.596940 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:11.596919    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz"
Jul 17 18:53:11.599666 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:11.599644    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 18:53:11.599833 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:11.599804    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sn49f\""
Jul 17 18:53:11.609711 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:11.609690    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz"]
Jul 17 18:53:11.712488 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:11.712453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq99m\" (UniqueName: \"kubernetes.io/projected/81697aaf-6bdf-4062-8053-8f250af6bf47-kube-api-access-hq99m\") pod \"dns-operator-controller-manager-864dd78c4c-snjzz\" (UID: \"81697aaf-6bdf-4062-8053-8f250af6bf47\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz"
Jul 17 18:53:11.813029 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:11.812989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq99m\" (UniqueName: \"kubernetes.io/projected/81697aaf-6bdf-4062-8053-8f250af6bf47-kube-api-access-hq99m\") pod \"dns-operator-controller-manager-864dd78c4c-snjzz\" (UID: \"81697aaf-6bdf-4062-8053-8f250af6bf47\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz"
Jul 17 18:53:11.823392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:11.823365    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq99m\" (UniqueName: \"kubernetes.io/projected/81697aaf-6bdf-4062-8053-8f250af6bf47-kube-api-access-hq99m\") pod \"dns-operator-controller-manager-864dd78c4c-snjzz\" (UID: \"81697aaf-6bdf-4062-8053-8f250af6bf47\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz"
Jul 17 18:53:11.908551 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:11.908523    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz"
Jul 17 18:53:12.061988 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:12.061956    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz"]
Jul 17 18:53:12.065269 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:53:12.065239    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81697aaf_6bdf_4062_8053_8f250af6bf47.slice/crio-3895621b4990fb9b599b1996e3da0807f957f2b0c7ac28177f2ac450ca4f5395 WatchSource:0}: Error finding container 3895621b4990fb9b599b1996e3da0807f957f2b0c7ac28177f2ac450ca4f5395: Status 404 returned error can't find the container with id 3895621b4990fb9b599b1996e3da0807f957f2b0c7ac28177f2ac450ca4f5395
Jul 17 18:53:12.423849 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:12.423806    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz" event={"ID":"81697aaf-6bdf-4062-8053-8f250af6bf47","Type":"ContainerStarted","Data":"3895621b4990fb9b599b1996e3da0807f957f2b0c7ac28177f2ac450ca4f5395"}
Jul 17 18:53:15.442137 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:15.442105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h" event={"ID":"6ec86eb9-2616-4f51-90c4-545f591f2c8d","Type":"ContainerStarted","Data":"6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5"}
Jul 17 18:53:15.442575 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:15.442239    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:15.443737 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:15.443717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz" event={"ID":"81697aaf-6bdf-4062-8053-8f250af6bf47","Type":"ContainerStarted","Data":"5dbb975b5a8000d399a8837258a744e19a28341a45ddd5a5959f087ea63fba78"}
Jul 17 18:53:15.443859 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:15.443844    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz"
Jul 17 18:53:15.465318 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:15.465268    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h" podStartSLOduration=1.5593984600000002 podStartE2EDuration="7.46525339s" totalImagesPullingTime="5.90585493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:53:15.4635741 +0000 UTC m=+515.457940124" watchObservedRunningTime="2026-07-17 18:53:15.46525339 +0000 UTC m=+515.459619408"
Jul 17 18:53:15.486925 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:15.486878    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz" podStartSLOduration=1.649577081 podStartE2EDuration="4.486865707s" totalImagesPullingTime="2.837288626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:53:15.485759927 +0000 UTC m=+515.480125953" watchObservedRunningTime="2026-07-17 18:53:15.486865707 +0000 UTC m=+515.481231722"
Jul 17 18:53:16.394320 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:16.394291    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bppl7"
Jul 17 18:53:17.783252 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:17.783218    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"]
Jul 17 18:53:17.786769 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:17.786753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:17.789618 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:17.789430    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 17 18:53:17.789618 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:17.789432    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 17 18:53:17.789618 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:17.789570    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6k9sw\""
Jul 17 18:53:17.798328 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:17.798308    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"]
Jul 17 18:53:17.965475 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:17.965445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sgfh2\" (UID: \"0b51a14e-ee10-48cf-a826-ca0cc962c6ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:17.965645 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:17.965491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bcz8\" (UniqueName: \"kubernetes.io/projected/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-kube-api-access-8bcz8\") pod \"kuadrant-console-plugin-66b5774985-sgfh2\" (UID: \"0b51a14e-ee10-48cf-a826-ca0cc962c6ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:17.965645 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:17.965548    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sgfh2\" (UID: \"0b51a14e-ee10-48cf-a826-ca0cc962c6ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:18.066776 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:18.066690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sgfh2\" (UID: \"0b51a14e-ee10-48cf-a826-ca0cc962c6ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:18.066776 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:18.066738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bcz8\" (UniqueName: \"kubernetes.io/projected/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-kube-api-access-8bcz8\") pod \"kuadrant-console-plugin-66b5774985-sgfh2\" (UID: \"0b51a14e-ee10-48cf-a826-ca0cc962c6ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:18.066776 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:18.066771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sgfh2\" (UID: \"0b51a14e-ee10-48cf-a826-ca0cc962c6ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:18.066982 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:18.066903    2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 17 18:53:18.066982 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:18.066968    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-plugin-serving-cert podName:0b51a14e-ee10-48cf-a826-ca0cc962c6ae nodeName:}" failed. No retries permitted until 2026-07-17 18:53:18.566948354 +0000 UTC m=+518.561314346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-sgfh2" (UID: "0b51a14e-ee10-48cf-a826-ca0cc962c6ae") : secret "plugin-serving-cert" not found
Jul 17 18:53:18.067386 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:18.067368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sgfh2\" (UID: \"0b51a14e-ee10-48cf-a826-ca0cc962c6ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:18.085972 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:18.085948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bcz8\" (UniqueName: \"kubernetes.io/projected/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-kube-api-access-8bcz8\") pod \"kuadrant-console-plugin-66b5774985-sgfh2\" (UID: \"0b51a14e-ee10-48cf-a826-ca0cc962c6ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:18.406769 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:18.406742    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:18.571718 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:18.571684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sgfh2\" (UID: \"0b51a14e-ee10-48cf-a826-ca0cc962c6ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:18.574327 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:18.574302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b51a14e-ee10-48cf-a826-ca0cc962c6ae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sgfh2\" (UID: \"0b51a14e-ee10-48cf-a826-ca0cc962c6ae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:18.696378 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:18.696302    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"
Jul 17 18:53:18.832812 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:18.832792    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2"]
Jul 17 18:53:18.835058 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:53:18.835029    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b51a14e_ee10_48cf_a826_ca0cc962c6ae.slice/crio-764cd6e4d002cf3491cedd432cc18f83a3585a9e340689f6bf6ee2915822490d WatchSource:0}: Error finding container 764cd6e4d002cf3491cedd432cc18f83a3585a9e340689f6bf6ee2915822490d: Status 404 returned error can't find the container with id 764cd6e4d002cf3491cedd432cc18f83a3585a9e340689f6bf6ee2915822490d
Jul 17 18:53:19.463348 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:19.463315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2" event={"ID":"0b51a14e-ee10-48cf-a826-ca0cc962c6ae","Type":"ContainerStarted","Data":"764cd6e4d002cf3491cedd432cc18f83a3585a9e340689f6bf6ee2915822490d"}
Jul 17 18:53:26.451718 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:26.451686    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-snjzz"
Jul 17 18:53:26.452057 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:26.451756    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:28.220766 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.220730    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"]
Jul 17 18:53:28.221249 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.220959    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" containerName="manager" containerID="cri-o://6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5" gracePeriod=2
Jul 17 18:53:28.224053 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:28.224012    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:28.226836 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.226810    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"]
Jul 17 18:53:28.251243 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.251175    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"]
Jul 17 18:53:28.251628 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.251585    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" containerName="manager"
Jul 17 18:53:28.251628 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.251605    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" containerName="manager"
Jul 17 18:53:28.251769 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.251695    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" containerName="manager"
Jul 17 18:53:28.255003 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.254983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:28.258480 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:28.258446    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:28.266025 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.265423    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"]
Jul 17 18:53:28.266025 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.265649    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn" podUID="1630feb1-d46f-4bce-beac-b7761bb2488a" containerName="manager" containerID="cri-o://f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878" gracePeriod=2
Jul 17 18:53:28.273542 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.271920    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"]
Jul 17 18:53:28.283848 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.283825    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"]
Jul 17 18:53:28.292882 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:28.292849    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:28.295364 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:28.295338    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2d7bn\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="1630feb1-d46f-4bce-beac-b7761bb2488a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:28.304962 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.304936    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml"]
Jul 17 18:53:28.305398 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.305384    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1630feb1-d46f-4bce-beac-b7761bb2488a" containerName="manager"
Jul 17 18:53:28.305398 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.305399    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1630feb1-d46f-4bce-beac-b7761bb2488a" containerName="manager"
Jul 17 18:53:28.305562 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.305463    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1630feb1-d46f-4bce-beac-b7761bb2488a" containerName="manager"
Jul 17 18:53:28.309710 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.309691    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml"
Jul 17 18:53:28.313192 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:28.313161    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2d7bn\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="1630feb1-d46f-4bce-beac-b7761bb2488a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:28.320924 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.320902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml"]
Jul 17 18:53:28.342774 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:28.342739    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:28.357657 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.357632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/010e72be-78c7-49b5-917d-acdfd00b4f14-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9hbgz\" (UID: \"010e72be-78c7-49b5-917d-acdfd00b4f14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:28.357786 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.357670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhpv8\" (UniqueName: \"kubernetes.io/projected/ef2af7c4-b849-4879-bbdc-116a02a5494f-kube-api-access-nhpv8\") pod \"limitador-operator-controller-manager-859d7b78bd-9p2ml\" (UID: \"ef2af7c4-b849-4879-bbdc-116a02a5494f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml"
Jul 17 18:53:28.357786 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.357752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n76zx\" (UniqueName: \"kubernetes.io/projected/010e72be-78c7-49b5-917d-acdfd00b4f14-kube-api-access-n76zx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9hbgz\" (UID: \"010e72be-78c7-49b5-917d-acdfd00b4f14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:28.458327 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.458287    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n76zx\" (UniqueName: \"kubernetes.io/projected/010e72be-78c7-49b5-917d-acdfd00b4f14-kube-api-access-n76zx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9hbgz\" (UID: \"010e72be-78c7-49b5-917d-acdfd00b4f14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:28.458510 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.458380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/010e72be-78c7-49b5-917d-acdfd00b4f14-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9hbgz\" (UID: \"010e72be-78c7-49b5-917d-acdfd00b4f14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:28.458510 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.458416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhpv8\" (UniqueName: \"kubernetes.io/projected/ef2af7c4-b849-4879-bbdc-116a02a5494f-kube-api-access-nhpv8\") pod \"limitador-operator-controller-manager-859d7b78bd-9p2ml\" (UID: \"ef2af7c4-b849-4879-bbdc-116a02a5494f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml"
Jul 17 18:53:28.458801 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.458783    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/010e72be-78c7-49b5-917d-acdfd00b4f14-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9hbgz\" (UID: \"010e72be-78c7-49b5-917d-acdfd00b4f14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:28.476128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.476055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhpv8\" (UniqueName: \"kubernetes.io/projected/ef2af7c4-b849-4879-bbdc-116a02a5494f-kube-api-access-nhpv8\") pod \"limitador-operator-controller-manager-859d7b78bd-9p2ml\" (UID: \"ef2af7c4-b849-4879-bbdc-116a02a5494f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml"
Jul 17 18:53:28.476128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.476097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n76zx\" (UniqueName: \"kubernetes.io/projected/010e72be-78c7-49b5-917d-acdfd00b4f14-kube-api-access-n76zx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9hbgz\" (UID: \"010e72be-78c7-49b5-917d-acdfd00b4f14\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:28.636599 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.636526    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:28.645155 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:28.645127    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml"
Jul 17 18:53:29.404827 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:29.404777    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn" podUID="1630feb1-d46f-4bce-beac-b7761bb2488a" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.26:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 18:53:41.959673 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:41.959638    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"]
Jul 17 18:53:41.963139 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:53:41.963108    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010e72be_78c7_49b5_917d_acdfd00b4f14.slice/crio-062bddb055a356abf256d333adf8c94b4079b3e6acd38217ca1061dfd3b49c22 WatchSource:0}: Error finding container 062bddb055a356abf256d333adf8c94b4079b3e6acd38217ca1061dfd3b49c22: Status 404 returned error can't find the container with id 062bddb055a356abf256d333adf8c94b4079b3e6acd38217ca1061dfd3b49c22
Jul 17 18:53:41.974397 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:41.974370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml"]
Jul 17 18:53:42.164565 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:53:42.164524    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2af7c4_b849_4879_bbdc_116a02a5494f.slice/crio-1ef383ba2b8fb1553e0e41325d84b575ffb26beed60e39fa14f8353170ae7bce WatchSource:0}: Error finding container 1ef383ba2b8fb1553e0e41325d84b575ffb26beed60e39fa14f8353170ae7bce: Status 404 returned error can't find the container with id 1ef383ba2b8fb1553e0e41325d84b575ffb26beed60e39fa14f8353170ae7bce
Jul 17 18:53:42.188819 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.188799    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:42.191004 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:42.190976    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:42.222832 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.222813    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:42.224878 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:42.224856    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2d7bn\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="1630feb1-d46f-4bce-beac-b7761bb2488a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:42.226846 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:42.226812    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:42.285265 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.285244    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ec86eb9-2616-4f51-90c4-545f591f2c8d-extensions-socket-volume\") pod \"6ec86eb9-2616-4f51-90c4-545f591f2c8d\" (UID: \"6ec86eb9-2616-4f51-90c4-545f591f2c8d\") "
Jul 17 18:53:42.285380 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.285278    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scbpx\" (UniqueName: \"kubernetes.io/projected/1630feb1-d46f-4bce-beac-b7761bb2488a-kube-api-access-scbpx\") pod \"1630feb1-d46f-4bce-beac-b7761bb2488a\" (UID: \"1630feb1-d46f-4bce-beac-b7761bb2488a\") "
Jul 17 18:53:42.285380 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.285339    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfhb2\" (UniqueName: \"kubernetes.io/projected/6ec86eb9-2616-4f51-90c4-545f591f2c8d-kube-api-access-sfhb2\") pod \"6ec86eb9-2616-4f51-90c4-545f591f2c8d\" (UID: \"6ec86eb9-2616-4f51-90c4-545f591f2c8d\") "
Jul 17 18:53:42.286164 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.286140    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec86eb9-2616-4f51-90c4-545f591f2c8d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6ec86eb9-2616-4f51-90c4-545f591f2c8d" (UID: "6ec86eb9-2616-4f51-90c4-545f591f2c8d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:53:42.287457 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.287430    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec86eb9-2616-4f51-90c4-545f591f2c8d-kube-api-access-sfhb2" (OuterVolumeSpecName: "kube-api-access-sfhb2") pod "6ec86eb9-2616-4f51-90c4-545f591f2c8d" (UID: "6ec86eb9-2616-4f51-90c4-545f591f2c8d"). InnerVolumeSpecName "kube-api-access-sfhb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:53:42.288174 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.288154    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1630feb1-d46f-4bce-beac-b7761bb2488a-kube-api-access-scbpx" (OuterVolumeSpecName: "kube-api-access-scbpx") pod "1630feb1-d46f-4bce-beac-b7761bb2488a" (UID: "1630feb1-d46f-4bce-beac-b7761bb2488a"). InnerVolumeSpecName "kube-api-access-scbpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:53:42.386817 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.386782    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfhb2\" (UniqueName: \"kubernetes.io/projected/6ec86eb9-2616-4f51-90c4-545f591f2c8d-kube-api-access-sfhb2\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:53:42.386817 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.386808    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ec86eb9-2616-4f51-90c4-545f591f2c8d-extensions-socket-volume\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:53:42.386817 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.386819    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scbpx\" (UniqueName: \"kubernetes.io/projected/1630feb1-d46f-4bce-beac-b7761bb2488a-kube-api-access-scbpx\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:53:42.488057 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.487973    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1630feb1-d46f-4bce-beac-b7761bb2488a" path="/var/lib/kubelet/pods/1630feb1-d46f-4bce-beac-b7761bb2488a/volumes"
Jul 17 18:53:42.488466 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.488448    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" path="/var/lib/kubelet/pods/6ec86eb9-2616-4f51-90c4-545f591f2c8d/volumes"
Jul 17 18:53:42.583559 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.583526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz" event={"ID":"010e72be-78c7-49b5-917d-acdfd00b4f14","Type":"ContainerStarted","Data":"0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994"}
Jul 17 18:53:42.583798 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.583590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz" event={"ID":"010e72be-78c7-49b5-917d-acdfd00b4f14","Type":"ContainerStarted","Data":"062bddb055a356abf256d333adf8c94b4079b3e6acd38217ca1061dfd3b49c22"}
Jul 17 18:53:42.583798 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.583650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:42.585119 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.585095    2581 generic.go:356] "Generic (PLEG): container finished" podID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" containerID="6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5" exitCode=0
Jul 17 18:53:42.585269 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.585254    2581 scope.go:117] "RemoveContainer" containerID="6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5"
Jul 17 18:53:42.585429 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.585409    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:42.588853 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.588814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2" event={"ID":"0b51a14e-ee10-48cf-a826-ca0cc962c6ae","Type":"ContainerStarted","Data":"cca2a05905851eb4b07d5122de62819f7c90dbc9a60a51a0e77edbe8d542561a"}
Jul 17 18:53:42.590360 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.590343    2581 generic.go:356] "Generic (PLEG): container finished" podID="1630feb1-d46f-4bce-beac-b7761bb2488a" containerID="f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878" exitCode=0
Jul 17 18:53:42.590446 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.590378    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:42.594653 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.594318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml" event={"ID":"ef2af7c4-b849-4879-bbdc-116a02a5494f","Type":"ContainerStarted","Data":"776e50fe812cc527f56bb6b4e25cc087c7bbb4ad89532478150d9488c85d2a25"}
Jul 17 18:53:42.594653 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.594365    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml" event={"ID":"ef2af7c4-b849-4879-bbdc-116a02a5494f","Type":"ContainerStarted","Data":"1ef383ba2b8fb1553e0e41325d84b575ffb26beed60e39fa14f8353170ae7bce"}
Jul 17 18:53:42.594821 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.594712    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml"
Jul 17 18:53:42.597053 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.597033    2581 scope.go:117] "RemoveContainer" containerID="6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5"
Jul 17 18:53:42.597324 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:42.597307    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5\": container with ID starting with 6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5 not found: ID does not exist" containerID="6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5"
Jul 17 18:53:42.597392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.597331    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5"} err="failed to get container status \"6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5\": rpc error: code = NotFound desc = could not find container \"6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5\": container with ID starting with 6cae63153939032800fa2010e2a6a1df4320937a00ca725ec945c24762a8ccb5 not found: ID does not exist"
Jul 17 18:53:42.597392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.597346    2581 scope.go:117] "RemoveContainer" containerID="f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878"
Jul 17 18:53:42.604624 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.604608    2581 scope.go:117] "RemoveContainer" containerID="f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878"
Jul 17 18:53:42.604884 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:42.604867    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878\": container with ID starting with f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878 not found: ID does not exist" containerID="f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878"
Jul 17 18:53:42.604936 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.604889    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878"} err="failed to get container status \"f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878\": rpc error: code = NotFound desc = could not find container \"f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878\": container with ID starting with f43e62821714d37324f29e3c562435e72b9c3b3a6facb0dc2241b8fc2b442878 not found: ID does not exist"
Jul 17 18:53:42.634932 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:42.634899    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tm86h\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="6ec86eb9-2616-4f51-90c4-545f591f2c8d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tm86h"
Jul 17 18:53:42.635652 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.635620    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz" podStartSLOduration=14.635607939 podStartE2EDuration="14.635607939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:53:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:53:42.632360386 +0000 UTC m=+542.626726412" watchObservedRunningTime="2026-07-17 18:53:42.635607939 +0000 UTC m=+542.629974022"
Jul 17 18:53:42.681443 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.681409    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sgfh2" podStartSLOduration=2.301844605 podStartE2EDuration="25.681396548s" totalImagesPullingTime="23.379551943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:53:42.680603276 +0000 UTC m=+542.674969292" watchObservedRunningTime="2026-07-17 18:53:42.681396548 +0000 UTC m=+542.675762571"
Jul 17 18:53:42.683388 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:42.683363    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2d7bn\" is forbidden: User \"system:node:ip-10-0-137-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-97.ec2.internal' and this object" podUID="1630feb1-d46f-4bce-beac-b7761bb2488a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d7bn"
Jul 17 18:53:42.726774 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:42.726735    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml" podStartSLOduration=14.72672147 podStartE2EDuration="14.72672147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:53:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:53:42.724187296 +0000 UTC m=+542.718553333" watchObservedRunningTime="2026-07-17 18:53:42.72672147 +0000 UTC m=+542.721087485"
Jul 17 18:53:45.207902 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.207866    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"]
Jul 17 18:53:45.208327 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.208037    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz" podUID="010e72be-78c7-49b5-917d-acdfd00b4f14" containerName="manager" containerID="cri-o://0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994" gracePeriod=10
Jul 17 18:53:45.484627 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.484559    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:45.610685 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.610654    2581 generic.go:356] "Generic (PLEG): container finished" podID="010e72be-78c7-49b5-917d-acdfd00b4f14" containerID="0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994" exitCode=0
Jul 17 18:53:45.610829 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.610701    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"
Jul 17 18:53:45.610829 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.610738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz" event={"ID":"010e72be-78c7-49b5-917d-acdfd00b4f14","Type":"ContainerDied","Data":"0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994"}
Jul 17 18:53:45.610829 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.610793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz" event={"ID":"010e72be-78c7-49b5-917d-acdfd00b4f14","Type":"ContainerDied","Data":"062bddb055a356abf256d333adf8c94b4079b3e6acd38217ca1061dfd3b49c22"}
Jul 17 18:53:45.610829 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.610824    2581 scope.go:117] "RemoveContainer" containerID="0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994"
Jul 17 18:53:45.614069 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.614051    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/010e72be-78c7-49b5-917d-acdfd00b4f14-extensions-socket-volume\") pod \"010e72be-78c7-49b5-917d-acdfd00b4f14\" (UID: \"010e72be-78c7-49b5-917d-acdfd00b4f14\") "
Jul 17 18:53:45.614179 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.614088    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n76zx\" (UniqueName: \"kubernetes.io/projected/010e72be-78c7-49b5-917d-acdfd00b4f14-kube-api-access-n76zx\") pod \"010e72be-78c7-49b5-917d-acdfd00b4f14\" (UID: \"010e72be-78c7-49b5-917d-acdfd00b4f14\") "
Jul 17 18:53:45.614532 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.614503    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010e72be-78c7-49b5-917d-acdfd00b4f14-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "010e72be-78c7-49b5-917d-acdfd00b4f14" (UID: "010e72be-78c7-49b5-917d-acdfd00b4f14"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:53:45.616664 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.616636    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010e72be-78c7-49b5-917d-acdfd00b4f14-kube-api-access-n76zx" (OuterVolumeSpecName: "kube-api-access-n76zx") pod "010e72be-78c7-49b5-917d-acdfd00b4f14" (UID: "010e72be-78c7-49b5-917d-acdfd00b4f14"). InnerVolumeSpecName "kube-api-access-n76zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:53:45.619646 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.619631    2581 scope.go:117] "RemoveContainer" containerID="0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994"
Jul 17 18:53:45.619921 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:53:45.619904    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994\": container with ID starting with 0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994 not found: ID does not exist" containerID="0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994"
Jul 17 18:53:45.620008 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.619927    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994"} err="failed to get container status \"0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994\": rpc error: code = NotFound desc = could not find container \"0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994\": container with ID starting with 0dea461ca685116a7b0505c52e5f86f523eca32322f661b3ee2d7f6afcbeb994 not found: ID does not exist"
Jul 17 18:53:45.714756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.714725    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/010e72be-78c7-49b5-917d-acdfd00b4f14-extensions-socket-volume\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:53:45.714756 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.714749    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n76zx\" (UniqueName: \"kubernetes.io/projected/010e72be-78c7-49b5-917d-acdfd00b4f14-kube-api-access-n76zx\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:53:45.937753 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.937726    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"]
Jul 17 18:53:45.943142 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:45.943116    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9hbgz"]
Jul 17 18:53:46.487474 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:46.487434    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="010e72be-78c7-49b5-917d-acdfd00b4f14" path="/var/lib/kubelet/pods/010e72be-78c7-49b5-917d-acdfd00b4f14/volumes"
Jul 17 18:53:53.602965 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:53:53.602933    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9p2ml"
Jul 17 18:54:01.558833 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.558804    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"]
Jul 17 18:54:01.559224 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.559117    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010e72be-78c7-49b5-917d-acdfd00b4f14" containerName="manager"
Jul 17 18:54:01.559224 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.559127    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="010e72be-78c7-49b5-917d-acdfd00b4f14" containerName="manager"
Jul 17 18:54:01.559224 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.559178    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="010e72be-78c7-49b5-917d-acdfd00b4f14" containerName="manager"
Jul 17 18:54:01.599539 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.599506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"]
Jul 17 18:54:01.599708 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.599634    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.603890 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.603866    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5dkd4\""
Jul 17 18:54:01.754748 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.754707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.754748 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.754743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7d507d-b164-4843-8d11-82d74270351d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.754956 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.754806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.754956 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.754854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.754956 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.754873    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.754956 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.754891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7d507d-b164-4843-8d11-82d74270351d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.754956 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.754907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn8zb\" (UniqueName: \"kubernetes.io/projected/fb7d507d-b164-4843-8d11-82d74270351d-kube-api-access-dn8zb\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.754956 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.754941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.755162 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.754980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7d507d-b164-4843-8d11-82d74270351d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.855999    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856040    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856085 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856379 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7d507d-b164-4843-8d11-82d74270351d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856379 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn8zb\" (UniqueName: \"kubernetes.io/projected/fb7d507d-b164-4843-8d11-82d74270351d-kube-api-access-dn8zb\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856379 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856379 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7d507d-b164-4843-8d11-82d74270351d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856579 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856579 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7d507d-b164-4843-8d11-82d74270351d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856579 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856723 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856774 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.856827 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856800    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.857045 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.856937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb7d507d-b164-4843-8d11-82d74270351d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.858533 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.858510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb7d507d-b164-4843-8d11-82d74270351d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.858905 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.858883    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb7d507d-b164-4843-8d11-82d74270351d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.865300 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.865257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb7d507d-b164-4843-8d11-82d74270351d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.865874 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.865853    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn8zb\" (UniqueName: \"kubernetes.io/projected/fb7d507d-b164-4843-8d11-82d74270351d-kube-api-access-dn8zb\") pod \"maas-default-gateway-openshift-default-56654dcf7-62rjv\" (UID: \"fb7d507d-b164-4843-8d11-82d74270351d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:01.910139 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:01.910107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:02.044629 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:02.044603    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"]
Jul 17 18:54:02.047317 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:54:02.047290    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb7d507d_b164_4843_8d11_82d74270351d.slice/crio-ec76372c13709ade0b269f7c8f9839fee7014c787c746af3663a9ff3e64e76ca WatchSource:0}: Error finding container ec76372c13709ade0b269f7c8f9839fee7014c787c746af3663a9ff3e64e76ca: Status 404 returned error can't find the container with id ec76372c13709ade0b269f7c8f9839fee7014c787c746af3663a9ff3e64e76ca
Jul 17 18:54:02.050069 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:02.050033    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:54:02.050146 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:02.050100    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:54:02.050146 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:02.050129    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:54:02.685701 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:02.685662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv" event={"ID":"fb7d507d-b164-4843-8d11-82d74270351d","Type":"ContainerStarted","Data":"3e44fb2479fb5dcba27bda1f51880bbbd7aff604b530a153c273d835c8de37e7"}
Jul 17 18:54:02.686079 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:02.685719    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv" event={"ID":"fb7d507d-b164-4843-8d11-82d74270351d","Type":"ContainerStarted","Data":"ec76372c13709ade0b269f7c8f9839fee7014c787c746af3663a9ff3e64e76ca"}
Jul 17 18:54:02.712908 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:02.712859    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv" podStartSLOduration=1.7128436 podStartE2EDuration="1.7128436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:02.711505428 +0000 UTC m=+562.705871444" watchObservedRunningTime="2026-07-17 18:54:02.7128436 +0000 UTC m=+562.707209615"
Jul 17 18:54:02.911156 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:02.911127    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:03.714234 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.714184    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"]
Jul 17 18:54:03.716723 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.716700    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:03.723499 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.723476    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 18:54:03.729981 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.729957    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"]
Jul 17 18:54:03.808779 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.808749    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"]
Jul 17 18:54:03.875252 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.875192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c92sq\" (UniqueName: \"kubernetes.io/projected/519483aa-afe9-466b-ba88-f3a38919fa7a-kube-api-access-c92sq\") pod \"limitador-limitador-64c94fd64f-pg5rq\" (UID: \"519483aa-afe9-466b-ba88-f3a38919fa7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:03.875422 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.875272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/519483aa-afe9-466b-ba88-f3a38919fa7a-config-file\") pod \"limitador-limitador-64c94fd64f-pg5rq\" (UID: \"519483aa-afe9-466b-ba88-f3a38919fa7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:03.922247 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.922175    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:03.975791 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.975721    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/519483aa-afe9-466b-ba88-f3a38919fa7a-config-file\") pod \"limitador-limitador-64c94fd64f-pg5rq\" (UID: \"519483aa-afe9-466b-ba88-f3a38919fa7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:03.975922 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.975799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c92sq\" (UniqueName: \"kubernetes.io/projected/519483aa-afe9-466b-ba88-f3a38919fa7a-kube-api-access-c92sq\") pod \"limitador-limitador-64c94fd64f-pg5rq\" (UID: \"519483aa-afe9-466b-ba88-f3a38919fa7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:03.976341 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.976324    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/519483aa-afe9-466b-ba88-f3a38919fa7a-config-file\") pod \"limitador-limitador-64c94fd64f-pg5rq\" (UID: \"519483aa-afe9-466b-ba88-f3a38919fa7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:03.984838 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:03.984815    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c92sq\" (UniqueName: \"kubernetes.io/projected/519483aa-afe9-466b-ba88-f3a38919fa7a-kube-api-access-c92sq\") pod \"limitador-limitador-64c94fd64f-pg5rq\" (UID: \"519483aa-afe9-466b-ba88-f3a38919fa7a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:04.027328 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.027304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:04.164128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.164073    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"]
Jul 17 18:54:04.166254 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:54:04.166226    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519483aa_afe9_466b_ba88_f3a38919fa7a.slice/crio-bb1b763b16f1f02cc9b9dcbcc08fa0dcd4cfcb98cdb18746842619d5bcd49adc WatchSource:0}: Error finding container bb1b763b16f1f02cc9b9dcbcc08fa0dcd4cfcb98cdb18746842619d5bcd49adc: Status 404 returned error can't find the container with id bb1b763b16f1f02cc9b9dcbcc08fa0dcd4cfcb98cdb18746842619d5bcd49adc
Jul 17 18:54:04.661086 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.661053    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7qwbj"]
Jul 17 18:54:04.663690 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.663675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7qwbj"
Jul 17 18:54:04.666706 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.666689    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rdvvm\""
Jul 17 18:54:04.669446 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.669414    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7qwbj"]
Jul 17 18:54:04.696179 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.696158    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq" event={"ID":"519483aa-afe9-466b-ba88-f3a38919fa7a","Type":"ContainerStarted","Data":"bb1b763b16f1f02cc9b9dcbcc08fa0dcd4cfcb98cdb18746842619d5bcd49adc"}
Jul 17 18:54:04.696387 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.696371    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:04.697395 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.697381    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:54:04.782026 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.781996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd6q8\" (UniqueName: \"kubernetes.io/projected/3cc48558-2c25-47f7-8847-18297b562fad-kube-api-access-kd6q8\") pod \"authorino-75d556bd77-7qwbj\" (UID: \"3cc48558-2c25-47f7-8847-18297b562fad\") " pod="kuadrant-system/authorino-75d556bd77-7qwbj"
Jul 17 18:54:04.883217 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.883161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd6q8\" (UniqueName: \"kubernetes.io/projected/3cc48558-2c25-47f7-8847-18297b562fad-kube-api-access-kd6q8\") pod \"authorino-75d556bd77-7qwbj\" (UID: \"3cc48558-2c25-47f7-8847-18297b562fad\") " pod="kuadrant-system/authorino-75d556bd77-7qwbj"
Jul 17 18:54:04.893135 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.893111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd6q8\" (UniqueName: \"kubernetes.io/projected/3cc48558-2c25-47f7-8847-18297b562fad-kube-api-access-kd6q8\") pod \"authorino-75d556bd77-7qwbj\" (UID: \"3cc48558-2c25-47f7-8847-18297b562fad\") " pod="kuadrant-system/authorino-75d556bd77-7qwbj"
Jul 17 18:54:04.973729 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:04.973673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7qwbj"
Jul 17 18:54:05.149344 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:05.149280    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7qwbj"]
Jul 17 18:54:05.154683 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:54:05.154652    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cc48558_2c25_47f7_8847_18297b562fad.slice/crio-b5522e900c5841ccb6f55a223c868a3402fde88dd58cc933e80719a67cf7cf69 WatchSource:0}: Error finding container b5522e900c5841ccb6f55a223c868a3402fde88dd58cc933e80719a67cf7cf69: Status 404 returned error can't find the container with id b5522e900c5841ccb6f55a223c868a3402fde88dd58cc933e80719a67cf7cf69
Jul 17 18:54:05.703824 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:05.703789    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7qwbj" event={"ID":"3cc48558-2c25-47f7-8847-18297b562fad","Type":"ContainerStarted","Data":"b5522e900c5841ccb6f55a223c868a3402fde88dd58cc933e80719a67cf7cf69"}
Jul 17 18:54:09.725556 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:09.725517    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq" event={"ID":"519483aa-afe9-466b-ba88-f3a38919fa7a","Type":"ContainerStarted","Data":"f3640901500e3821d5f75ba741ad5d9766669f9d3d855ad47e60ef72b01f1022"}
Jul 17 18:54:09.726238 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:09.725622    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:09.727049 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:09.727026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7qwbj" event={"ID":"3cc48558-2c25-47f7-8847-18297b562fad","Type":"ContainerStarted","Data":"796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49"}
Jul 17 18:54:09.744917 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:09.744870    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq" podStartSLOduration=1.811090064 podStartE2EDuration="6.744857145s" totalImagesPullingTime="4.933767081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:09.743052271 +0000 UTC m=+569.737418287" watchObservedRunningTime="2026-07-17 18:54:09.744857145 +0000 UTC m=+569.739223159"
Jul 17 18:54:09.763715 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:09.763676    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7qwbj" podStartSLOduration=1.818379119 podStartE2EDuration="5.763662816s" totalImagesPullingTime="3.945283697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:09.761997754 +0000 UTC m=+569.756363782" watchObservedRunningTime="2026-07-17 18:54:09.763662816 +0000 UTC m=+569.758028831"
Jul 17 18:54:20.732889 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:20.732856    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:21.315683 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:21.315645    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"]
Jul 17 18:54:21.315942 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:21.315902    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq" podUID="519483aa-afe9-466b-ba88-f3a38919fa7a" containerName="limitador" containerID="cri-o://f3640901500e3821d5f75ba741ad5d9766669f9d3d855ad47e60ef72b01f1022" gracePeriod=30
Jul 17 18:54:21.794304 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:21.794191    2581 generic.go:356] "Generic (PLEG): container finished" podID="519483aa-afe9-466b-ba88-f3a38919fa7a" containerID="f3640901500e3821d5f75ba741ad5d9766669f9d3d855ad47e60ef72b01f1022" exitCode=0
Jul 17 18:54:21.794304 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:21.794235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq" event={"ID":"519483aa-afe9-466b-ba88-f3a38919fa7a","Type":"ContainerDied","Data":"f3640901500e3821d5f75ba741ad5d9766669f9d3d855ad47e60ef72b01f1022"}
Jul 17 18:54:21.867539 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:21.867521    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:21.925701 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:21.925681    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c92sq\" (UniqueName: \"kubernetes.io/projected/519483aa-afe9-466b-ba88-f3a38919fa7a-kube-api-access-c92sq\") pod \"519483aa-afe9-466b-ba88-f3a38919fa7a\" (UID: \"519483aa-afe9-466b-ba88-f3a38919fa7a\") "
Jul 17 18:54:21.925812 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:21.925713    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/519483aa-afe9-466b-ba88-f3a38919fa7a-config-file\") pod \"519483aa-afe9-466b-ba88-f3a38919fa7a\" (UID: \"519483aa-afe9-466b-ba88-f3a38919fa7a\") "
Jul 17 18:54:21.926061 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:21.926038    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519483aa-afe9-466b-ba88-f3a38919fa7a-config-file" (OuterVolumeSpecName: "config-file") pod "519483aa-afe9-466b-ba88-f3a38919fa7a" (UID: "519483aa-afe9-466b-ba88-f3a38919fa7a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:54:21.927750 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:21.927730    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519483aa-afe9-466b-ba88-f3a38919fa7a-kube-api-access-c92sq" (OuterVolumeSpecName: "kube-api-access-c92sq") pod "519483aa-afe9-466b-ba88-f3a38919fa7a" (UID: "519483aa-afe9-466b-ba88-f3a38919fa7a"). InnerVolumeSpecName "kube-api-access-c92sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:54:22.027021 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:22.026989    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c92sq\" (UniqueName: \"kubernetes.io/projected/519483aa-afe9-466b-ba88-f3a38919fa7a-kube-api-access-c92sq\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:54:22.027021 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:22.027015    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/519483aa-afe9-466b-ba88-f3a38919fa7a-config-file\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:54:22.800571 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:22.800489    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq" event={"ID":"519483aa-afe9-466b-ba88-f3a38919fa7a","Type":"ContainerDied","Data":"bb1b763b16f1f02cc9b9dcbcc08fa0dcd4cfcb98cdb18746842619d5bcd49adc"}
Jul 17 18:54:22.800571 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:22.800531    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"
Jul 17 18:54:22.800571 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:22.800555    2581 scope.go:117] "RemoveContainer" containerID="f3640901500e3821d5f75ba741ad5d9766669f9d3d855ad47e60ef72b01f1022"
Jul 17 18:54:22.817315 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:22.817294    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"]
Jul 17 18:54:22.823853 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:22.823836    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pg5rq"]
Jul 17 18:54:24.485730 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:24.485692    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="519483aa-afe9-466b-ba88-f3a38919fa7a" path="/var/lib/kubelet/pods/519483aa-afe9-466b-ba88-f3a38919fa7a/volumes"
Jul 17 18:54:25.453016 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.452983    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"]
Jul 17 18:54:25.453454 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.453436    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519483aa-afe9-466b-ba88-f3a38919fa7a" containerName="limitador"
Jul 17 18:54:25.453554 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.453457    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="519483aa-afe9-466b-ba88-f3a38919fa7a" containerName="limitador"
Jul 17 18:54:25.453554 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.453541    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="519483aa-afe9-466b-ba88-f3a38919fa7a" containerName="limitador"
Jul 17 18:54:25.457533 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.457513    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"
Jul 17 18:54:25.460581 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.460559    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 18:54:25.461161 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.461136    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 18:54:25.461650 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.461632    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-tnxcb\""
Jul 17 18:54:25.461781 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.461664    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 18:54:25.471153 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.471107    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"]
Jul 17 18:54:25.553857 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.553830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k78r7\" (UniqueName: \"kubernetes.io/projected/4649beac-4e47-4b85-b60b-89655cb9e0d8-kube-api-access-k78r7\") pod \"postgres-69fb4594cf-b82tf\" (UID: \"4649beac-4e47-4b85-b60b-89655cb9e0d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"
Jul 17 18:54:25.554153 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.553892    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4649beac-4e47-4b85-b60b-89655cb9e0d8-data\") pod \"postgres-69fb4594cf-b82tf\" (UID: \"4649beac-4e47-4b85-b60b-89655cb9e0d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"
Jul 17 18:54:25.655073 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.655030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4649beac-4e47-4b85-b60b-89655cb9e0d8-data\") pod \"postgres-69fb4594cf-b82tf\" (UID: \"4649beac-4e47-4b85-b60b-89655cb9e0d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"
Jul 17 18:54:25.655241 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.655108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k78r7\" (UniqueName: \"kubernetes.io/projected/4649beac-4e47-4b85-b60b-89655cb9e0d8-kube-api-access-k78r7\") pod \"postgres-69fb4594cf-b82tf\" (UID: \"4649beac-4e47-4b85-b60b-89655cb9e0d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"
Jul 17 18:54:25.655455 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.655437    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4649beac-4e47-4b85-b60b-89655cb9e0d8-data\") pod \"postgres-69fb4594cf-b82tf\" (UID: \"4649beac-4e47-4b85-b60b-89655cb9e0d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"
Jul 17 18:54:25.666171 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.666141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k78r7\" (UniqueName: \"kubernetes.io/projected/4649beac-4e47-4b85-b60b-89655cb9e0d8-kube-api-access-k78r7\") pod \"postgres-69fb4594cf-b82tf\" (UID: \"4649beac-4e47-4b85-b60b-89655cb9e0d8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"
Jul 17 18:54:25.772969 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.772903    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"
Jul 17 18:54:25.906788 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:25.906754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"]
Jul 17 18:54:25.909534 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:54:25.909488    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4649beac_4e47_4b85_b60b_89655cb9e0d8.slice/crio-0ca585ce89b8e1783bdad9640219aab940ee51d661ecf92a7ed481eda9549c1a WatchSource:0}: Error finding container 0ca585ce89b8e1783bdad9640219aab940ee51d661ecf92a7ed481eda9549c1a: Status 404 returned error can't find the container with id 0ca585ce89b8e1783bdad9640219aab940ee51d661ecf92a7ed481eda9549c1a
Jul 17 18:54:26.825174 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:26.825090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf" event={"ID":"4649beac-4e47-4b85-b60b-89655cb9e0d8","Type":"ContainerStarted","Data":"0ca585ce89b8e1783bdad9640219aab940ee51d661ecf92a7ed481eda9549c1a"}
Jul 17 18:54:30.846258 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:30.846227    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf" event={"ID":"4649beac-4e47-4b85-b60b-89655cb9e0d8","Type":"ContainerStarted","Data":"da7bfa0952a21fb63d90b79c6f24fa05b1bcf9ee6a156beeba741050daba8c7d"}
Jul 17 18:54:30.846607 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:30.846391    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"
Jul 17 18:54:30.863120 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:30.863062    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf" podStartSLOduration=1.056541304 podStartE2EDuration="5.863047238s" totalImagesPullingTime="4.806505934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:30.862562301 +0000 UTC m=+590.856928307" watchObservedRunningTime="2026-07-17 18:54:30.863047238 +0000 UTC m=+590.857413253"
Jul 17 18:54:36.881464 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:36.881435    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-b82tf"
Jul 17 18:54:37.954184 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:37.954150    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d765988b8-cpdmb"]
Jul 17 18:54:37.960246 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:37.960224    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d765988b8-cpdmb"
Jul 17 18:54:37.962736 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:37.962712    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 18:54:37.965720 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:37.965700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d765988b8-cpdmb"]
Jul 17 18:54:38.058753 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:38.058716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lclbm\" (UniqueName: \"kubernetes.io/projected/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-kube-api-access-lclbm\") pod \"authorino-d765988b8-cpdmb\" (UID: \"cc09b8c6-5c8a-43c3-9285-cc817b6161bb\") " pod="kuadrant-system/authorino-d765988b8-cpdmb"
Jul 17 18:54:38.058926 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:38.058763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-tls-cert\") pod \"authorino-d765988b8-cpdmb\" (UID: \"cc09b8c6-5c8a-43c3-9285-cc817b6161bb\") " pod="kuadrant-system/authorino-d765988b8-cpdmb"
Jul 17 18:54:38.159969 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:38.159927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lclbm\" (UniqueName: \"kubernetes.io/projected/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-kube-api-access-lclbm\") pod \"authorino-d765988b8-cpdmb\" (UID: \"cc09b8c6-5c8a-43c3-9285-cc817b6161bb\") " pod="kuadrant-system/authorino-d765988b8-cpdmb"
Jul 17 18:54:38.160142 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:38.159980    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-tls-cert\") pod \"authorino-d765988b8-cpdmb\" (UID: \"cc09b8c6-5c8a-43c3-9285-cc817b6161bb\") " pod="kuadrant-system/authorino-d765988b8-cpdmb"
Jul 17 18:54:38.162609 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:38.162577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-tls-cert\") pod \"authorino-d765988b8-cpdmb\" (UID: \"cc09b8c6-5c8a-43c3-9285-cc817b6161bb\") " pod="kuadrant-system/authorino-d765988b8-cpdmb"
Jul 17 18:54:38.169613 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:38.169589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lclbm\" (UniqueName: \"kubernetes.io/projected/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-kube-api-access-lclbm\") pod \"authorino-d765988b8-cpdmb\" (UID: \"cc09b8c6-5c8a-43c3-9285-cc817b6161bb\") " pod="kuadrant-system/authorino-d765988b8-cpdmb"
Jul 17 18:54:38.270698 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:38.270619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d765988b8-cpdmb"
Jul 17 18:54:38.417154 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:38.417132    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d765988b8-cpdmb"]
Jul 17 18:54:38.419184 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:54:38.419160    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc09b8c6_5c8a_43c3_9285_cc817b6161bb.slice/crio-d5eb57f66827ab8cfdc981916e60a361af14615a5c436a1e3ffddc8ae41a1cc0 WatchSource:0}: Error finding container d5eb57f66827ab8cfdc981916e60a361af14615a5c436a1e3ffddc8ae41a1cc0: Status 404 returned error can't find the container with id d5eb57f66827ab8cfdc981916e60a361af14615a5c436a1e3ffddc8ae41a1cc0
Jul 17 18:54:38.884752 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:38.884726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d765988b8-cpdmb" event={"ID":"cc09b8c6-5c8a-43c3-9285-cc817b6161bb","Type":"ContainerStarted","Data":"d5eb57f66827ab8cfdc981916e60a361af14615a5c436a1e3ffddc8ae41a1cc0"}
Jul 17 18:54:39.890566 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:39.890531    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d765988b8-cpdmb" event={"ID":"cc09b8c6-5c8a-43c3-9285-cc817b6161bb","Type":"ContainerStarted","Data":"e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2"}
Jul 17 18:54:39.910941 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:39.910889    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d765988b8-cpdmb" podStartSLOduration=2.49320053 podStartE2EDuration="2.910874812s" totalImagesPullingTime="417.674282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:39.909427073 +0000 UTC m=+599.903793089" watchObservedRunningTime="2026-07-17 18:54:39.910874812 +0000 UTC m=+599.905240827"
Jul 17 18:54:39.937002 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:39.936958    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7qwbj"]
Jul 17 18:54:39.937177 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:39.937149    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7qwbj" podUID="3cc48558-2c25-47f7-8847-18297b562fad" containerName="authorino" containerID="cri-o://796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49" gracePeriod=30
Jul 17 18:54:40.217583 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.217552    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7qwbj"
Jul 17 18:54:40.277447 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.277421    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd6q8\" (UniqueName: \"kubernetes.io/projected/3cc48558-2c25-47f7-8847-18297b562fad-kube-api-access-kd6q8\") pod \"3cc48558-2c25-47f7-8847-18297b562fad\" (UID: \"3cc48558-2c25-47f7-8847-18297b562fad\") "
Jul 17 18:54:40.279609 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.279583    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc48558-2c25-47f7-8847-18297b562fad-kube-api-access-kd6q8" (OuterVolumeSpecName: "kube-api-access-kd6q8") pod "3cc48558-2c25-47f7-8847-18297b562fad" (UID: "3cc48558-2c25-47f7-8847-18297b562fad"). InnerVolumeSpecName "kube-api-access-kd6q8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:54:40.378032 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.378000    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd6q8\" (UniqueName: \"kubernetes.io/projected/3cc48558-2c25-47f7-8847-18297b562fad-kube-api-access-kd6q8\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:54:40.896395 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.896301    2581 generic.go:356] "Generic (PLEG): container finished" podID="3cc48558-2c25-47f7-8847-18297b562fad" containerID="796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49" exitCode=0
Jul 17 18:54:40.896395 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.896359    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7qwbj"
Jul 17 18:54:40.896839 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.896342    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7qwbj" event={"ID":"3cc48558-2c25-47f7-8847-18297b562fad","Type":"ContainerDied","Data":"796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49"}
Jul 17 18:54:40.896839 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.896475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7qwbj" event={"ID":"3cc48558-2c25-47f7-8847-18297b562fad","Type":"ContainerDied","Data":"b5522e900c5841ccb6f55a223c868a3402fde88dd58cc933e80719a67cf7cf69"}
Jul 17 18:54:40.896839 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.896495    2581 scope.go:117] "RemoveContainer" containerID="796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49"
Jul 17 18:54:40.904957 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.904940    2581 scope.go:117] "RemoveContainer" containerID="796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49"
Jul 17 18:54:40.905253 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:54:40.905235    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49\": container with ID starting with 796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49 not found: ID does not exist" containerID="796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49"
Jul 17 18:54:40.905316 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.905264    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49"} err="failed to get container status \"796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49\": rpc error: code = NotFound desc = could not find container \"796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49\": container with ID starting with 796210353f49cfc60c794ec6c158787a0c1a8dbf2aedddf5122ebd60f4dbdb49 not found: ID does not exist"
Jul 17 18:54:40.915715 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.915695    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7qwbj"]
Jul 17 18:54:40.920106 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:40.920087    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7qwbj"]
Jul 17 18:54:42.486331 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:42.486301    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cc48558-2c25-47f7-8847-18297b562fad" path="/var/lib/kubelet/pods/3cc48558-2c25-47f7-8847-18297b562fad/volumes"
Jul 17 18:54:44.716524 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.716493    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-599b575bf7-8n9lq"]
Jul 17 18:54:44.716982 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.716887    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc48558-2c25-47f7-8847-18297b562fad" containerName="authorino"
Jul 17 18:54:44.716982 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.716898    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc48558-2c25-47f7-8847-18297b562fad" containerName="authorino"
Jul 17 18:54:44.716982 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.716963    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc48558-2c25-47f7-8847-18297b562fad" containerName="authorino"
Jul 17 18:54:44.895540 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.895500    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-599b575bf7-8n9lq"]
Jul 17 18:54:44.895701 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.895616    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:54:44.898450 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.898433    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g7rfb\""
Jul 17 18:54:44.898706 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.898693    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 18:54:44.899053 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.899039    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 18:54:44.916186 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.916160    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76855646fc-fsrtb"]
Jul 17 18:54:44.933550 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.933526    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76855646fc-fsrtb"]
Jul 17 18:54:44.933674 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:44.933648    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:54:45.015948 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.015880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm9rd\" (UniqueName: \"kubernetes.io/projected/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-kube-api-access-fm9rd\") pod \"maas-controller-76855646fc-fsrtb\" (UID: \"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d\") " pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:54:45.015948 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.015917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07110ef1-6dbd-46cb-8364-6138dcad04d7-webhook-cert\") pod \"maas-controller-599b575bf7-8n9lq\" (UID: \"07110ef1-6dbd-46cb-8364-6138dcad04d7\") " pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:54:45.016110 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.015987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-webhook-cert\") pod \"maas-controller-76855646fc-fsrtb\" (UID: \"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d\") " pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:54:45.016110 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.016005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4svzw\" (UniqueName: \"kubernetes.io/projected/07110ef1-6dbd-46cb-8364-6138dcad04d7-kube-api-access-4svzw\") pod \"maas-controller-599b575bf7-8n9lq\" (UID: \"07110ef1-6dbd-46cb-8364-6138dcad04d7\") " pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:54:45.117245 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.117186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-webhook-cert\") pod \"maas-controller-76855646fc-fsrtb\" (UID: \"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d\") " pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:54:45.117245 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.117247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4svzw\" (UniqueName: \"kubernetes.io/projected/07110ef1-6dbd-46cb-8364-6138dcad04d7-kube-api-access-4svzw\") pod \"maas-controller-599b575bf7-8n9lq\" (UID: \"07110ef1-6dbd-46cb-8364-6138dcad04d7\") " pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:54:45.117439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.117302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm9rd\" (UniqueName: \"kubernetes.io/projected/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-kube-api-access-fm9rd\") pod \"maas-controller-76855646fc-fsrtb\" (UID: \"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d\") " pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:54:45.117439 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.117324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07110ef1-6dbd-46cb-8364-6138dcad04d7-webhook-cert\") pod \"maas-controller-599b575bf7-8n9lq\" (UID: \"07110ef1-6dbd-46cb-8364-6138dcad04d7\") " pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:54:45.119804 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.119779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07110ef1-6dbd-46cb-8364-6138dcad04d7-webhook-cert\") pod \"maas-controller-599b575bf7-8n9lq\" (UID: \"07110ef1-6dbd-46cb-8364-6138dcad04d7\") " pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:54:45.119964 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.119944    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-webhook-cert\") pod \"maas-controller-76855646fc-fsrtb\" (UID: \"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d\") " pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:54:45.126158 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.126135    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4svzw\" (UniqueName: \"kubernetes.io/projected/07110ef1-6dbd-46cb-8364-6138dcad04d7-kube-api-access-4svzw\") pod \"maas-controller-599b575bf7-8n9lq\" (UID: \"07110ef1-6dbd-46cb-8364-6138dcad04d7\") " pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:54:45.126356 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.126338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm9rd\" (UniqueName: \"kubernetes.io/projected/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-kube-api-access-fm9rd\") pod \"maas-controller-76855646fc-fsrtb\" (UID: \"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d\") " pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:54:45.206557 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.206525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:54:45.243861 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.243827    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:54:45.348027 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.347996    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-599b575bf7-8n9lq"]
Jul 17 18:54:45.350219 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:54:45.350164    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07110ef1_6dbd_46cb_8364_6138dcad04d7.slice/crio-bbd49717647106cd83460c5503fdff4813f6ea54e2609f58f3c7b4a8fcc3f6ec WatchSource:0}: Error finding container bbd49717647106cd83460c5503fdff4813f6ea54e2609f58f3c7b4a8fcc3f6ec: Status 404 returned error can't find the container with id bbd49717647106cd83460c5503fdff4813f6ea54e2609f58f3c7b4a8fcc3f6ec
Jul 17 18:54:45.393346 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.393323    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76855646fc-fsrtb"]
Jul 17 18:54:45.395721 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:54:45.395693    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6fc1a85_d849_40a7_ad7f_9ddbf2becf4d.slice/crio-11d08532a19726fd685fd84fc2f05169596cd619b83b49e94b154beb32b18662 WatchSource:0}: Error finding container 11d08532a19726fd685fd84fc2f05169596cd619b83b49e94b154beb32b18662: Status 404 returned error can't find the container with id 11d08532a19726fd685fd84fc2f05169596cd619b83b49e94b154beb32b18662
Jul 17 18:54:45.920265 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.920226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76855646fc-fsrtb" event={"ID":"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d","Type":"ContainerStarted","Data":"11d08532a19726fd685fd84fc2f05169596cd619b83b49e94b154beb32b18662"}
Jul 17 18:54:45.921355 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:45.921332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-599b575bf7-8n9lq" event={"ID":"07110ef1-6dbd-46cb-8364-6138dcad04d7","Type":"ContainerStarted","Data":"bbd49717647106cd83460c5503fdff4813f6ea54e2609f58f3c7b4a8fcc3f6ec"}
Jul 17 18:54:48.941110 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:48.941076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-599b575bf7-8n9lq" event={"ID":"07110ef1-6dbd-46cb-8364-6138dcad04d7","Type":"ContainerStarted","Data":"fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c"}
Jul 17 18:54:48.941630 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:48.941167    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:54:48.942628 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:48.942607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76855646fc-fsrtb" event={"ID":"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d","Type":"ContainerStarted","Data":"24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21"}
Jul 17 18:54:48.942732 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:48.942659    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:54:48.965818 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:48.965746    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-599b575bf7-8n9lq" podStartSLOduration=2.242988012 podStartE2EDuration="4.965731051s" totalImagesPullingTime="2.722743039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:48.965385745 +0000 UTC m=+608.959751760" watchObservedRunningTime="2026-07-17 18:54:48.965731051 +0000 UTC m=+608.960097067"
Jul 17 18:54:49.014161 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:49.014109    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76855646fc-fsrtb" podStartSLOduration=2.330046487 podStartE2EDuration="5.014086543s" totalImagesPullingTime="2.684040056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:54:49.007606144 +0000 UTC m=+609.001972159" watchObservedRunningTime="2026-07-17 18:54:49.014086543 +0000 UTC m=+609.008452578"
Jul 17 18:54:59.948444 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:59.948409    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:54:59.948923 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:54:59.948647    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:55:00.013483 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.013453    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-599b575bf7-8n9lq"]
Jul 17 18:55:00.013700 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.013677    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-599b575bf7-8n9lq" podUID="07110ef1-6dbd-46cb-8364-6138dcad04d7" containerName="manager" containerID="cri-o://fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c" gracePeriod=30
Jul 17 18:55:00.259629 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.259606    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:55:00.342162 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.342128    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07110ef1-6dbd-46cb-8364-6138dcad04d7-webhook-cert\") pod \"07110ef1-6dbd-46cb-8364-6138dcad04d7\" (UID: \"07110ef1-6dbd-46cb-8364-6138dcad04d7\") "
Jul 17 18:55:00.342162 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.342166    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4svzw\" (UniqueName: \"kubernetes.io/projected/07110ef1-6dbd-46cb-8364-6138dcad04d7-kube-api-access-4svzw\") pod \"07110ef1-6dbd-46cb-8364-6138dcad04d7\" (UID: \"07110ef1-6dbd-46cb-8364-6138dcad04d7\") "
Jul 17 18:55:00.344440 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.344413    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07110ef1-6dbd-46cb-8364-6138dcad04d7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "07110ef1-6dbd-46cb-8364-6138dcad04d7" (UID: "07110ef1-6dbd-46cb-8364-6138dcad04d7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:55:00.344552 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.344514    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07110ef1-6dbd-46cb-8364-6138dcad04d7-kube-api-access-4svzw" (OuterVolumeSpecName: "kube-api-access-4svzw") pod "07110ef1-6dbd-46cb-8364-6138dcad04d7" (UID: "07110ef1-6dbd-46cb-8364-6138dcad04d7"). InnerVolumeSpecName "kube-api-access-4svzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:55:00.443181 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.443155    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07110ef1-6dbd-46cb-8364-6138dcad04d7-webhook-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:55:00.443181 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.443179    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4svzw\" (UniqueName: \"kubernetes.io/projected/07110ef1-6dbd-46cb-8364-6138dcad04d7-kube-api-access-4svzw\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:55:00.993373 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.993336    2581 generic.go:356] "Generic (PLEG): container finished" podID="07110ef1-6dbd-46cb-8364-6138dcad04d7" containerID="fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c" exitCode=0
Jul 17 18:55:00.993808 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.993376    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-599b575bf7-8n9lq"
Jul 17 18:55:00.993808 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.993415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-599b575bf7-8n9lq" event={"ID":"07110ef1-6dbd-46cb-8364-6138dcad04d7","Type":"ContainerDied","Data":"fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c"}
Jul 17 18:55:00.993808 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.993464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-599b575bf7-8n9lq" event={"ID":"07110ef1-6dbd-46cb-8364-6138dcad04d7","Type":"ContainerDied","Data":"bbd49717647106cd83460c5503fdff4813f6ea54e2609f58f3c7b4a8fcc3f6ec"}
Jul 17 18:55:00.993808 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:00.993486    2581 scope.go:117] "RemoveContainer" containerID="fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c"
Jul 17 18:55:01.001480 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:01.001465    2581 scope.go:117] "RemoveContainer" containerID="fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c"
Jul 17 18:55:01.001724 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:55:01.001706    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c\": container with ID starting with fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c not found: ID does not exist" containerID="fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c"
Jul 17 18:55:01.001769 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:01.001732    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c"} err="failed to get container status \"fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c\": rpc error: code = NotFound desc = could not find container \"fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c\": container with ID starting with fd98bc5e5eb82fbc3e1e82bd950d1995fcea6292c8afe85f2b5b3f35ce12532c not found: ID does not exist"
Jul 17 18:55:01.011378 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:01.011330    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-599b575bf7-8n9lq"]
Jul 17 18:55:01.015697 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:01.015677    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-599b575bf7-8n9lq"]
Jul 17 18:55:02.485986 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:02.485948    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07110ef1-6dbd-46cb-8364-6138dcad04d7" path="/var/lib/kubelet/pods/07110ef1-6dbd-46cb-8364-6138dcad04d7/volumes"
Jul 17 18:55:20.780895 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.780859    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"]
Jul 17 18:55:20.781550 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.781234    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07110ef1-6dbd-46cb-8364-6138dcad04d7" containerName="manager"
Jul 17 18:55:20.781550 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.781246    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="07110ef1-6dbd-46cb-8364-6138dcad04d7" containerName="manager"
Jul 17 18:55:20.781550 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.781316    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="07110ef1-6dbd-46cb-8364-6138dcad04d7" containerName="manager"
Jul 17 18:55:20.784361 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.784342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:20.789049 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.789031    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 18:55:20.798164 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.798140    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cxfjz\""
Jul 17 18:55:20.809212 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.809175    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"]
Jul 17 18:55:20.895671 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.895630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c25d8e16-441c-4dd9-bf58-664ad8873489-openshift-service-ca\") pod \"maas-api-768b5d7fc7-4k8tc\" (UID: \"c25d8e16-441c-4dd9-bf58-664ad8873489\") " pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:20.895815 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.895700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c25d8e16-441c-4dd9-bf58-664ad8873489-maas-api-tls\") pod \"maas-api-768b5d7fc7-4k8tc\" (UID: \"c25d8e16-441c-4dd9-bf58-664ad8873489\") " pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:20.895815 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.895787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q59g\" (UniqueName: \"kubernetes.io/projected/c25d8e16-441c-4dd9-bf58-664ad8873489-kube-api-access-9q59g\") pod \"maas-api-768b5d7fc7-4k8tc\" (UID: \"c25d8e16-441c-4dd9-bf58-664ad8873489\") " pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:20.997170 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.997140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c25d8e16-441c-4dd9-bf58-664ad8873489-openshift-service-ca\") pod \"maas-api-768b5d7fc7-4k8tc\" (UID: \"c25d8e16-441c-4dd9-bf58-664ad8873489\") " pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:20.997324 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.997178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c25d8e16-441c-4dd9-bf58-664ad8873489-maas-api-tls\") pod \"maas-api-768b5d7fc7-4k8tc\" (UID: \"c25d8e16-441c-4dd9-bf58-664ad8873489\") " pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:20.997324 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.997231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q59g\" (UniqueName: \"kubernetes.io/projected/c25d8e16-441c-4dd9-bf58-664ad8873489-kube-api-access-9q59g\") pod \"maas-api-768b5d7fc7-4k8tc\" (UID: \"c25d8e16-441c-4dd9-bf58-664ad8873489\") " pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:20.997772 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.997745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c25d8e16-441c-4dd9-bf58-664ad8873489-openshift-service-ca\") pod \"maas-api-768b5d7fc7-4k8tc\" (UID: \"c25d8e16-441c-4dd9-bf58-664ad8873489\") " pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:20.999518 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:20.999496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c25d8e16-441c-4dd9-bf58-664ad8873489-maas-api-tls\") pod \"maas-api-768b5d7fc7-4k8tc\" (UID: \"c25d8e16-441c-4dd9-bf58-664ad8873489\") " pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:21.007400 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.007375    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q59g\" (UniqueName: \"kubernetes.io/projected/c25d8e16-441c-4dd9-bf58-664ad8873489-kube-api-access-9q59g\") pod \"maas-api-768b5d7fc7-4k8tc\" (UID: \"c25d8e16-441c-4dd9-bf58-664ad8873489\") " pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:21.095010 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.094949    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:21.237880 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.237849    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"]
Jul 17 18:55:21.240917 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:55:21.240893    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc25d8e16_441c_4dd9_bf58_664ad8873489.slice/crio-7ddf5f02f1d0c5c2b8d44c67959b64f6dd19de93604a6a123e89030369b7b486 WatchSource:0}: Error finding container 7ddf5f02f1d0c5c2b8d44c67959b64f6dd19de93604a6a123e89030369b7b486: Status 404 returned error can't find the container with id 7ddf5f02f1d0c5c2b8d44c67959b64f6dd19de93604a6a123e89030369b7b486
Jul 17 18:55:21.596673 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.596640    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-wwnbx"]
Jul 17 18:55:21.599744 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.599728    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx"
Jul 17 18:55:21.602714 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.602690    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g4lbs\""
Jul 17 18:55:21.602836 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.602736    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 18:55:21.617806 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.617780    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-wwnbx"]
Jul 17 18:55:21.635957 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.635928    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-cppg4"]
Jul 17 18:55:21.638273 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.638257    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4"
Jul 17 18:55:21.652546 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.652523    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-cppg4"]
Jul 17 18:55:21.702992 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.702948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk4xx\" (UniqueName: \"kubernetes.io/projected/47032b35-5243-46dd-93bf-21574e71a004-kube-api-access-dk4xx\") pod \"payload-processing-5bf47cd988-wwnbx\" (UID: \"47032b35-5243-46dd-93bf-21574e71a004\") " pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx"
Jul 17 18:55:21.703189 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.703017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47032b35-5243-46dd-93bf-21574e71a004-plugins-config-volume\") pod \"payload-processing-5bf47cd988-wwnbx\" (UID: \"47032b35-5243-46dd-93bf-21574e71a004\") " pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx"
Jul 17 18:55:21.703189 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.703044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c738dd9-1a42-4fd7-8f62-fad1d918fc8e-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-cppg4\" (UID: \"5c738dd9-1a42-4fd7-8f62-fad1d918fc8e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4"
Jul 17 18:55:21.703189 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.703116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rsjj\" (UniqueName: \"kubernetes.io/projected/5c738dd9-1a42-4fd7-8f62-fad1d918fc8e-kube-api-access-5rsjj\") pod \"payload-pre-processing-7677b774bb-cppg4\" (UID: \"5c738dd9-1a42-4fd7-8f62-fad1d918fc8e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4"
Jul 17 18:55:21.804128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.804086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47032b35-5243-46dd-93bf-21574e71a004-plugins-config-volume\") pod \"payload-processing-5bf47cd988-wwnbx\" (UID: \"47032b35-5243-46dd-93bf-21574e71a004\") " pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx"
Jul 17 18:55:21.804128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.804121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c738dd9-1a42-4fd7-8f62-fad1d918fc8e-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-cppg4\" (UID: \"5c738dd9-1a42-4fd7-8f62-fad1d918fc8e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4"
Jul 17 18:55:21.804653 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.804164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rsjj\" (UniqueName: \"kubernetes.io/projected/5c738dd9-1a42-4fd7-8f62-fad1d918fc8e-kube-api-access-5rsjj\") pod \"payload-pre-processing-7677b774bb-cppg4\" (UID: \"5c738dd9-1a42-4fd7-8f62-fad1d918fc8e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4"
Jul 17 18:55:21.804653 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.804243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk4xx\" (UniqueName: \"kubernetes.io/projected/47032b35-5243-46dd-93bf-21574e71a004-kube-api-access-dk4xx\") pod \"payload-processing-5bf47cd988-wwnbx\" (UID: \"47032b35-5243-46dd-93bf-21574e71a004\") " pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx"
Jul 17 18:55:21.805008 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.804979    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c738dd9-1a42-4fd7-8f62-fad1d918fc8e-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-cppg4\" (UID: \"5c738dd9-1a42-4fd7-8f62-fad1d918fc8e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4"
Jul 17 18:55:21.805150 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.805042    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47032b35-5243-46dd-93bf-21574e71a004-plugins-config-volume\") pod \"payload-processing-5bf47cd988-wwnbx\" (UID: \"47032b35-5243-46dd-93bf-21574e71a004\") " pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx"
Jul 17 18:55:21.819759 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.819733    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk4xx\" (UniqueName: \"kubernetes.io/projected/47032b35-5243-46dd-93bf-21574e71a004-kube-api-access-dk4xx\") pod \"payload-processing-5bf47cd988-wwnbx\" (UID: \"47032b35-5243-46dd-93bf-21574e71a004\") " pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx"
Jul 17 18:55:21.822001 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.821984    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rsjj\" (UniqueName: \"kubernetes.io/projected/5c738dd9-1a42-4fd7-8f62-fad1d918fc8e-kube-api-access-5rsjj\") pod \"payload-pre-processing-7677b774bb-cppg4\" (UID: \"5c738dd9-1a42-4fd7-8f62-fad1d918fc8e\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4"
Jul 17 18:55:21.909976 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.909899    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx"
Jul 17 18:55:21.947922 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:21.947896    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4"
Jul 17 18:55:22.075099 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:22.075071    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-wwnbx"]
Jul 17 18:55:22.077514 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:55:22.077486    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47032b35_5243_46dd_93bf_21574e71a004.slice/crio-a54c0eee531ab9eb8fe149a7bb0272a3aaa2d63bc302e6963b6fd9b51da7532a WatchSource:0}: Error finding container a54c0eee531ab9eb8fe149a7bb0272a3aaa2d63bc302e6963b6fd9b51da7532a: Status 404 returned error can't find the container with id a54c0eee531ab9eb8fe149a7bb0272a3aaa2d63bc302e6963b6fd9b51da7532a
Jul 17 18:55:22.085851 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:22.085820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc" event={"ID":"c25d8e16-441c-4dd9-bf58-664ad8873489","Type":"ContainerStarted","Data":"7ddf5f02f1d0c5c2b8d44c67959b64f6dd19de93604a6a123e89030369b7b486"}
Jul 17 18:55:22.087415 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:22.087377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx" event={"ID":"47032b35-5243-46dd-93bf-21574e71a004","Type":"ContainerStarted","Data":"a54c0eee531ab9eb8fe149a7bb0272a3aaa2d63bc302e6963b6fd9b51da7532a"}
Jul 17 18:55:22.105380 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:22.105359    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-cppg4"]
Jul 17 18:55:22.107048 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:55:22.107026    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c738dd9_1a42_4fd7_8f62_fad1d918fc8e.slice/crio-e1655c1d2b14aacad554182606ecc67da99ec56ee2e928d455bce2b319ec4d16 WatchSource:0}: Error finding container e1655c1d2b14aacad554182606ecc67da99ec56ee2e928d455bce2b319ec4d16: Status 404 returned error can't find the container with id e1655c1d2b14aacad554182606ecc67da99ec56ee2e928d455bce2b319ec4d16
Jul 17 18:55:23.114737 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:23.114466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4" event={"ID":"5c738dd9-1a42-4fd7-8f62-fad1d918fc8e","Type":"ContainerStarted","Data":"e1655c1d2b14aacad554182606ecc67da99ec56ee2e928d455bce2b319ec4d16"}
Jul 17 18:55:24.122954 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:24.122910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc" event={"ID":"c25d8e16-441c-4dd9-bf58-664ad8873489","Type":"ContainerStarted","Data":"8a81eb1f57cccabe0cddb3147ebd6d80105d03c56607e5876c6467d7f5fa9aff"}
Jul 17 18:55:24.123437 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:24.123273    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:24.149448 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:24.148493    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc" podStartSLOduration=2.23860651 podStartE2EDuration="4.148472583s" totalImagesPullingTime="1.909866073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:24.147189032 +0000 UTC m=+644.141555047" watchObservedRunningTime="2026-07-17 18:55:24.148472583 +0000 UTC m=+644.142838600"
Jul 17 18:55:26.140719 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:26.140638    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx" event={"ID":"47032b35-5243-46dd-93bf-21574e71a004","Type":"ContainerStarted","Data":"28f276a6bfdd428b2ac90cfa27ce1ad8b065caee1631e96c1319f3b899912bc9"}
Jul 17 18:55:26.141112 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:26.140772    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx"
Jul 17 18:55:26.142249 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:26.142223    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4" event={"ID":"5c738dd9-1a42-4fd7-8f62-fad1d918fc8e","Type":"ContainerStarted","Data":"dd3b263232f6e495a7eca30c80fd9ed4486c8a5eb73a96db57d80edf6d15484b"}
Jul 17 18:55:26.142377 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:26.142308    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4"
Jul 17 18:55:26.168029 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:26.167985    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx" podStartSLOduration=1.429789525 podStartE2EDuration="5.167972318s" totalImagesPullingTime="3.738182793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:26.166863285 +0000 UTC m=+646.161229311" watchObservedRunningTime="2026-07-17 18:55:26.167972318 +0000 UTC m=+646.162338332"
Jul 17 18:55:26.204320 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:26.204256    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4" podStartSLOduration=1.4888533050000001 podStartE2EDuration="5.204234742s" totalImagesPullingTime="3.715381437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:55:26.202702236 +0000 UTC m=+646.197068251" watchObservedRunningTime="2026-07-17 18:55:26.204234742 +0000 UTC m=+646.198600759"
Jul 17 18:55:30.133781 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:30.133756    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-768b5d7fc7-4k8tc"
Jul 17 18:55:30.163717 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:30.163689    2581 generic.go:356] "Generic (PLEG): container finished" podID="fb7d507d-b164-4843-8d11-82d74270351d" containerID="3e44fb2479fb5dcba27bda1f51880bbbd7aff604b530a153c273d835c8de37e7" exitCode=0
Jul 17 18:55:30.163865 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:30.163760    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv" event={"ID":"fb7d507d-b164-4843-8d11-82d74270351d","Type":"ContainerDied","Data":"3e44fb2479fb5dcba27bda1f51880bbbd7aff604b530a153c273d835c8de37e7"}
Jul 17 18:55:30.164087 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:30.164073    2581 scope.go:117] "RemoveContainer" containerID="3e44fb2479fb5dcba27bda1f51880bbbd7aff604b530a153c273d835c8de37e7"
Jul 17 18:55:30.165002 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:30.164975    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:55:30.165102 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:30.165053    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:55:30.165171 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:30.165101    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 18:55:31.170667 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:31.170628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv" event={"ID":"fb7d507d-b164-4843-8d11-82d74270351d","Type":"ContainerStarted","Data":"099b50559f3c3e53cd6dcb21b052062bcefd2a6d232d02bd7da9ecec82ffc835"}
Jul 17 18:55:31.910921 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:31.910883    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:55:31.911779 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:31.911744    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-62rjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 17 18:55:31.911899 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:31.911802    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv" podUID="fb7d507d-b164-4843-8d11-82d74270351d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 17 18:55:32.911242 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:32.911184    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-62rjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 17 18:55:32.911722 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:32.911278    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv" podUID="fb7d507d-b164-4843-8d11-82d74270351d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 17 18:55:33.911504 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:33.911467    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-62rjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 17 18:55:33.911906 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:33.911536    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv" podUID="fb7d507d-b164-4843-8d11-82d74270351d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 17 18:55:34.697404 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:34.697348    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:55:34.911463 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:34.911425    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-62rjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 17 18:55:34.911628 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:34.911484    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv" podUID="fb7d507d-b164-4843-8d11-82d74270351d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 17 18:55:35.914769 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:35.914739    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:55:35.915626 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:35.915610    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-62rjv"
Jul 17 18:55:37.149328 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:37.149297    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-wwnbx"
Jul 17 18:55:37.149733 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:55:37.149364    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-cppg4"
Jul 17 18:56:31.752049 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.751970    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"]
Jul 17 18:56:31.756138 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.756123    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.762718 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.762697    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 18:56:31.762847 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.762761    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 18:56:31.763717 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.763697    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 18:56:31.763778 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.763739    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tmjdx\""
Jul 17 18:56:31.767963 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.767942    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"]
Jul 17 18:56:31.818581 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.818551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.818727 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.818592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.818727 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.818628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxn9f\" (UniqueName: \"kubernetes.io/projected/7af51847-c793-4681-8af2-9055fcd4741f-kube-api-access-bxn9f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.818822 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.818753    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.818822 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.818812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.818898 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.818850    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7af51847-c793-4681-8af2-9055fcd4741f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.921392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.920094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.921392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.920292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7af51847-c793-4681-8af2-9055fcd4741f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.921392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.920427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.921392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.920485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.921392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.920543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxn9f\" (UniqueName: \"kubernetes.io/projected/7af51847-c793-4681-8af2-9055fcd4741f-kube-api-access-bxn9f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.921392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.920666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.921392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.920682    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.921392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.920971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.921392 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.921240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.925221 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.923848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7af51847-c793-4681-8af2-9055fcd4741f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.928576 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.928552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7af51847-c793-4681-8af2-9055fcd4741f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:31.930565 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:31.930543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxn9f\" (UniqueName: \"kubernetes.io/projected/7af51847-c793-4681-8af2-9055fcd4741f-kube-api-access-bxn9f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg\" (UID: \"7af51847-c793-4681-8af2-9055fcd4741f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:32.067634 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:32.067548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:32.207181 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:56:32.207150    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af51847_c793_4681_8af2_9055fcd4741f.slice/crio-250696628baf8f9772c923b6e0803511bda4ab27eb6605abc240bb80349de4f1 WatchSource:0}: Error finding container 250696628baf8f9772c923b6e0803511bda4ab27eb6605abc240bb80349de4f1: Status 404 returned error can't find the container with id 250696628baf8f9772c923b6e0803511bda4ab27eb6605abc240bb80349de4f1
Jul 17 18:56:32.208628 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:32.208605    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"]
Jul 17 18:56:32.208707 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:32.208648    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:56:32.468302 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:32.468258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg" event={"ID":"7af51847-c793-4681-8af2-9055fcd4741f","Type":"ContainerStarted","Data":"250696628baf8f9772c923b6e0803511bda4ab27eb6605abc240bb80349de4f1"}
Jul 17 18:56:33.473994 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:33.473898    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg" event={"ID":"7af51847-c793-4681-8af2-9055fcd4741f","Type":"ContainerStarted","Data":"5fb2e106258a138c481b84b144e3ff2ae0164ca54d281f3dccfec2c67d5214f3"}
Jul 17 18:56:42.067783 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:42.067746    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:42.068158 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:42.067837    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:42.080750 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:42.080728    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:42.104833 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:42.104789    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg" podStartSLOduration=10.101417267 podStartE2EDuration="11.104776908s" totalImagesPullingTime="1.003359641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:33.51893017 +0000 UTC m=+713.513296197" watchObservedRunningTime="2026-07-17 18:56:42.104776908 +0000 UTC m=+722.099142923"
Jul 17 18:56:42.524555 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:42.524529    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg"
Jul 17 18:56:44.569859 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.569825    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"]
Jul 17 18:56:44.573415 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.573397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.575963 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.575948    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 17 18:56:44.584032 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.584007    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"]
Jul 17 18:56:44.732213 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.732168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.732405 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.732297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.732405 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.732357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.732405 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.732392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmzs7\" (UniqueName: \"kubernetes.io/projected/58dbfd41-78da-4224-bfba-9633e68d3141-kube-api-access-jmzs7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.732551 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.732431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.732551 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.732513    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58dbfd41-78da-4224-bfba-9633e68d3141-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.832979 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.832900    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58dbfd41-78da-4224-bfba-9633e68d3141-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.832979 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.832947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.832979 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.832976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.833264 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.833025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.833264 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.833065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmzs7\" (UniqueName: \"kubernetes.io/projected/58dbfd41-78da-4224-bfba-9633e68d3141-kube-api-access-jmzs7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.833264 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.833097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.833503 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.833474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.833643 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.833503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.833643 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.833572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.835360 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.835335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58dbfd41-78da-4224-bfba-9633e68d3141-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.835692 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.835672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58dbfd41-78da-4224-bfba-9633e68d3141-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.842036 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.842016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmzs7\" (UniqueName: \"kubernetes.io/projected/58dbfd41-78da-4224-bfba-9633e68d3141-kube-api-access-jmzs7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rvxlj\" (UID: \"58dbfd41-78da-4224-bfba-9633e68d3141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:44.884056 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:44.884034    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:45.021244 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:45.021218    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"]
Jul 17 18:56:45.022831 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:56:45.022808    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58dbfd41_78da_4224_bfba_9633e68d3141.slice/crio-697aa77716e503ec280e16c3c982746b35bce909e40fd888a28864a38f0890fe WatchSource:0}: Error finding container 697aa77716e503ec280e16c3c982746b35bce909e40fd888a28864a38f0890fe: Status 404 returned error can't find the container with id 697aa77716e503ec280e16c3c982746b35bce909e40fd888a28864a38f0890fe
Jul 17 18:56:45.529385 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:45.529292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj" event={"ID":"58dbfd41-78da-4224-bfba-9633e68d3141","Type":"ContainerStarted","Data":"3eda4ab604b54453dd3d3dd51b835568c2cc4e1344b241187e2c9bf5b3a488f6"}
Jul 17 18:56:45.529385 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:45.529340    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj" event={"ID":"58dbfd41-78da-4224-bfba-9633e68d3141","Type":"ContainerStarted","Data":"697aa77716e503ec280e16c3c982746b35bce909e40fd888a28864a38f0890fe"}
Jul 17 18:56:45.549828 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:45.549786    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj" podStartSLOduration=1.3555890800000001 podStartE2EDuration="1.549771373s" totalImagesPullingTime="194.182293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:45.547507412 +0000 UTC m=+725.541873421" watchObservedRunningTime="2026-07-17 18:56:45.549771373 +0000 UTC m=+725.544137388"
Jul 17 18:56:50.981972 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:50.981942    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"]
Jul 17 18:56:50.985285 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:50.985267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:50.988605 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:50.988586    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 17 18:56:51.015019 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.014993    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"]
Jul 17 18:56:51.093064 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.093031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.093233 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.093077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.093233 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.093156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39865097-253c-4937-9915-5b7288d166bc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.093308 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.093254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnhvn\" (UniqueName: \"kubernetes.io/projected/39865097-253c-4937-9915-5b7288d166bc-kube-api-access-vnhvn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.093308 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.093287    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.093378 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.093316    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.194320 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.194284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.194320 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.194320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.194557 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.194366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.194557 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.194390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.194557 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.194447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39865097-253c-4937-9915-5b7288d166bc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.194557 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.194503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnhvn\" (UniqueName: \"kubernetes.io/projected/39865097-253c-4937-9915-5b7288d166bc-kube-api-access-vnhvn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.194758 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.194710    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.194817 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.194770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.194854 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.194820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.196822 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.196802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39865097-253c-4937-9915-5b7288d166bc-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.197108 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.197087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39865097-253c-4937-9915-5b7288d166bc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.213553 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.213515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnhvn\" (UniqueName: \"kubernetes.io/projected/39865097-253c-4937-9915-5b7288d166bc-kube-api-access-vnhvn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4\" (UID: \"39865097-253c-4937-9915-5b7288d166bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.295037 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.294971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:56:51.449148 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.449110    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"]
Jul 17 18:56:51.452399 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:56:51.452371    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39865097_253c_4937_9915_5b7288d166bc.slice/crio-9d568af52c91503ded0f8ac4d7988558f1fd26afce11e698ce4fb7706cf69b63 WatchSource:0}: Error finding container 9d568af52c91503ded0f8ac4d7988558f1fd26afce11e698ce4fb7706cf69b63: Status 404 returned error can't find the container with id 9d568af52c91503ded0f8ac4d7988558f1fd26afce11e698ce4fb7706cf69b63
Jul 17 18:56:51.557365 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:51.557295    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4" event={"ID":"39865097-253c-4937-9915-5b7288d166bc","Type":"ContainerStarted","Data":"9d568af52c91503ded0f8ac4d7988558f1fd26afce11e698ce4fb7706cf69b63"}
Jul 17 18:56:52.562720 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:52.562685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4" event={"ID":"39865097-253c-4937-9915-5b7288d166bc","Type":"ContainerStarted","Data":"1bdd8c48d81e0bfd61918fc78a4a3d9ece1d5d8a1eeaf2bcc03411f9c485e18c"}
Jul 17 18:56:52.591297 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:52.591252    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4" podStartSLOduration=2.3702778860000002 podStartE2EDuration="2.591238283s" totalImagesPullingTime="220.960397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:56:52.588940339 +0000 UTC m=+732.583306354" watchObservedRunningTime="2026-07-17 18:56:52.591238283 +0000 UTC m=+732.585604298"
Jul 17 18:56:54.884387 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:54.884355    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:54.884860 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:54.884524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:54.899401 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:54.899371    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:56:55.588132 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:56:55.588092    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rvxlj"
Jul 17 18:57:01.295428 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:01.295400    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:57:01.295799 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:01.295445    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:57:01.308305 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:01.308281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:57:01.615741 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:01.615669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4"
Jul 17 18:57:54.601018 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.600966    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d765988b8-cpdmb"]
Jul 17 18:57:54.601577 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.601245    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-d765988b8-cpdmb" podUID="cc09b8c6-5c8a-43c3-9285-cc817b6161bb" containerName="authorino" containerID="cri-o://e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2" gracePeriod=30
Jul 17 18:57:54.847848 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.847823    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d765988b8-cpdmb"
Jul 17 18:57:54.866573 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.866513    2581 generic.go:356] "Generic (PLEG): container finished" podID="cc09b8c6-5c8a-43c3-9285-cc817b6161bb" containerID="e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2" exitCode=0
Jul 17 18:57:54.866573 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.866554    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d765988b8-cpdmb"
Jul 17 18:57:54.866705 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.866596    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d765988b8-cpdmb" event={"ID":"cc09b8c6-5c8a-43c3-9285-cc817b6161bb","Type":"ContainerDied","Data":"e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2"}
Jul 17 18:57:54.866705 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.866638    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d765988b8-cpdmb" event={"ID":"cc09b8c6-5c8a-43c3-9285-cc817b6161bb","Type":"ContainerDied","Data":"d5eb57f66827ab8cfdc981916e60a361af14615a5c436a1e3ffddc8ae41a1cc0"}
Jul 17 18:57:54.866705 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.866656    2581 scope.go:117] "RemoveContainer" containerID="e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2"
Jul 17 18:57:54.874961 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.874935    2581 scope.go:117] "RemoveContainer" containerID="e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2"
Jul 17 18:57:54.875186 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:57:54.875170    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2\": container with ID starting with e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2 not found: ID does not exist" containerID="e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2"
Jul 17 18:57:54.875260 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.875212    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2"} err="failed to get container status \"e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2\": rpc error: code = NotFound desc = could not find container \"e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2\": container with ID starting with e25ce9bbd0992bd30dd668f6ca099803a7b2064ab364a3df2121cee1f2b63dd2 not found: ID does not exist"
Jul 17 18:57:54.936380 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.936349    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-tls-cert\") pod \"cc09b8c6-5c8a-43c3-9285-cc817b6161bb\" (UID: \"cc09b8c6-5c8a-43c3-9285-cc817b6161bb\") "
Jul 17 18:57:54.936548 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.936432    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lclbm\" (UniqueName: \"kubernetes.io/projected/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-kube-api-access-lclbm\") pod \"cc09b8c6-5c8a-43c3-9285-cc817b6161bb\" (UID: \"cc09b8c6-5c8a-43c3-9285-cc817b6161bb\") "
Jul 17 18:57:54.938573 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.938542    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-kube-api-access-lclbm" (OuterVolumeSpecName: "kube-api-access-lclbm") pod "cc09b8c6-5c8a-43c3-9285-cc817b6161bb" (UID: "cc09b8c6-5c8a-43c3-9285-cc817b6161bb"). InnerVolumeSpecName "kube-api-access-lclbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:57:54.946843 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:54.946819    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cc09b8c6-5c8a-43c3-9285-cc817b6161bb" (UID: "cc09b8c6-5c8a-43c3-9285-cc817b6161bb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:57:55.037128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:55.037094    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-tls-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:57:55.037128 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:55.037121    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lclbm\" (UniqueName: \"kubernetes.io/projected/cc09b8c6-5c8a-43c3-9285-cc817b6161bb-kube-api-access-lclbm\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:57:55.198025 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:55.197998    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d765988b8-cpdmb"]
Jul 17 18:57:55.230122 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:55.230086    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d765988b8-cpdmb"]
Jul 17 18:57:56.486480 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:57:56.486437    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc09b8c6-5c8a-43c3-9285-cc817b6161bb" path="/var/lib/kubelet/pods/cc09b8c6-5c8a-43c3-9285-cc817b6161bb/volumes"
Jul 17 18:58:42.711901 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:42.711867    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76855646fc-fsrtb"]
Jul 17 18:58:42.712428 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:42.712081    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76855646fc-fsrtb" podUID="a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d" containerName="manager" containerID="cri-o://24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21" gracePeriod=30
Jul 17 18:58:42.961428 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:42.961405    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:58:43.091640 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.091547    2581 generic.go:356] "Generic (PLEG): container finished" podID="a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d" containerID="24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21" exitCode=0
Jul 17 18:58:43.091640 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.091595    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76855646fc-fsrtb"
Jul 17 18:58:43.091640 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.091629    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76855646fc-fsrtb" event={"ID":"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d","Type":"ContainerDied","Data":"24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21"}
Jul 17 18:58:43.091867 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.091679    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76855646fc-fsrtb" event={"ID":"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d","Type":"ContainerDied","Data":"11d08532a19726fd685fd84fc2f05169596cd619b83b49e94b154beb32b18662"}
Jul 17 18:58:43.091867 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.091703    2581 scope.go:117] "RemoveContainer" containerID="24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21"
Jul 17 18:58:43.100175 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.100158    2581 scope.go:117] "RemoveContainer" containerID="24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21"
Jul 17 18:58:43.100455 ip-10-0-137-97 kubenswrapper[2581]: E0717 18:58:43.100438    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21\": container with ID starting with 24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21 not found: ID does not exist" containerID="24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21"
Jul 17 18:58:43.100499 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.100464    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21"} err="failed to get container status \"24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21\": rpc error: code = NotFound desc = could not find container \"24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21\": container with ID starting with 24a7ec544f771d15c8f44ba270066f942c40cf5ad04e8cd85132409ade5d6d21 not found: ID does not exist"
Jul 17 18:58:43.152706 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.152673    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm9rd\" (UniqueName: \"kubernetes.io/projected/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-kube-api-access-fm9rd\") pod \"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d\" (UID: \"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d\") "
Jul 17 18:58:43.152888 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.152774    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-webhook-cert\") pod \"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d\" (UID: \"a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d\") "
Jul 17 18:58:43.154969 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.154944    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-kube-api-access-fm9rd" (OuterVolumeSpecName: "kube-api-access-fm9rd") pod "a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d" (UID: "a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d"). InnerVolumeSpecName "kube-api-access-fm9rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:58:43.154969 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.154963    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d" (UID: "a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:58:43.254388 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.254355    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm9rd\" (UniqueName: \"kubernetes.io/projected/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-kube-api-access-fm9rd\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:58:43.254388 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.254385    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d-webhook-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 18:58:43.419530 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.419502    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76855646fc-fsrtb"]
Jul 17 18:58:43.423122 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:43.423099    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76855646fc-fsrtb"]
Jul 17 18:58:44.486569 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:58:44.486529    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d" path="/var/lib/kubelet/pods/a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d/volumes"
Jul 17 18:59:44.243214 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.243169    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76855646fc-vdqfg"]
Jul 17 18:59:44.243605 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.243562    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc09b8c6-5c8a-43c3-9285-cc817b6161bb" containerName="authorino"
Jul 17 18:59:44.243605 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.243576    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc09b8c6-5c8a-43c3-9285-cc817b6161bb" containerName="authorino"
Jul 17 18:59:44.243605 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.243594    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d" containerName="manager"
Jul 17 18:59:44.243605 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.243599    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d" containerName="manager"
Jul 17 18:59:44.243725 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.243667    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6fc1a85-d849-40a7-ad7f-9ddbf2becf4d" containerName="manager"
Jul 17 18:59:44.243725 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.243679    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc09b8c6-5c8a-43c3-9285-cc817b6161bb" containerName="authorino"
Jul 17 18:59:44.248102 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.248085    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 18:59:44.251683 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.251659    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g7rfb\""
Jul 17 18:59:44.251835 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.251817    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 18:59:44.251907 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.251815    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 18:59:44.259466 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.259448    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76855646fc-vdqfg"]
Jul 17 18:59:44.266510 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.266489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cad877f0-673b-46b8-99f3-68f514dd165f-webhook-cert\") pod \"maas-controller-76855646fc-vdqfg\" (UID: \"cad877f0-673b-46b8-99f3-68f514dd165f\") " pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 18:59:44.266603 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.266521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxw94\" (UniqueName: \"kubernetes.io/projected/cad877f0-673b-46b8-99f3-68f514dd165f-kube-api-access-kxw94\") pod \"maas-controller-76855646fc-vdqfg\" (UID: \"cad877f0-673b-46b8-99f3-68f514dd165f\") " pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 18:59:44.367616 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.367580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cad877f0-673b-46b8-99f3-68f514dd165f-webhook-cert\") pod \"maas-controller-76855646fc-vdqfg\" (UID: \"cad877f0-673b-46b8-99f3-68f514dd165f\") " pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 18:59:44.367796 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.367623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxw94\" (UniqueName: \"kubernetes.io/projected/cad877f0-673b-46b8-99f3-68f514dd165f-kube-api-access-kxw94\") pod \"maas-controller-76855646fc-vdqfg\" (UID: \"cad877f0-673b-46b8-99f3-68f514dd165f\") " pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 18:59:44.370216 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.370166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cad877f0-673b-46b8-99f3-68f514dd165f-webhook-cert\") pod \"maas-controller-76855646fc-vdqfg\" (UID: \"cad877f0-673b-46b8-99f3-68f514dd165f\") " pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 18:59:44.385901 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.385880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxw94\" (UniqueName: \"kubernetes.io/projected/cad877f0-673b-46b8-99f3-68f514dd165f-kube-api-access-kxw94\") pod \"maas-controller-76855646fc-vdqfg\" (UID: \"cad877f0-673b-46b8-99f3-68f514dd165f\") " pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 18:59:44.559509 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.559436    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 18:59:44.707561 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:44.707535    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76855646fc-vdqfg"]
Jul 17 18:59:44.709816 ip-10-0-137-97 kubenswrapper[2581]: W0717 18:59:44.709788    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad877f0_673b_46b8_99f3_68f514dd165f.slice/crio-8fc3c582b1dde6b3f26aa1c54a290f860b9c68182096207987db46c64d54b997 WatchSource:0}: Error finding container 8fc3c582b1dde6b3f26aa1c54a290f860b9c68182096207987db46c64d54b997: Status 404 returned error can't find the container with id 8fc3c582b1dde6b3f26aa1c54a290f860b9c68182096207987db46c64d54b997
Jul 17 18:59:45.384164 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:45.384133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76855646fc-vdqfg" event={"ID":"cad877f0-673b-46b8-99f3-68f514dd165f","Type":"ContainerStarted","Data":"8fc3c582b1dde6b3f26aa1c54a290f860b9c68182096207987db46c64d54b997"}
Jul 17 18:59:46.395505 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:46.395468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76855646fc-vdqfg" event={"ID":"cad877f0-673b-46b8-99f3-68f514dd165f","Type":"ContainerStarted","Data":"6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee"}
Jul 17 18:59:46.395986 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:46.395608    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 18:59:46.417584 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:46.417531    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76855646fc-vdqfg" podStartSLOduration=1.801858562 podStartE2EDuration="2.417516304s" totalImagesPullingTime="615.657742ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:59:46.41576438 +0000 UTC m=+906.410130396" watchObservedRunningTime="2026-07-17 18:59:46.417516304 +0000 UTC m=+906.411882320"
Jul 17 18:59:57.402906 ip-10-0-137-97 kubenswrapper[2581]: I0717 18:59:57.402872    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 19:00:02.057046 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.057009    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76855646fc-vdqfg"]
Jul 17 19:00:02.057511 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.057220    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76855646fc-vdqfg" podUID="cad877f0-673b-46b8-99f3-68f514dd165f" containerName="manager" containerID="cri-o://6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee" gracePeriod=30
Jul 17 19:00:02.307679 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.307617    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 19:00:02.420304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.420262    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxw94\" (UniqueName: \"kubernetes.io/projected/cad877f0-673b-46b8-99f3-68f514dd165f-kube-api-access-kxw94\") pod \"cad877f0-673b-46b8-99f3-68f514dd165f\" (UID: \"cad877f0-673b-46b8-99f3-68f514dd165f\") "
Jul 17 19:00:02.420499 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.420387    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cad877f0-673b-46b8-99f3-68f514dd165f-webhook-cert\") pod \"cad877f0-673b-46b8-99f3-68f514dd165f\" (UID: \"cad877f0-673b-46b8-99f3-68f514dd165f\") "
Jul 17 19:00:02.422539 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.422504    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad877f0-673b-46b8-99f3-68f514dd165f-kube-api-access-kxw94" (OuterVolumeSpecName: "kube-api-access-kxw94") pod "cad877f0-673b-46b8-99f3-68f514dd165f" (UID: "cad877f0-673b-46b8-99f3-68f514dd165f"). InnerVolumeSpecName "kube-api-access-kxw94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:00:02.423001 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.422977    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cad877f0-673b-46b8-99f3-68f514dd165f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cad877f0-673b-46b8-99f3-68f514dd165f" (UID: "cad877f0-673b-46b8-99f3-68f514dd165f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:00:02.473040 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.473007    2581 generic.go:356] "Generic (PLEG): container finished" podID="cad877f0-673b-46b8-99f3-68f514dd165f" containerID="6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee" exitCode=0
Jul 17 19:00:02.473239 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.473049    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76855646fc-vdqfg" event={"ID":"cad877f0-673b-46b8-99f3-68f514dd165f","Type":"ContainerDied","Data":"6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee"}
Jul 17 19:00:02.473239 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.473086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76855646fc-vdqfg" event={"ID":"cad877f0-673b-46b8-99f3-68f514dd165f","Type":"ContainerDied","Data":"8fc3c582b1dde6b3f26aa1c54a290f860b9c68182096207987db46c64d54b997"}
Jul 17 19:00:02.473239 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.473106    2581 scope.go:117] "RemoveContainer" containerID="6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee"
Jul 17 19:00:02.473239 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.473052    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76855646fc-vdqfg"
Jul 17 19:00:02.483111 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.483088    2581 scope.go:117] "RemoveContainer" containerID="6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee"
Jul 17 19:00:02.483414 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:00:02.483391    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee\": container with ID starting with 6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee not found: ID does not exist" containerID="6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee"
Jul 17 19:00:02.483494 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.483421    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee"} err="failed to get container status \"6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee\": rpc error: code = NotFound desc = could not find container \"6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee\": container with ID starting with 6dbb107812ce83c036b77bab7eddd2c1d25bb0f4a3c14f7e33c93d4f4c609eee not found: ID does not exist"
Jul 17 19:00:02.495724 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.495701    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76855646fc-vdqfg"]
Jul 17 19:00:02.500260 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.500237    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76855646fc-vdqfg"]
Jul 17 19:00:02.521322 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.521300    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxw94\" (UniqueName: \"kubernetes.io/projected/cad877f0-673b-46b8-99f3-68f514dd165f-kube-api-access-kxw94\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:00:02.521406 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:02.521324    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cad877f0-673b-46b8-99f3-68f514dd165f-webhook-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:00:03.288354 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.288321    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76855646fc-vblmm"]
Jul 17 19:00:03.288709 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.288701    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad877f0-673b-46b8-99f3-68f514dd165f" containerName="manager"
Jul 17 19:00:03.288746 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.288713    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad877f0-673b-46b8-99f3-68f514dd165f" containerName="manager"
Jul 17 19:00:03.288789 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.288779    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cad877f0-673b-46b8-99f3-68f514dd165f" containerName="manager"
Jul 17 19:00:03.293054 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.293037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76855646fc-vblmm"
Jul 17 19:00:03.296721 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.296704    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 19:00:03.296836 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.296705    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 19:00:03.296836 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.296705    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g7rfb\""
Jul 17 19:00:03.304170 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.304148    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76855646fc-vblmm"]
Jul 17 19:00:03.430074 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.430044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztx8z\" (UniqueName: \"kubernetes.io/projected/a3baac5e-e097-436d-b668-ff2a7b7c7a7e-kube-api-access-ztx8z\") pod \"maas-controller-76855646fc-vblmm\" (UID: \"a3baac5e-e097-436d-b668-ff2a7b7c7a7e\") " pod="opendatahub/maas-controller-76855646fc-vblmm"
Jul 17 19:00:03.430249 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.430162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3baac5e-e097-436d-b668-ff2a7b7c7a7e-webhook-cert\") pod \"maas-controller-76855646fc-vblmm\" (UID: \"a3baac5e-e097-436d-b668-ff2a7b7c7a7e\") " pod="opendatahub/maas-controller-76855646fc-vblmm"
Jul 17 19:00:03.530940 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.530912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3baac5e-e097-436d-b668-ff2a7b7c7a7e-webhook-cert\") pod \"maas-controller-76855646fc-vblmm\" (UID: \"a3baac5e-e097-436d-b668-ff2a7b7c7a7e\") " pod="opendatahub/maas-controller-76855646fc-vblmm"
Jul 17 19:00:03.531124 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.530978    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztx8z\" (UniqueName: \"kubernetes.io/projected/a3baac5e-e097-436d-b668-ff2a7b7c7a7e-kube-api-access-ztx8z\") pod \"maas-controller-76855646fc-vblmm\" (UID: \"a3baac5e-e097-436d-b668-ff2a7b7c7a7e\") " pod="opendatahub/maas-controller-76855646fc-vblmm"
Jul 17 19:00:03.533728 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.533706    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3baac5e-e097-436d-b668-ff2a7b7c7a7e-webhook-cert\") pod \"maas-controller-76855646fc-vblmm\" (UID: \"a3baac5e-e097-436d-b668-ff2a7b7c7a7e\") " pod="opendatahub/maas-controller-76855646fc-vblmm"
Jul 17 19:00:03.540055 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.539999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztx8z\" (UniqueName: \"kubernetes.io/projected/a3baac5e-e097-436d-b668-ff2a7b7c7a7e-kube-api-access-ztx8z\") pod \"maas-controller-76855646fc-vblmm\" (UID: \"a3baac5e-e097-436d-b668-ff2a7b7c7a7e\") " pod="opendatahub/maas-controller-76855646fc-vblmm"
Jul 17 19:00:03.603613 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.603587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76855646fc-vblmm"
Jul 17 19:00:03.734979 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:03.734947    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76855646fc-vblmm"]
Jul 17 19:00:03.738414 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:00:03.738383    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3baac5e_e097_436d_b668_ff2a7b7c7a7e.slice/crio-464f499f443de59617e6a1279277f9a1d16346327b956ab5a67f8c43a89d5b99 WatchSource:0}: Error finding container 464f499f443de59617e6a1279277f9a1d16346327b956ab5a67f8c43a89d5b99: Status 404 returned error can't find the container with id 464f499f443de59617e6a1279277f9a1d16346327b956ab5a67f8c43a89d5b99
Jul 17 19:00:04.486852 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:04.486815    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cad877f0-673b-46b8-99f3-68f514dd165f" path="/var/lib/kubelet/pods/cad877f0-673b-46b8-99f3-68f514dd165f/volumes"
Jul 17 19:00:04.487966 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:04.487942    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76855646fc-vblmm" event={"ID":"a3baac5e-e097-436d-b668-ff2a7b7c7a7e","Type":"ContainerStarted","Data":"f997849102a66d6f84ace1ba09b3981a6c868e5c4ff559389abbd519de61e689"}
Jul 17 19:00:04.488086 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:04.487986    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76855646fc-vblmm" event={"ID":"a3baac5e-e097-436d-b668-ff2a7b7c7a7e","Type":"ContainerStarted","Data":"464f499f443de59617e6a1279277f9a1d16346327b956ab5a67f8c43a89d5b99"}
Jul 17 19:00:04.488086 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:04.488045    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76855646fc-vblmm"
Jul 17 19:00:04.506291 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:04.506247    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76855646fc-vblmm" podStartSLOduration=0.905790469 podStartE2EDuration="1.506231287s" totalImagesPullingTime="600.440818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:00:04.50470905 +0000 UTC m=+924.499075064" watchObservedRunningTime="2026-07-17 19:00:04.506231287 +0000 UTC m=+924.500597328"
Jul 17 19:00:15.495675 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:00:15.495636    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76855646fc-vblmm"
Jul 17 19:12:19.681815 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.681783    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"]
Jul 17 19:12:19.685442 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.685426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.689074 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.689049    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fb2e5b30-openshift-default-dockercfg-mjt67\""
Jul 17 19:12:19.769156 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.769125    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"]
Jul 17 19:12:19.793409 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.793372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istiod-ca-cert\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.793577 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.793422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-socket\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.793577 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.793557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-credential-socket\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.793686 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.793580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-certs\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.793686 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.793603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5zsg\" (UniqueName: \"kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-kube-api-access-n5zsg\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.793686 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.793658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-podinfo\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.793844 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.793719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-data\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.793844 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.793749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-token\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.793844 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.793773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-envoy\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895026 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.894984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istiod-ca-cert\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895026 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-socket\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895309 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-credential-socket\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895309 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-certs\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895309 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5zsg\" (UniqueName: \"kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-kube-api-access-n5zsg\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895309 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-podinfo\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895309 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-data\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895309 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-token\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895309 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-envoy\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895661 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-certs\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895661 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-credential-socket\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895771 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895697    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-socket\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895829 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-data\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.895877 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.895840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istiod-ca-cert\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.897761 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.897737    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-envoy\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.897907 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.897890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-podinfo\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.915206 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.915177    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5zsg\" (UniqueName: \"kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-kube-api-access-n5zsg\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.920828 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.920804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-token\") pod \"e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") " pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:19.997834 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:19.997760    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:20.146519 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:20.146495    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"]
Jul 17 19:12:20.148052 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:12:20.148014    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3a4b71_9049_4855_9abb_9a893f0f2f54.slice/crio-69102b16b5fe40369afc6fa67fbdb6bdf27f7b96e413a70bd02e9c5d1db41d48 WatchSource:0}: Error finding container 69102b16b5fe40369afc6fa67fbdb6bdf27f7b96e413a70bd02e9c5d1db41d48: Status 404 returned error can't find the container with id 69102b16b5fe40369afc6fa67fbdb6bdf27f7b96e413a70bd02e9c5d1db41d48
Jul 17 19:12:20.150322 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:20.150289    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:12:20.150393 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:20.150359    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:12:20.150435 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:20.150389    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:12:20.961663 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:20.961629    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" event={"ID":"8c3a4b71-9049-4855-9abb-9a893f0f2f54","Type":"ContainerStarted","Data":"f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6"}
Jul 17 19:12:20.962029 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:20.961680    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" event={"ID":"8c3a4b71-9049-4855-9abb-9a893f0f2f54","Type":"ContainerStarted","Data":"69102b16b5fe40369afc6fa67fbdb6bdf27f7b96e413a70bd02e9c5d1db41d48"}
Jul 17 19:12:20.988406 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:20.988362    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" podStartSLOduration=1.988346556 podStartE2EDuration="1.988346556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:12:20.986527397 +0000 UTC m=+1660.980893436" watchObservedRunningTime="2026-07-17 19:12:20.988346556 +0000 UTC m=+1660.982712571"
Jul 17 19:12:20.998451 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:20.998426    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:22.003562 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.003532    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:22.702336 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.698282    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"]
Jul 17 19:12:22.706042 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.706016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:22.711158 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.711137    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fb2e5b30-serving-cert\""
Jul 17 19:12:22.723893 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.723867    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"]
Jul 17 19:12:22.820265 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.820229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc8zh\" (UniqueName: \"kubernetes.io/projected/3ce20326-9ba9-403c-9f10-20f5397b521e-kube-api-access-wc8zh\") pod \"maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:22.820462 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.820305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ce20326-9ba9-403c-9f10-20f5397b521e-maas-api-tls\") pod \"maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:22.820462 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.820337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ce20326-9ba9-403c-9f10-20f5397b521e-openshift-service-ca\") pod \"maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:22.921568 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.921518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc8zh\" (UniqueName: \"kubernetes.io/projected/3ce20326-9ba9-403c-9f10-20f5397b521e-kube-api-access-wc8zh\") pod \"maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:22.921753 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.921600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ce20326-9ba9-403c-9f10-20f5397b521e-maas-api-tls\") pod \"maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:22.921753 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.921634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ce20326-9ba9-403c-9f10-20f5397b521e-openshift-service-ca\") pod \"maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:22.922312 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.922289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ce20326-9ba9-403c-9f10-20f5397b521e-openshift-service-ca\") pod \"maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:22.924091 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.924073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ce20326-9ba9-403c-9f10-20f5397b521e-maas-api-tls\") pod \"maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:22.955233 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.955147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc8zh\" (UniqueName: \"kubernetes.io/projected/3ce20326-9ba9-403c-9f10-20f5397b521e-kube-api-access-wc8zh\") pod \"maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:22.971333 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.971312    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:22.972235 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:22.972190    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:23.017836 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:23.017786    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:23.171716 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:23.171691    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"]
Jul 17 19:12:23.173298 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:12:23.173269    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce20326_9ba9_403c_9f10_20f5397b521e.slice/crio-3189a57c6c91df585be75c78afe69ecbc11d512024cb7b4b4741fcfbe2e363ef WatchSource:0}: Error finding container 3189a57c6c91df585be75c78afe69ecbc11d512024cb7b4b4741fcfbe2e363ef: Status 404 returned error can't find the container with id 3189a57c6c91df585be75c78afe69ecbc11d512024cb7b4b4741fcfbe2e363ef
Jul 17 19:12:23.174824 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:23.174803    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 19:12:23.977127 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:23.977097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp" event={"ID":"3ce20326-9ba9-403c-9f10-20f5397b521e","Type":"ContainerStarted","Data":"3189a57c6c91df585be75c78afe69ecbc11d512024cb7b4b4741fcfbe2e363ef"}
Jul 17 19:12:24.984115 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:24.984071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp" event={"ID":"3ce20326-9ba9-403c-9f10-20f5397b521e","Type":"ContainerStarted","Data":"9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875"}
Jul 17 19:12:24.984640 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:24.984329    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:25.010722 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:25.010676    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp" podStartSLOduration=2.208741522 podStartE2EDuration="3.010660988s" totalImagesPullingTime="801.919466ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:12:25.008784731 +0000 UTC m=+1665.003150748" watchObservedRunningTime="2026-07-17 19:12:25.010660988 +0000 UTC m=+1665.005027002"
Jul 17 19:12:30.999113 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:30.999075    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:37.048300 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:37.048268    2581 generic.go:356] "Generic (PLEG): container finished" podID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerID="f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6" exitCode=0
Jul 17 19:12:37.048691 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:37.048346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" event={"ID":"8c3a4b71-9049-4855-9abb-9a893f0f2f54","Type":"ContainerDied","Data":"f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6"}
Jul 17 19:12:37.048789 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:37.048772    2581 scope.go:117] "RemoveContainer" containerID="f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6"
Jul 17 19:12:37.049873 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:37.049848    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:12:37.049924 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:37.049915    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:12:37.049975 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:37.049963    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:12:37.972212 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:37.972146    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:38.055171 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:38.055136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" event={"ID":"8c3a4b71-9049-4855-9abb-9a893f0f2f54","Type":"ContainerStarted","Data":"6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c"}
Jul 17 19:12:38.999256 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:38.999217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:38.999457 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:38.999377    2581 patch_prober.go:28] interesting pod/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 17 19:12:38.999457 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:38.999422    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 17 19:12:39.999033 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:39.998984    2581 patch_prober.go:28] interesting pod/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 17 19:12:39.999534 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:39.999072    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 17 19:12:40.998393 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:40.998357    2581 patch_prober.go:28] interesting pod/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 17 19:12:40.999076 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:40.998662    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 17 19:12:42.002424 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:42.002393    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:42.002807 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:42.002662    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:42.003410 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:42.003392    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:12:58.530188 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.530156    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"]
Jul 17 19:12:58.530716 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.530389    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp" podUID="3ce20326-9ba9-403c-9f10-20f5397b521e" containerName="maas-api" containerID="cri-o://9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875" gracePeriod=30
Jul 17 19:12:58.786423 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.786362    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:58.836524 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.836494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ce20326-9ba9-403c-9f10-20f5397b521e-maas-api-tls\") pod \"3ce20326-9ba9-403c-9f10-20f5397b521e\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") "
Jul 17 19:12:58.836654 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.836537    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ce20326-9ba9-403c-9f10-20f5397b521e-openshift-service-ca\") pod \"3ce20326-9ba9-403c-9f10-20f5397b521e\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") "
Jul 17 19:12:58.836654 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.836580    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc8zh\" (UniqueName: \"kubernetes.io/projected/3ce20326-9ba9-403c-9f10-20f5397b521e-kube-api-access-wc8zh\") pod \"3ce20326-9ba9-403c-9f10-20f5397b521e\" (UID: \"3ce20326-9ba9-403c-9f10-20f5397b521e\") "
Jul 17 19:12:58.836929 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.836906    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ce20326-9ba9-403c-9f10-20f5397b521e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3ce20326-9ba9-403c-9f10-20f5397b521e" (UID: "3ce20326-9ba9-403c-9f10-20f5397b521e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:12:58.838848 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.838823    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce20326-9ba9-403c-9f10-20f5397b521e-kube-api-access-wc8zh" (OuterVolumeSpecName: "kube-api-access-wc8zh") pod "3ce20326-9ba9-403c-9f10-20f5397b521e" (UID: "3ce20326-9ba9-403c-9f10-20f5397b521e"). InnerVolumeSpecName "kube-api-access-wc8zh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:12:58.838950 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.838868    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ce20326-9ba9-403c-9f10-20f5397b521e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3ce20326-9ba9-403c-9f10-20f5397b521e" (UID: "3ce20326-9ba9-403c-9f10-20f5397b521e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:12:58.938258 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.938234    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ce20326-9ba9-403c-9f10-20f5397b521e-maas-api-tls\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:12:58.938258 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.938257    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ce20326-9ba9-403c-9f10-20f5397b521e-openshift-service-ca\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:12:58.938382 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:58.938266    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc8zh\" (UniqueName: \"kubernetes.io/projected/3ce20326-9ba9-403c-9f10-20f5397b521e-kube-api-access-wc8zh\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:12:59.159305 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:59.159279    2581 generic.go:356] "Generic (PLEG): container finished" podID="3ce20326-9ba9-403c-9f10-20f5397b521e" containerID="9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875" exitCode=0
Jul 17 19:12:59.159427 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:59.159327    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"
Jul 17 19:12:59.159427 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:59.159354    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp" event={"ID":"3ce20326-9ba9-403c-9f10-20f5397b521e","Type":"ContainerDied","Data":"9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875"}
Jul 17 19:12:59.159427 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:59.159394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp" event={"ID":"3ce20326-9ba9-403c-9f10-20f5397b521e","Type":"ContainerDied","Data":"3189a57c6c91df585be75c78afe69ecbc11d512024cb7b4b4741fcfbe2e363ef"}
Jul 17 19:12:59.159427 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:59.159416    2581 scope.go:117] "RemoveContainer" containerID="9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875"
Jul 17 19:12:59.168819 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:59.168803    2581 scope.go:117] "RemoveContainer" containerID="9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875"
Jul 17 19:12:59.169089 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:12:59.169071    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875\": container with ID starting with 9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875 not found: ID does not exist" containerID="9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875"
Jul 17 19:12:59.169152 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:59.169100    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875"} err="failed to get container status \"9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875\": rpc error: code = NotFound desc = could not find container \"9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875\": container with ID starting with 9bfba2558db5a672826bb28dbbcd059ee51897f9c9046076cd71751058238875 not found: ID does not exist"
Jul 17 19:12:59.186791 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:59.186769    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"]
Jul 17 19:12:59.190686 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:12:59.190661    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fb2e5b30-5c748544f5-9fksp"]
Jul 17 19:13:00.486176 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:00.486145    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ce20326-9ba9-403c-9f10-20f5397b521e" path="/var/lib/kubelet/pods/3ce20326-9ba9-403c-9f10-20f5397b521e/volumes"
Jul 17 19:13:03.208621 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:03.208540    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"]
Jul 17 19:13:03.209041 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:03.208789    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerName="istio-proxy" containerID="cri-o://6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c" gracePeriod=30
Jul 17 19:13:04.328507 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.328476    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"]
Jul 17 19:13:04.328929 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.328857    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce20326-9ba9-403c-9f10-20f5397b521e" containerName="maas-api"
Jul 17 19:13:04.328929 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.328868    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce20326-9ba9-403c-9f10-20f5397b521e" containerName="maas-api"
Jul 17 19:13:04.328999 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.328940    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ce20326-9ba9-403c-9f10-20f5397b521e" containerName="maas-api"
Jul 17 19:13:04.333341 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.333320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.336452 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.336430    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-eb352e55-gw-openshift-default-dockercfg-6b7kg\""
Jul 17 19:13:04.362732 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.362706    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"]
Jul 17 19:13:04.383538 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.383515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-podinfo\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.383668 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.383579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-envoy\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.383668 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.383603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-data\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.383668 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.383617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-token\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.383668 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.383641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ml79\" (UniqueName: \"kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-kube-api-access-5ml79\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.383882 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.383771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b37259-1654-4d6e-989e-d6dc65d5953b-istiod-ca-cert\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.383882 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.383813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-socket\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.383882 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.383838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-credential-socket\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.384034 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.383902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-certs\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.484614 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.484576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-podinfo\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.484792 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.484663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-envoy\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.484792 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.484692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-data\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.484792 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.484717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-token\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.484792 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.484746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ml79\" (UniqueName: \"kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-kube-api-access-5ml79\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.485005 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.484793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b37259-1654-4d6e-989e-d6dc65d5953b-istiod-ca-cert\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.485005 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.484837    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-socket\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.485005 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.484861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-credential-socket\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.485167 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.485014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-certs\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.485381 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.485356    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-data\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.485620 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.485528    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-credential-socket\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.485620 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.485622    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-socket\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.485809 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.485653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-certs\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.485809 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.485757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b37259-1654-4d6e-989e-d6dc65d5953b-istiod-ca-cert\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.487517 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.487493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-podinfo\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.487710 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.487695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-envoy\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.498669 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.498648    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ml79\" (UniqueName: \"kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-kube-api-access-5ml79\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.499318 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.499298    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-token\") pod \"e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") " pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.643436 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.643362    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:04.800982 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.800958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"]
Jul 17 19:13:04.802244 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:13:04.802193    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60b37259_1654_4d6e_989e_d6dc65d5953b.slice/crio-c01392620d407154f5e90f8bcb1ecee9a4acae6e6762fada8024587c0005f900 WatchSource:0}: Error finding container c01392620d407154f5e90f8bcb1ecee9a4acae6e6762fada8024587c0005f900: Status 404 returned error can't find the container with id c01392620d407154f5e90f8bcb1ecee9a4acae6e6762fada8024587c0005f900
Jul 17 19:13:04.804353 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.804319    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:13:04.804442 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.804390    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:13:04.804442 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:04.804420    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:13:05.191067 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:05.191033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" event={"ID":"60b37259-1654-4d6e-989e-d6dc65d5953b","Type":"ContainerStarted","Data":"5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80"}
Jul 17 19:13:05.191254 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:05.191084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" event={"ID":"60b37259-1654-4d6e-989e-d6dc65d5953b","Type":"ContainerStarted","Data":"c01392620d407154f5e90f8bcb1ecee9a4acae6e6762fada8024587c0005f900"}
Jul 17 19:13:05.221761 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:05.221710    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" podStartSLOduration=1.221696206 podStartE2EDuration="1.221696206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:13:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:13:05.21913697 +0000 UTC m=+1705.213502984" watchObservedRunningTime="2026-07-17 19:13:05.221696206 +0000 UTC m=+1705.216062222"
Jul 17 19:13:05.643690 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:05.643615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:05.648614 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:05.648590    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:06.196124 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:06.196074    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:06.197181 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:06.197153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:08.465601 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.465575    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:13:08.523078 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523012    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-podinfo\") pod \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") "
Jul 17 19:13:08.523078 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523057    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-certs\") pod \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") "
Jul 17 19:13:08.523078 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523080    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-socket\") pod \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") "
Jul 17 19:13:08.523347 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523096    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5zsg\" (UniqueName: \"kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-kube-api-access-n5zsg\") pod \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") "
Jul 17 19:13:08.523347 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523143    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-envoy\") pod \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") "
Jul 17 19:13:08.523347 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523189    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-credential-socket\") pod \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") "
Jul 17 19:13:08.523347 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523262    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-data\") pod \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") "
Jul 17 19:13:08.523347 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523284    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-token\") pod \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") "
Jul 17 19:13:08.523347 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523319    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istiod-ca-cert\") pod \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\" (UID: \"8c3a4b71-9049-4855-9abb-9a893f0f2f54\") "
Jul 17 19:13:08.523637 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523313    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c3a4b71-9049-4855-9abb-9a893f0f2f54" (UID: "8c3a4b71-9049-4855-9abb-9a893f0f2f54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:13:08.523637 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523358    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c3a4b71-9049-4855-9abb-9a893f0f2f54" (UID: "8c3a4b71-9049-4855-9abb-9a893f0f2f54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:13:08.523637 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523506    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c3a4b71-9049-4855-9abb-9a893f0f2f54" (UID: "8c3a4b71-9049-4855-9abb-9a893f0f2f54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:13:08.523788 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.523762    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c3a4b71-9049-4855-9abb-9a893f0f2f54" (UID: "8c3a4b71-9049-4855-9abb-9a893f0f2f54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:13:08.524231 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.524186    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c3a4b71-9049-4855-9abb-9a893f0f2f54" (UID: "8c3a4b71-9049-4855-9abb-9a893f0f2f54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:13:08.525441 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.525409    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c3a4b71-9049-4855-9abb-9a893f0f2f54" (UID: "8c3a4b71-9049-4855-9abb-9a893f0f2f54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:13:08.525558 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.525470    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c3a4b71-9049-4855-9abb-9a893f0f2f54" (UID: "8c3a4b71-9049-4855-9abb-9a893f0f2f54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:13:08.525558 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.525530    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c3a4b71-9049-4855-9abb-9a893f0f2f54" (UID: "8c3a4b71-9049-4855-9abb-9a893f0f2f54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:13:08.525815 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.525797    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-kube-api-access-n5zsg" (OuterVolumeSpecName: "kube-api-access-n5zsg") pod "8c3a4b71-9049-4855-9abb-9a893f0f2f54" (UID: "8c3a4b71-9049-4855-9abb-9a893f0f2f54"). InnerVolumeSpecName "kube-api-access-n5zsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:13:08.624453 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.624431    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:08.624453 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.624452    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:08.624584 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.624461    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5zsg\" (UniqueName: \"kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-kube-api-access-n5zsg\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:08.624584 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.624470    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:08.624584 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.624478    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:08.624584 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.624486    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:08.624584 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.624494    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:08.624584 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.624501    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:08.624584 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:08.624508    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c3a4b71-9049-4855-9abb-9a893f0f2f54-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:09.212732 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.212700    2581 generic.go:356] "Generic (PLEG): container finished" podID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerID="6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c" exitCode=0
Jul 17 19:13:09.212908 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.212748    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"
Jul 17 19:13:09.212908 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.212790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" event={"ID":"8c3a4b71-9049-4855-9abb-9a893f0f2f54","Type":"ContainerDied","Data":"6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c"}
Jul 17 19:13:09.212908 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.212848    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9" event={"ID":"8c3a4b71-9049-4855-9abb-9a893f0f2f54","Type":"ContainerDied","Data":"69102b16b5fe40369afc6fa67fbdb6bdf27f7b96e413a70bd02e9c5d1db41d48"}
Jul 17 19:13:09.212908 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.212877    2581 scope.go:117] "RemoveContainer" containerID="6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c"
Jul 17 19:13:09.222559 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.222544    2581 scope.go:117] "RemoveContainer" containerID="f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6"
Jul 17 19:13:09.230257 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.230233    2581 scope.go:117] "RemoveContainer" containerID="6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c"
Jul 17 19:13:09.230498 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:13:09.230481    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c\": container with ID starting with 6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c not found: ID does not exist" containerID="6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c"
Jul 17 19:13:09.230541 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.230507    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c"} err="failed to get container status \"6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c\": rpc error: code = NotFound desc = could not find container \"6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c\": container with ID starting with 6a6cad89eb04d21caa2d9ca67ea7d73fa4a2b82b24eaf8eed75b9627396cb81c not found: ID does not exist"
Jul 17 19:13:09.230541 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.230523    2581 scope.go:117] "RemoveContainer" containerID="f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6"
Jul 17 19:13:09.230856 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:13:09.230755    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6\": container with ID starting with f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6 not found: ID does not exist" containerID="f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6"
Jul 17 19:13:09.230856 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.230777    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6"} err="failed to get container status \"f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6\": rpc error: code = NotFound desc = could not find container \"f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6\": container with ID starting with f25dfe65c7c7e447d79b30313b29e0d0f349c5d469c11de4f8ffa0a4ab623ea6 not found: ID does not exist"
Jul 17 19:13:09.234052 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.234032    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"]
Jul 17 19:13:09.238386 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:09.238367    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fb2e5b30-openshift-default-698d8b8d97-jk5j9"]
Jul 17 19:13:10.492211 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:10.492164    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" path="/var/lib/kubelet/pods/8c3a4b71-9049-4855-9abb-9a893f0f2f54/volumes"
Jul 17 19:13:18.258800 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:18.258766    2581 generic.go:356] "Generic (PLEG): container finished" podID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerID="5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80" exitCode=0
Jul 17 19:13:18.259310 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:18.258841    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" event={"ID":"60b37259-1654-4d6e-989e-d6dc65d5953b","Type":"ContainerDied","Data":"5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80"}
Jul 17 19:13:18.259310 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:18.259269    2581 scope.go:117] "RemoveContainer" containerID="5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80"
Jul 17 19:13:18.260302 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:18.260271    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:13:18.260365 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:18.260351    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:13:18.260418 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:18.260401    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:13:19.265613 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:19.265583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" event={"ID":"60b37259-1654-4d6e-989e-d6dc65d5953b","Type":"ContainerStarted","Data":"adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e"}
Jul 17 19:13:19.643821 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:19.643740    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:19.644940 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:19.644915    2581 patch_prober.go:28] interesting pod/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 17 19:13:19.645043 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:19.644967    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 17 19:13:20.644643 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:20.644611    2581 patch_prober.go:28] interesting pod/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 17 19:13:20.645095 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:20.644667    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 17 19:13:21.196778 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:21.196736    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:21.644638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:21.644541    2581 patch_prober.go:28] interesting pod/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 17 19:13:21.644638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:21.644602    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 17 19:13:22.644264 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:22.644222    2581 patch_prober.go:28] interesting pod/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 17 19:13:22.644447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:22.644294    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 17 19:13:23.648466 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:23.648430    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:23.649481 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:23.649449    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:46.973973 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:46.973941    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"]
Jul 17 19:13:46.974396 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:46.974153    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy" containerID="cri-o://adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e" gracePeriod=30
Jul 17 19:13:47.820093 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.820057    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"]
Jul 17 19:13:47.820486 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.820473    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerName="istio-proxy"
Jul 17 19:13:47.820558 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.820488    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerName="istio-proxy"
Jul 17 19:13:47.820614 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.820576    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerName="istio-proxy"
Jul 17 19:13:47.820614 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.820585    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerName="istio-proxy"
Jul 17 19:13:47.825172 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.825153    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.827979 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.827963    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e544e90b-openshift-default-dockercfg-xjbrt\""
Jul 17 19:13:47.855156 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.855129    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"]
Jul 17 19:13:47.861614 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.861591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gdr2\" (UniqueName: \"kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-kube-api-access-5gdr2\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.861716 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.861636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-credential-socket\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.861716 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.861662    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-envoy\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.861791 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.861747    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71111088-9451-4ae5-af65-831f30b1a028-istio-podinfo\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.861848 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.861833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71111088-9451-4ae5-af65-831f30b1a028-istiod-ca-cert\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.861909 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.861895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-data\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.861952 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.861927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-certs\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.861990 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.861963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-istio-token\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.862038 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.861990    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-socket\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.962645 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.962614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71111088-9451-4ae5-af65-831f30b1a028-istiod-ca-cert\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.962840 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.962665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-data\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.962840 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.962786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-certs\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.962966 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.962844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-istio-token\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.962966 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.962878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-socket\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.962966 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.962916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gdr2\" (UniqueName: \"kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-kube-api-access-5gdr2\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.962966 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.962959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-credential-socket\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.963165 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.962983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-envoy\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.963165 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.963021    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-data\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.963165 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.963031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71111088-9451-4ae5-af65-831f30b1a028-istio-podinfo\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.963165 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.963122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-certs\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.963437 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.963228    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-socket\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.963437 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.963400    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71111088-9451-4ae5-af65-831f30b1a028-istiod-ca-cert\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.963554 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.963522    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-credential-socket\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.965574 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.965551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71111088-9451-4ae5-af65-831f30b1a028-istio-podinfo\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.965683 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.965581    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-envoy\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.975032 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.975005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-istio-token\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:47.978117 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:47.978096    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gdr2\" (UniqueName: \"kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-kube-api-access-5gdr2\") pod \"e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") " pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:48.134938 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:48.134867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:48.283010 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:48.282986    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"]
Jul 17 19:13:48.285189 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:13:48.285161    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71111088_9451_4ae5_af65_831f30b1a028.slice/crio-060538eb0522aa5d3be15dc89c3e0bd831137d80b0afb237abd464ebe1255177 WatchSource:0}: Error finding container 060538eb0522aa5d3be15dc89c3e0bd831137d80b0afb237abd464ebe1255177: Status 404 returned error can't find the container with id 060538eb0522aa5d3be15dc89c3e0bd831137d80b0afb237abd464ebe1255177
Jul 17 19:13:48.287460 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:48.287418    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:13:48.287541 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:48.287504    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:13:48.287580 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:48.287544    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:13:48.406143 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:48.406111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" event={"ID":"71111088-9451-4ae5-af65-831f30b1a028","Type":"ContainerStarted","Data":"2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34"}
Jul 17 19:13:48.406319 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:48.406169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" event={"ID":"71111088-9451-4ae5-af65-831f30b1a028","Type":"ContainerStarted","Data":"060538eb0522aa5d3be15dc89c3e0bd831137d80b0afb237abd464ebe1255177"}
Jul 17 19:13:48.432642 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:48.432591    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" podStartSLOduration=1.432574743 podStartE2EDuration="1.432574743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:13:48.4299191 +0000 UTC m=+1748.424285115" watchObservedRunningTime="2026-07-17 19:13:48.432574743 +0000 UTC m=+1748.426940757"
Jul 17 19:13:49.135349 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:49.135314    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:49.140300 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:49.140277    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:49.411144 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:49.411114    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:49.412003 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:49.411982    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:13:52.232587 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.232561    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:52.308180 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308097    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-certs\") pod \"60b37259-1654-4d6e-989e-d6dc65d5953b\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") "
Jul 17 19:13:52.308180 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308138    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-podinfo\") pod \"60b37259-1654-4d6e-989e-d6dc65d5953b\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") "
Jul 17 19:13:52.308180 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308166    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ml79\" (UniqueName: \"kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-kube-api-access-5ml79\") pod \"60b37259-1654-4d6e-989e-d6dc65d5953b\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") "
Jul 17 19:13:52.308461 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308228    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-token\") pod \"60b37259-1654-4d6e-989e-d6dc65d5953b\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") "
Jul 17 19:13:52.308461 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-data\") pod \"60b37259-1654-4d6e-989e-d6dc65d5953b\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") "
Jul 17 19:13:52.308461 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308350    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-envoy\") pod \"60b37259-1654-4d6e-989e-d6dc65d5953b\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") "
Jul 17 19:13:52.308461 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308414    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b37259-1654-4d6e-989e-d6dc65d5953b-istiod-ca-cert\") pod \"60b37259-1654-4d6e-989e-d6dc65d5953b\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") "
Jul 17 19:13:52.308461 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-socket\") pod \"60b37259-1654-4d6e-989e-d6dc65d5953b\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") "
Jul 17 19:13:52.308727 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308476    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-credential-socket\") pod \"60b37259-1654-4d6e-989e-d6dc65d5953b\" (UID: \"60b37259-1654-4d6e-989e-d6dc65d5953b\") "
Jul 17 19:13:52.308879 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308798    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60b37259-1654-4d6e-989e-d6dc65d5953b" (UID: "60b37259-1654-4d6e-989e-d6dc65d5953b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:13:52.308977 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.308879    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60b37259-1654-4d6e-989e-d6dc65d5953b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60b37259-1654-4d6e-989e-d6dc65d5953b" (UID: "60b37259-1654-4d6e-989e-d6dc65d5953b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:13:52.309258 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.309037    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60b37259-1654-4d6e-989e-d6dc65d5953b" (UID: "60b37259-1654-4d6e-989e-d6dc65d5953b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:13:52.309431 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.309165    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60b37259-1654-4d6e-989e-d6dc65d5953b" (UID: "60b37259-1654-4d6e-989e-d6dc65d5953b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:13:52.309624 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.309597    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-data" (OuterVolumeSpecName: "istio-data") pod "60b37259-1654-4d6e-989e-d6dc65d5953b" (UID: "60b37259-1654-4d6e-989e-d6dc65d5953b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:13:52.310641 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.310618    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60b37259-1654-4d6e-989e-d6dc65d5953b" (UID: "60b37259-1654-4d6e-989e-d6dc65d5953b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:13:52.310725 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.310674    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60b37259-1654-4d6e-989e-d6dc65d5953b" (UID: "60b37259-1654-4d6e-989e-d6dc65d5953b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:13:52.310725 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.310705    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-kube-api-access-5ml79" (OuterVolumeSpecName: "kube-api-access-5ml79") pod "60b37259-1654-4d6e-989e-d6dc65d5953b" (UID: "60b37259-1654-4d6e-989e-d6dc65d5953b"). InnerVolumeSpecName "kube-api-access-5ml79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:13:52.310873 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.310858    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-token" (OuterVolumeSpecName: "istio-token") pod "60b37259-1654-4d6e-989e-d6dc65d5953b" (UID: "60b37259-1654-4d6e-989e-d6dc65d5953b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:13:52.410011 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.409982    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:52.410011 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.410005    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:52.410011 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.410014    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b37259-1654-4d6e-989e-d6dc65d5953b-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:52.410232 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.410023    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:52.410232 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.410032    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:52.410232 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.410040    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b37259-1654-4d6e-989e-d6dc65d5953b-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:52.410232 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.410047    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:52.410232 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.410056    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ml79\" (UniqueName: \"kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-kube-api-access-5ml79\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:52.410232 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.410064    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b37259-1654-4d6e-989e-d6dc65d5953b-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:13:52.425883 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.425853    2581 generic.go:356] "Generic (PLEG): container finished" podID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerID="adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e" exitCode=0
Jul 17 19:13:52.426009 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.425904    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"
Jul 17 19:13:52.426009 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.425939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" event={"ID":"60b37259-1654-4d6e-989e-d6dc65d5953b","Type":"ContainerDied","Data":"adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e"}
Jul 17 19:13:52.426009 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.425994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v" event={"ID":"60b37259-1654-4d6e-989e-d6dc65d5953b","Type":"ContainerDied","Data":"c01392620d407154f5e90f8bcb1ecee9a4acae6e6762fada8024587c0005f900"}
Jul 17 19:13:52.426127 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.426022    2581 scope.go:117] "RemoveContainer" containerID="adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e"
Jul 17 19:13:52.435599 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.435584    2581 scope.go:117] "RemoveContainer" containerID="5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80"
Jul 17 19:13:52.444127 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.444113    2581 scope.go:117] "RemoveContainer" containerID="adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e"
Jul 17 19:13:52.444380 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:13:52.444365    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e\": container with ID starting with adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e not found: ID does not exist" containerID="adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e"
Jul 17 19:13:52.444450 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.444388    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e"} err="failed to get container status \"adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e\": rpc error: code = NotFound desc = could not find container \"adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e\": container with ID starting with adfc6d857edb0ec2caf850b89ac6b79842acc155c6657f3291adb4a6ae45328e not found: ID does not exist"
Jul 17 19:13:52.444450 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.444403    2581 scope.go:117] "RemoveContainer" containerID="5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80"
Jul 17 19:13:52.444649 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:13:52.444630    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80\": container with ID starting with 5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80 not found: ID does not exist" containerID="5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80"
Jul 17 19:13:52.444707 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.444661    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80"} err="failed to get container status \"5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80\": rpc error: code = NotFound desc = could not find container \"5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80\": container with ID starting with 5b1236e0a9956b4d61f65f98b7d4a71af1fed4726eeaf683ebd1d0cd54d4af80 not found: ID does not exist"
Jul 17 19:13:52.452398 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.452377    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"]
Jul 17 19:13:52.458160 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.458141    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-eb352e55-gw-openshift-default-78cdf45dff-ckn4v"]
Jul 17 19:13:52.491429 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:13:52.487935    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" path="/var/lib/kubelet/pods/60b37259-1654-4d6e-989e-d6dc65d5953b/volumes"
Jul 17 19:14:04.412442 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:04.412403    2581 patch_prober.go:28] interesting pod/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 17 19:14:04.412908 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:04.412478    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 17 19:14:04.486920 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:04.486882    2581 generic.go:356] "Generic (PLEG): container finished" podID="71111088-9451-4ae5-af65-831f30b1a028" containerID="2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34" exitCode=0
Jul 17 19:14:04.486920 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:04.486919    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" event={"ID":"71111088-9451-4ae5-af65-831f30b1a028","Type":"ContainerDied","Data":"2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34"}
Jul 17 19:14:04.487336 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:04.487320    2581 scope.go:117] "RemoveContainer" containerID="2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34"
Jul 17 19:14:04.488275 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:04.488247    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:14:04.488339 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:04.488315    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:14:04.488390 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:04.488348    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:14:05.498686 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:05.498641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" event={"ID":"71111088-9451-4ae5-af65-831f30b1a028","Type":"ContainerStarted","Data":"8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c"}
Jul 17 19:14:06.135186 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:06.135142    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:14:06.135421 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:06.135394    2581 patch_prober.go:28] interesting pod/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 17 19:14:06.135472 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:06.135451    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 17 19:14:07.135618 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:07.135585    2581 patch_prober.go:28] interesting pod/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 17 19:14:07.136006 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:07.135641    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 17 19:14:08.135403 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:08.135369    2581 patch_prober.go:28] interesting pod/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 17 19:14:08.135583 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:08.135425    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 17 19:14:09.135210 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:09.135138    2581 patch_prober.go:28] interesting pod/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 17 19:14:09.135210 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:09.135188    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 17 19:14:10.139424 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:10.139394    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:14:10.139846 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:10.139651    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:14:10.140263 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:10.140246    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:14:31.958128 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:31.958054    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"]
Jul 17 19:14:31.958555 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:31.958283    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy" containerID="cri-o://8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c" gracePeriod=30
Jul 17 19:14:32.815815 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.815784    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"]
Jul 17 19:14:32.816169 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.816156    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerName="istio-proxy"
Jul 17 19:14:32.816253 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.816170    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c3a4b71-9049-4855-9abb-9a893f0f2f54" containerName="istio-proxy"
Jul 17 19:14:32.816253 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.816183    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy"
Jul 17 19:14:32.816253 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.816188    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy"
Jul 17 19:14:32.816253 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.816214    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy"
Jul 17 19:14:32.816253 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.816221    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy"
Jul 17 19:14:32.816503 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.816286    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy"
Jul 17 19:14:32.816503 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.816295    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="60b37259-1654-4d6e-989e-d6dc65d5953b" containerName="istio-proxy"
Jul 17 19:14:32.819317 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.819296    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:32.827807 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.827784    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a8061117-openshift-default-dockercfg-99jqn\""
Jul 17 19:14:32.861927 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.861905    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"]
Jul 17 19:14:32.959456 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.959422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-envoy\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:32.959858 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.959465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-socket\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:32.959858 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.959496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-podinfo\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:32.959858 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.959559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istiod-ca-cert\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:32.959858 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.959603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-credential-socket\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:32.959858 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.959620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-certs\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:32.959858 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.959645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-data\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:32.959858 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.959668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bgh6\" (UniqueName: \"kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-kube-api-access-7bgh6\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:32.959858 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:32.959734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-token\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.060212 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-token\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.060369 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-envoy\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.060369 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-socket\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.060369 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-podinfo\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.060369 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istiod-ca-cert\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.060548 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-credential-socket\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.060548 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-certs\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.060548 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-data\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.060548 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bgh6\" (UniqueName: \"kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-kube-api-access-7bgh6\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.061005 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060859    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-credential-socket\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.061005 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-data\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.061005 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-socket\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.061005 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.060979    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-certs\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.061269 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.061112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istiod-ca-cert\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.062683 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.062657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-envoy\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.063193 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.063169    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-podinfo\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.088042 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.087992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-token\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.092479 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.092453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bgh6\" (UniqueName: \"kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-kube-api-access-7bgh6\") pod \"e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") " pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.130172 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.130151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:33.282034 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.282015    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"]
Jul 17 19:14:33.284561 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:14:33.284529    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf749e7cc_0dd4_45a7_8588_ae5b065cf74f.slice/crio-7e10af355fb4b0bd8c1953f6630bbaeef534fe694efcd9b3458f289e74c23a07 WatchSource:0}: Error finding container 7e10af355fb4b0bd8c1953f6630bbaeef534fe694efcd9b3458f289e74c23a07: Status 404 returned error can't find the container with id 7e10af355fb4b0bd8c1953f6630bbaeef534fe694efcd9b3458f289e74c23a07
Jul 17 19:14:33.286609 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.286579    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:14:33.286678 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.286644    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:14:33.286678 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.286672    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:14:33.632133 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.632090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" event={"ID":"f749e7cc-0dd4-45a7-8588-ae5b065cf74f","Type":"ContainerStarted","Data":"ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0"}
Jul 17 19:14:33.632318 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.632188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" event={"ID":"f749e7cc-0dd4-45a7-8588-ae5b065cf74f","Type":"ContainerStarted","Data":"7e10af355fb4b0bd8c1953f6630bbaeef534fe694efcd9b3458f289e74c23a07"}
Jul 17 19:14:33.660676 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:33.660620    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" podStartSLOduration=1.66060491 podStartE2EDuration="1.66060491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:14:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:14:33.658098265 +0000 UTC m=+1793.652464281" watchObservedRunningTime="2026-07-17 19:14:33.66060491 +0000 UTC m=+1793.654970926"
Jul 17 19:14:34.130671 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:34.130640    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:34.135387 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:34.135362    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:34.637037 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:34.637005    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:34.638059 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:34.638040    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:37.209592 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.209567    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:14:37.300012 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.299939    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-data\") pod \"71111088-9451-4ae5-af65-831f30b1a028\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") "
Jul 17 19:14:37.300012 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.299980    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-envoy\") pod \"71111088-9451-4ae5-af65-831f30b1a028\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") "
Jul 17 19:14:37.300012 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300005    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71111088-9451-4ae5-af65-831f30b1a028-istiod-ca-cert\") pod \"71111088-9451-4ae5-af65-831f30b1a028\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") "
Jul 17 19:14:37.300269 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300025    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-certs\") pod \"71111088-9451-4ae5-af65-831f30b1a028\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") "
Jul 17 19:14:37.300269 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300079    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-credential-socket\") pod \"71111088-9451-4ae5-af65-831f30b1a028\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") "
Jul 17 19:14:37.300269 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300105    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gdr2\" (UniqueName: \"kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-kube-api-access-5gdr2\") pod \"71111088-9451-4ae5-af65-831f30b1a028\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") "
Jul 17 19:14:37.300269 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300142    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-istio-token\") pod \"71111088-9451-4ae5-af65-831f30b1a028\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") "
Jul 17 19:14:37.300269 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300191    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71111088-9451-4ae5-af65-831f30b1a028-istio-podinfo\") pod \"71111088-9451-4ae5-af65-831f30b1a028\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") "
Jul 17 19:14:37.300269 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300248    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-socket\") pod \"71111088-9451-4ae5-af65-831f30b1a028\" (UID: \"71111088-9451-4ae5-af65-831f30b1a028\") "
Jul 17 19:14:37.300591 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300420    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71111088-9451-4ae5-af65-831f30b1a028-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71111088-9451-4ae5-af65-831f30b1a028" (UID: "71111088-9451-4ae5-af65-831f30b1a028"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:14:37.300591 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300423    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71111088-9451-4ae5-af65-831f30b1a028" (UID: "71111088-9451-4ae5-af65-831f30b1a028"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:14:37.300591 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300441    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71111088-9451-4ae5-af65-831f30b1a028" (UID: "71111088-9451-4ae5-af65-831f30b1a028"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:14:37.300747 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300629    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:14:37.300747 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300652    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71111088-9451-4ae5-af65-831f30b1a028-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:14:37.300747 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300662    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71111088-9451-4ae5-af65-831f30b1a028" (UID: "71111088-9451-4ae5-af65-831f30b1a028"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:14:37.300747 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.300669    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:14:37.301189 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.301096    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-data" (OuterVolumeSpecName: "istio-data") pod "71111088-9451-4ae5-af65-831f30b1a028" (UID: "71111088-9451-4ae5-af65-831f30b1a028"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:14:37.302486 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.302466    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-kube-api-access-5gdr2" (OuterVolumeSpecName: "kube-api-access-5gdr2") pod "71111088-9451-4ae5-af65-831f30b1a028" (UID: "71111088-9451-4ae5-af65-831f30b1a028"). InnerVolumeSpecName "kube-api-access-5gdr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:14:37.302620 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.302600    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71111088-9451-4ae5-af65-831f30b1a028-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71111088-9451-4ae5-af65-831f30b1a028" (UID: "71111088-9451-4ae5-af65-831f30b1a028"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:14:37.302669 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.302600    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71111088-9451-4ae5-af65-831f30b1a028" (UID: "71111088-9451-4ae5-af65-831f30b1a028"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:14:37.302741 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.302727    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-istio-token" (OuterVolumeSpecName: "istio-token") pod "71111088-9451-4ae5-af65-831f30b1a028" (UID: "71111088-9451-4ae5-af65-831f30b1a028"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:14:37.401692 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.401668    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gdr2\" (UniqueName: \"kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-kube-api-access-5gdr2\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:14:37.401692 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.401690    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71111088-9451-4ae5-af65-831f30b1a028-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:14:37.401833 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.401700    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71111088-9451-4ae5-af65-831f30b1a028-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:14:37.401833 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.401709    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:14:37.401833 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.401716    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:14:37.401833 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.401725    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71111088-9451-4ae5-af65-831f30b1a028-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:14:37.652776 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.652737    2581 generic.go:356] "Generic (PLEG): container finished" podID="71111088-9451-4ae5-af65-831f30b1a028" containerID="8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c" exitCode=0
Jul 17 19:14:37.652948 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.652773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" event={"ID":"71111088-9451-4ae5-af65-831f30b1a028","Type":"ContainerDied","Data":"8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c"}
Jul 17 19:14:37.652948 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.652824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg" event={"ID":"71111088-9451-4ae5-af65-831f30b1a028","Type":"ContainerDied","Data":"060538eb0522aa5d3be15dc89c3e0bd831137d80b0afb237abd464ebe1255177"}
Jul 17 19:14:37.652948 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.652755    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"
Jul 17 19:14:37.652948 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.652850    2581 scope.go:117] "RemoveContainer" containerID="8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c"
Jul 17 19:14:37.668636 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.668620    2581 scope.go:117] "RemoveContainer" containerID="2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34"
Jul 17 19:14:37.677060 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.677035    2581 scope.go:117] "RemoveContainer" containerID="8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c"
Jul 17 19:14:37.677421 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:14:37.677386    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c\": container with ID starting with 8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c not found: ID does not exist" containerID="8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c"
Jul 17 19:14:37.677555 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.677423    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c"} err="failed to get container status \"8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c\": rpc error: code = NotFound desc = could not find container \"8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c\": container with ID starting with 8e168bda54e8a7760611272dad5a214bfeab4dd945f4601bf8f2d575faccdd6c not found: ID does not exist"
Jul 17 19:14:37.677555 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.677444    2581 scope.go:117] "RemoveContainer" containerID="2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34"
Jul 17 19:14:37.677736 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:14:37.677719    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34\": container with ID starting with 2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34 not found: ID does not exist" containerID="2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34"
Jul 17 19:14:37.677782 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.677740    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34"} err="failed to get container status \"2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34\": rpc error: code = NotFound desc = could not find container \"2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34\": container with ID starting with 2d069e2c2ca7906f8b2e9088b931c52be4cee6da8245a37821cd92afe6464a34 not found: ID does not exist"
Jul 17 19:14:37.679150 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.679131    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"]
Jul 17 19:14:37.682984 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:37.682966    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e544e90b-openshift-default-85645cf5-mcvbg"]
Jul 17 19:14:38.487130 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:38.487099    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71111088-9451-4ae5-af65-831f30b1a028" path="/var/lib/kubelet/pods/71111088-9451-4ae5-af65-831f30b1a028/volumes"
Jul 17 19:14:48.715639 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:48.715603    2581 generic.go:356] "Generic (PLEG): container finished" podID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerID="ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0" exitCode=0
Jul 17 19:14:48.716108 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:48.715663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" event={"ID":"f749e7cc-0dd4-45a7-8588-ae5b065cf74f","Type":"ContainerDied","Data":"ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0"}
Jul 17 19:14:48.716108 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:48.715997    2581 scope.go:117] "RemoveContainer" containerID="ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0"
Jul 17 19:14:48.717009 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:48.716975    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:14:48.717100 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:48.717048    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:14:48.717100 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:48.717079    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:14:49.637214 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:49.637173    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:49.722823 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:49.722788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" event={"ID":"f749e7cc-0dd4-45a7-8588-ae5b065cf74f","Type":"ContainerStarted","Data":"fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4"}
Jul 17 19:14:50.130402 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:50.130369    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:50.131534 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:50.131506    2581 patch_prober.go:28] interesting pod/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 17 19:14:50.131611 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:50.131564    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 17 19:14:51.131284 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:51.131254    2581 patch_prober.go:28] interesting pod/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 17 19:14:51.131670 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:51.131311    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 17 19:14:52.131019 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:52.130990    2581 patch_prober.go:28] interesting pod/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 17 19:14:52.131209 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:52.131040    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 17 19:14:53.130975 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:53.130940    2581 patch_prober.go:28] interesting pod/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 17 19:14:53.131396 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:53.131006    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 17 19:14:54.134380 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:54.134343    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:54.134843 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:54.134742    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:14:54.135444 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:14:54.135424    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:15:15.144095 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:15.144060    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"]
Jul 17 19:15:15.144674 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:15.144337    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy" containerID="cri-o://fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4" gracePeriod=30
Jul 17 19:15:20.402884 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.402856    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:15:20.594440 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594354    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-data\") pod \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") "
Jul 17 19:15:20.594440 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594391    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bgh6\" (UniqueName: \"kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-kube-api-access-7bgh6\") pod \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") "
Jul 17 19:15:20.594440 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594440    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-credential-socket\") pod \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") "
Jul 17 19:15:20.594739 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594458    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-certs\") pod \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") "
Jul 17 19:15:20.594739 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594487    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-podinfo\") pod \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") "
Jul 17 19:15:20.594739 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594504    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-token\") pod \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") "
Jul 17 19:15:20.594739 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594525    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istiod-ca-cert\") pod \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") "
Jul 17 19:15:20.594739 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594677    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-socket\") pod \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") "
Jul 17 19:15:20.594739 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594717    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-envoy\") pod \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\" (UID: \"f749e7cc-0dd4-45a7-8588-ae5b065cf74f\") "
Jul 17 19:15:20.595049 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594753    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f749e7cc-0dd4-45a7-8588-ae5b065cf74f" (UID: "f749e7cc-0dd4-45a7-8588-ae5b065cf74f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:15:20.595049 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594895    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f749e7cc-0dd4-45a7-8588-ae5b065cf74f" (UID: "f749e7cc-0dd4-45a7-8588-ae5b065cf74f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:15:20.595049 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.594983    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f749e7cc-0dd4-45a7-8588-ae5b065cf74f" (UID: "f749e7cc-0dd4-45a7-8588-ae5b065cf74f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:15:20.595049 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.595001    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f749e7cc-0dd4-45a7-8588-ae5b065cf74f" (UID: "f749e7cc-0dd4-45a7-8588-ae5b065cf74f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:15:20.595304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.595151    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:15:20.595304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.595169    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:15:20.595304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.595182    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:15:20.595304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.595230    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:15:20.595512 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.595358    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-data" (OuterVolumeSpecName: "istio-data") pod "f749e7cc-0dd4-45a7-8588-ae5b065cf74f" (UID: "f749e7cc-0dd4-45a7-8588-ae5b065cf74f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:15:20.597153 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.597125    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f749e7cc-0dd4-45a7-8588-ae5b065cf74f" (UID: "f749e7cc-0dd4-45a7-8588-ae5b065cf74f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:15:20.597288 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.597264    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-token" (OuterVolumeSpecName: "istio-token") pod "f749e7cc-0dd4-45a7-8588-ae5b065cf74f" (UID: "f749e7cc-0dd4-45a7-8588-ae5b065cf74f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:15:20.597525 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.597497    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-kube-api-access-7bgh6" (OuterVolumeSpecName: "kube-api-access-7bgh6") pod "f749e7cc-0dd4-45a7-8588-ae5b065cf74f" (UID: "f749e7cc-0dd4-45a7-8588-ae5b065cf74f"). InnerVolumeSpecName "kube-api-access-7bgh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:15:20.597624 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.597487    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f749e7cc-0dd4-45a7-8588-ae5b065cf74f" (UID: "f749e7cc-0dd4-45a7-8588-ae5b065cf74f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:15:20.695829 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.695794    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:15:20.695829 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.695823    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:15:20.695829 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.695834    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bgh6\" (UniqueName: \"kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-kube-api-access-7bgh6\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:15:20.696066 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.695844    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:15:20.696066 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.695852    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f749e7cc-0dd4-45a7-8588-ae5b065cf74f-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:15:20.883888 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.883765    2581 generic.go:356] "Generic (PLEG): container finished" podID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerID="fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4" exitCode=0
Jul 17 19:15:20.883888 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.883833    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"
Jul 17 19:15:20.883888 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.883847    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" event={"ID":"f749e7cc-0dd4-45a7-8588-ae5b065cf74f","Type":"ContainerDied","Data":"fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4"}
Jul 17 19:15:20.884091 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.883909    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf" event={"ID":"f749e7cc-0dd4-45a7-8588-ae5b065cf74f","Type":"ContainerDied","Data":"7e10af355fb4b0bd8c1953f6630bbaeef534fe694efcd9b3458f289e74c23a07"}
Jul 17 19:15:20.884091 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.883938    2581 scope.go:117] "RemoveContainer" containerID="fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4"
Jul 17 19:15:20.894077 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.894056    2581 scope.go:117] "RemoveContainer" containerID="ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0"
Jul 17 19:15:20.902121 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.902104    2581 scope.go:117] "RemoveContainer" containerID="fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4"
Jul 17 19:15:20.902430 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:15:20.902405    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4\": container with ID starting with fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4 not found: ID does not exist" containerID="fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4"
Jul 17 19:15:20.902541 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.902436    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4"} err="failed to get container status \"fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4\": rpc error: code = NotFound desc = could not find container \"fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4\": container with ID starting with fff5a56b6528ce8dd2a7b1496f0a6a682edefad511f61308cbbb93b4bf3314d4 not found: ID does not exist"
Jul 17 19:15:20.902541 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.902452    2581 scope.go:117] "RemoveContainer" containerID="ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0"
Jul 17 19:15:20.902703 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:15:20.902685    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0\": container with ID starting with ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0 not found: ID does not exist" containerID="ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0"
Jul 17 19:15:20.902749 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.902708    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0"} err="failed to get container status \"ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0\": rpc error: code = NotFound desc = could not find container \"ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0\": container with ID starting with ecb86af0fb47c609017c19b7fbe1e6eb5c2185ab3441c90fa1ed9a79f0e24bc0 not found: ID does not exist"
Jul 17 19:15:20.914628 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.914608    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"]
Jul 17 19:15:20.919370 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:20.919352    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a8061117-openshift-default-59ffbf9b55-gt7jf"]
Jul 17 19:15:22.487011 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:15:22.486978    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" path="/var/lib/kubelet/pods/f749e7cc-0dd4-45a7-8588-ae5b065cf74f/volumes"
Jul 17 19:16:56.158157 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158122    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"]
Jul 17 19:16:56.158768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158510    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy"
Jul 17 19:16:56.158768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158525    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy"
Jul 17 19:16:56.158768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158537    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy"
Jul 17 19:16:56.158768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158542    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy"
Jul 17 19:16:56.158768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158550    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy"
Jul 17 19:16:56.158768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158556    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy"
Jul 17 19:16:56.158768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158564    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy"
Jul 17 19:16:56.158768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158570    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy"
Jul 17 19:16:56.158768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158632    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy"
Jul 17 19:16:56.158768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.158639    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy"
Jul 17 19:16:56.161572 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.161555    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.165276 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.165257    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1db770c3-openshift-default-dockercfg-tmfn2\""
Jul 17 19:16:56.201968 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.201942    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"]
Jul 17 19:16:56.308192 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.308149    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istiod-ca-cert\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.308399 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.308232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-certs\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.308399 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.308265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-token\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.308399 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.308294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-data\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.308399 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.308360    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-socket\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.308555 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.308409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-envoy\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.308555 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.308469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-credential-socket\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.308555 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.308493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwrj4\" (UniqueName: \"kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-kube-api-access-gwrj4\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.308555 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.308525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-podinfo\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.409688 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.409597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-socket\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.409688 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.409640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-envoy\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.409688 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.409685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-credential-socket\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.409973 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.409707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwrj4\" (UniqueName: \"kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-kube-api-access-gwrj4\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.409973 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.409751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-podinfo\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.409973 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.409804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istiod-ca-cert\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.409973 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.409831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-certs\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.409973 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.409858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-token\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.409973 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.409947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-data\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.410316 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.410045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-socket\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.410316 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.410263    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-certs\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.410428 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.410337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-data\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.410486 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.410423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-credential-socket\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.410576 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.410556    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istiod-ca-cert\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.412735 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.412705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-envoy\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.413068 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.413046    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-podinfo\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.419371 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.419326    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-token\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.419922 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.419900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwrj4\" (UniqueName: \"kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-kube-api-access-gwrj4\") pod \"e2e-mt-1db770c3-openshift-default-55cb678699-2f84k\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") " pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.472466 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.472445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:56.622984 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.622959    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"]
Jul 17 19:16:56.625358 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:16:56.625333    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6d503c_a23b_4f63_8fdd_308813ebd6eb.slice/crio-d6225e8210de805b5eb6b09aaa32a710543e90076f1cbcbc4f227731e8fa834f WatchSource:0}: Error finding container d6225e8210de805b5eb6b09aaa32a710543e90076f1cbcbc4f227731e8fa834f: Status 404 returned error can't find the container with id d6225e8210de805b5eb6b09aaa32a710543e90076f1cbcbc4f227731e8fa834f
Jul 17 19:16:56.630633 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.630597    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:16:56.630715 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.630676    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:16:56.630715 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:56.630706    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:16:57.338427 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:57.338387    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" event={"ID":"ba6d503c-a23b-4f63-8fdd-308813ebd6eb","Type":"ContainerStarted","Data":"cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d"}
Jul 17 19:16:57.338889 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:57.338449    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" event={"ID":"ba6d503c-a23b-4f63-8fdd-308813ebd6eb","Type":"ContainerStarted","Data":"d6225e8210de805b5eb6b09aaa32a710543e90076f1cbcbc4f227731e8fa834f"}
Jul 17 19:16:57.368213 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:57.368159    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" podStartSLOduration=1.368143524 podStartE2EDuration="1.368143524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:16:57.364066781 +0000 UTC m=+1937.358432796" watchObservedRunningTime="2026-07-17 19:16:57.368143524 +0000 UTC m=+1937.362509539"
Jul 17 19:16:57.473357 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:57.473323    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:57.475217 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:57.475175    2581 patch_prober.go:28] interesting pod/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 17 19:16:57.475344 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:57.475252    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 17 19:16:58.477528 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:58.477488    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:59.349382 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:59.349351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:16:59.350298 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:16:59.350278    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:17:14.359129 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:14.358482    2581 patch_prober.go:28] interesting pod/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:53376->10.133.0.52:15021: read: connection reset by peer" start-of-body=
Jul 17 19:17:14.359129 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:14.358547    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:53376->10.133.0.52:15021: read: connection reset by peer"
Jul 17 19:17:14.432090 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:14.432063    2581 generic.go:356] "Generic (PLEG): container finished" podID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerID="cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d" exitCode=0
Jul 17 19:17:14.432225 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:14.432150    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" event={"ID":"ba6d503c-a23b-4f63-8fdd-308813ebd6eb","Type":"ContainerDied","Data":"cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d"}
Jul 17 19:17:14.432565 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:14.432549    2581 scope.go:117] "RemoveContainer" containerID="cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d"
Jul 17 19:17:14.433491 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:14.433462    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:17:14.433585 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:14.433568    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:17:14.433651 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:14.433628    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:17:15.439380 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:15.439345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" event={"ID":"ba6d503c-a23b-4f63-8fdd-308813ebd6eb","Type":"ContainerStarted","Data":"e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b"}
Jul 17 19:17:15.472784 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:15.472754    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:17:15.472987 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:15.472967    2581 patch_prober.go:28] interesting pod/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 17 19:17:15.473038 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:15.473015    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 17 19:17:16.473299 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:16.473246    2581 patch_prober.go:28] interesting pod/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 17 19:17:16.473780 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:16.473318    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 17 19:17:17.473885 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:17.473847    2581 patch_prober.go:28] interesting pod/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 17 19:17:17.474328 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:17.473905    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 17 19:17:18.472818 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:18.472785    2581 patch_prober.go:28] interesting pod/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 17 19:17:18.472994 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:18.472844    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 17 19:17:19.476812 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:19.476786    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:17:19.477301 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:19.477286    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:17:19.478075 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:19.478056    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:17:33.687287 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:33.687174    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"]
Jul 17 19:17:33.687873 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:33.687437    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy" containerID="cri-o://e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b" gracePeriod=30
Jul 17 19:17:34.479386 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:34.479348    2581 patch_prober.go:28] interesting pod/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 19:17:34.479590 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:34.479417    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 19:17:38.946901 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:38.946874    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:17:39.108574 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108494    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-certs\") pod \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") "
Jul 17 19:17:39.108574 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108532    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-socket\") pod \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") "
Jul 17 19:17:39.108574 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108574    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-token\") pod \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") "
Jul 17 19:17:39.108880 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108645    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istiod-ca-cert\") pod \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") "
Jul 17 19:17:39.108880 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108670    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-envoy\") pod \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") "
Jul 17 19:17:39.108880 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108709    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-podinfo\") pod \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") "
Jul 17 19:17:39.108880 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108736    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwrj4\" (UniqueName: \"kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-kube-api-access-gwrj4\") pod \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") "
Jul 17 19:17:39.108880 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108772    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-data\") pod \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") "
Jul 17 19:17:39.108880 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108796    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-credential-socket\") pod \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\" (UID: \"ba6d503c-a23b-4f63-8fdd-308813ebd6eb\") "
Jul 17 19:17:39.108880 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108794    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba6d503c-a23b-4f63-8fdd-308813ebd6eb" (UID: "ba6d503c-a23b-4f63-8fdd-308813ebd6eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:17:39.108880 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.108853    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba6d503c-a23b-4f63-8fdd-308813ebd6eb" (UID: "ba6d503c-a23b-4f63-8fdd-308813ebd6eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:17:39.109328 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.109062    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba6d503c-a23b-4f63-8fdd-308813ebd6eb" (UID: "ba6d503c-a23b-4f63-8fdd-308813ebd6eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:17:39.109328 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.109119    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:17:39.109328 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.109137    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:17:39.109328 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.109304    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba6d503c-a23b-4f63-8fdd-308813ebd6eb" (UID: "ba6d503c-a23b-4f63-8fdd-308813ebd6eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:17:39.109706 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.109579    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba6d503c-a23b-4f63-8fdd-308813ebd6eb" (UID: "ba6d503c-a23b-4f63-8fdd-308813ebd6eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:17:39.111033 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.111009    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba6d503c-a23b-4f63-8fdd-308813ebd6eb" (UID: "ba6d503c-a23b-4f63-8fdd-308813ebd6eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:17:39.111153 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.111048    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba6d503c-a23b-4f63-8fdd-308813ebd6eb" (UID: "ba6d503c-a23b-4f63-8fdd-308813ebd6eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:17:39.111413 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.111395    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-kube-api-access-gwrj4" (OuterVolumeSpecName: "kube-api-access-gwrj4") pod "ba6d503c-a23b-4f63-8fdd-308813ebd6eb" (UID: "ba6d503c-a23b-4f63-8fdd-308813ebd6eb"). InnerVolumeSpecName "kube-api-access-gwrj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:17:39.111413 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.111396    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba6d503c-a23b-4f63-8fdd-308813ebd6eb" (UID: "ba6d503c-a23b-4f63-8fdd-308813ebd6eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:17:39.210002 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.209965    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:17:39.210002 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.209990    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:17:39.210310 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.210004    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:17:39.210310 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.210024    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:17:39.210310 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.210035    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwrj4\" (UniqueName: \"kubernetes.io/projected/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-kube-api-access-gwrj4\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:17:39.210310 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.210049    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:17:39.210310 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.210062    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba6d503c-a23b-4f63-8fdd-308813ebd6eb-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:17:39.557836 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.557801    2581 generic.go:356] "Generic (PLEG): container finished" podID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerID="e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b" exitCode=0
Jul 17 19:17:39.558001 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.557861    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"
Jul 17 19:17:39.558001 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.557892    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" event={"ID":"ba6d503c-a23b-4f63-8fdd-308813ebd6eb","Type":"ContainerDied","Data":"e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b"}
Jul 17 19:17:39.558001 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.557964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k" event={"ID":"ba6d503c-a23b-4f63-8fdd-308813ebd6eb","Type":"ContainerDied","Data":"d6225e8210de805b5eb6b09aaa32a710543e90076f1cbcbc4f227731e8fa834f"}
Jul 17 19:17:39.558001 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.557986    2581 scope.go:117] "RemoveContainer" containerID="e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b"
Jul 17 19:17:39.567121 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.567106    2581 scope.go:117] "RemoveContainer" containerID="cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d"
Jul 17 19:17:39.575113 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.575094    2581 scope.go:117] "RemoveContainer" containerID="e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b"
Jul 17 19:17:39.575445 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:17:39.575424    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b\": container with ID starting with e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b not found: ID does not exist" containerID="e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b"
Jul 17 19:17:39.575525 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.575450    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b"} err="failed to get container status \"e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b\": rpc error: code = NotFound desc = could not find container \"e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b\": container with ID starting with e739a4958e66e8f79bfc9d5858d598c46a5c7b49f32bb0f7047197264e54aa0b not found: ID does not exist"
Jul 17 19:17:39.575525 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.575466    2581 scope.go:117] "RemoveContainer" containerID="cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d"
Jul 17 19:17:39.575739 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:17:39.575714    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d\": container with ID starting with cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d not found: ID does not exist" containerID="cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d"
Jul 17 19:17:39.575835 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.575739    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d"} err="failed to get container status \"cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d\": rpc error: code = NotFound desc = could not find container \"cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d\": container with ID starting with cb6578928a2f0bd1ac7f217c16888bd838597bec038d3ee67e4ec0c46b40239d not found: ID does not exist"
Jul 17 19:17:39.578836 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.578816    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"]
Jul 17 19:17:39.584283 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:39.584263    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1db770c3-openshift-default-55cb678699-2f84k"]
Jul 17 19:17:40.486870 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:40.486838    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" path="/var/lib/kubelet/pods/ba6d503c-a23b-4f63-8fdd-308813ebd6eb/volumes"
Jul 17 19:17:53.902184 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.902144    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"]
Jul 17 19:17:53.902787 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.902770    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy"
Jul 17 19:17:53.902832 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.902790    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy"
Jul 17 19:17:53.902832 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.902803    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy"
Jul 17 19:17:53.902832 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.902811    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy"
Jul 17 19:17:53.902930 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.902919    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy"
Jul 17 19:17:53.902968 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.902937    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6d503c-a23b-4f63-8fdd-308813ebd6eb" containerName="istio-proxy"
Jul 17 19:17:53.902968 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.902946    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f749e7cc-0dd4-45a7-8588-ae5b065cf74f" containerName="istio-proxy"
Jul 17 19:17:53.902968 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.902954    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71111088-9451-4ae5-af65-831f30b1a028" containerName="istio-proxy"
Jul 17 19:17:53.906324 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.906307    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:53.909374 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.909354    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dc79a049-openshift-default-dockercfg-dc6wc\""
Jul 17 19:17:53.919215 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.919177    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"]
Jul 17 19:17:53.936218 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.936176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-envoy\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:53.936325 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.936232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-socket\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:53.936368 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.936349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqwz\" (UniqueName: \"kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-kube-api-access-ncqwz\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:53.936404 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.936393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-credential-socket\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:53.936442 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.936417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-data\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:53.936474 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.936451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-podinfo\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:53.936516 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.936495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istiod-ca-cert\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:53.936558 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.936548    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-certs\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:53.936638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:53.936580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-token\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037156 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqwz\" (UniqueName: \"kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-kube-api-access-ncqwz\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037156 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-credential-socket\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037428 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-data\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037428 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-podinfo\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037428 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istiod-ca-cert\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037622 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-certs\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037622 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-token\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037622 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-envoy\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037622 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-socket\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037822 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037644    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-credential-socket\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037822 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-data\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.037949 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.037903    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-certs\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.038121 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.038102    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istiod-ca-cert\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.038257 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.038236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-socket\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.039834 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.039809    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-podinfo\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.039940 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.039882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-envoy\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.046554 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.046535    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqwz\" (UniqueName: \"kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-kube-api-access-ncqwz\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.046925 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.046893    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-token\") pod \"e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") " pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.218699 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.218617    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:54.357282 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.357256    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"]
Jul 17 19:17:54.359379 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:17:54.359353    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a23a6d_85f9_46d5_a80a_0d1aae6416e8.slice/crio-925d7668da2ccbb8d449f1687f5344e277b4b194c7722342c9fc64b3c11e5f77 WatchSource:0}: Error finding container 925d7668da2ccbb8d449f1687f5344e277b4b194c7722342c9fc64b3c11e5f77: Status 404 returned error can't find the container with id 925d7668da2ccbb8d449f1687f5344e277b4b194c7722342c9fc64b3c11e5f77
Jul 17 19:17:54.361637 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.361598    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:17:54.361709 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.361694    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:17:54.361757 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.361740    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:17:54.631355 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.631275    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" event={"ID":"99a23a6d-85f9-46d5-a80a-0d1aae6416e8","Type":"ContainerStarted","Data":"cb3c2d24799e3234b8695c239fa788c28d9f5bb08ca55c8b79af3205d159abc8"}
Jul 17 19:17:54.631355 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.631333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" event={"ID":"99a23a6d-85f9-46d5-a80a-0d1aae6416e8","Type":"ContainerStarted","Data":"925d7668da2ccbb8d449f1687f5344e277b4b194c7722342c9fc64b3c11e5f77"}
Jul 17 19:17:54.655884 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:54.655817    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" podStartSLOduration=1.655802231 podStartE2EDuration="1.655802231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:17:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:17:54.652417562 +0000 UTC m=+1994.646783577" watchObservedRunningTime="2026-07-17 19:17:54.655802231 +0000 UTC m=+1994.650168310"
Jul 17 19:17:55.218959 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:55.218926    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:55.223825 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:55.223799    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:55.636724 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:55.636651    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:17:55.637508 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:17:55.637491    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:18:11.680376 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:11.680325    2581 patch_prober.go:28] interesting pod/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 19:18:11.680876 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:11.680408    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 19:18:12.730405 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:12.730370    2581 generic.go:356] "Generic (PLEG): container finished" podID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerID="cb3c2d24799e3234b8695c239fa788c28d9f5bb08ca55c8b79af3205d159abc8" exitCode=0
Jul 17 19:18:12.730830 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:12.730421    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" event={"ID":"99a23a6d-85f9-46d5-a80a-0d1aae6416e8","Type":"ContainerDied","Data":"cb3c2d24799e3234b8695c239fa788c28d9f5bb08ca55c8b79af3205d159abc8"}
Jul 17 19:18:12.730830 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:12.730731    2581 scope.go:117] "RemoveContainer" containerID="cb3c2d24799e3234b8695c239fa788c28d9f5bb08ca55c8b79af3205d159abc8"
Jul 17 19:18:12.731707 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:12.731678    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:18:12.731803 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:12.731746    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:18:12.731803 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:12.731777    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:18:13.737148 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:13.737114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" event={"ID":"99a23a6d-85f9-46d5-a80a-0d1aae6416e8","Type":"ContainerStarted","Data":"3322f8c03598e61f26754857d831fac59c39f178e1cb247237ee1bfaed18f584"}
Jul 17 19:18:14.219449 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:14.219411    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:18:14.219699 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:14.219677    2581 patch_prober.go:28] interesting pod/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 17 19:18:14.219745 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:14.219726    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 17 19:18:15.219980 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:15.219944    2581 patch_prober.go:28] interesting pod/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 17 19:18:15.220410 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:15.219997    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 17 19:18:16.219381 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:16.219346    2581 patch_prober.go:28] interesting pod/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 17 19:18:16.219560 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:16.219402    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 17 19:18:17.219850 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:17.219808    2581 patch_prober.go:28] interesting pod/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 17 19:18:17.220279 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:17.219876    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 17 19:18:18.223355 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:18.223317    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:18:18.223731 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:18.223588    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:18:18.224275 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:18.224257    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:18:20.471956 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.471927    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"]
Jul 17 19:18:20.475936 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.475915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.479724 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.479701    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-dc79a049\"/\"e2e-lifecycle-model-dc79a049-kserve-self-signed-certs\""
Jul 17 19:18:20.479841 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.479754    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-dc79a049\"/\"kube-root-ca.crt\""
Jul 17 19:18:20.479841 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.479794    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-dc79a049\"/\"default-dockercfg-m2kmt\""
Jul 17 19:18:20.479841 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.479794    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-dc79a049\"/\"openshift-service-ca.crt\""
Jul 17 19:18:20.488441 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.488420    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"]
Jul 17 19:18:20.583594 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.583557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10750c3-c02b-4948-b679-0831e8cb0a73-tls-certs\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.583744 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.583604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-model-cache\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.583744 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.583670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-home\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.583835 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.583798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-tmp-dir\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.583879 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.583837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fr9c\" (UniqueName: \"kubernetes.io/projected/f10750c3-c02b-4948-b679-0831e8cb0a73-kube-api-access-7fr9c\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.583919 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.583889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-dshm\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.684646 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.684608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10750c3-c02b-4948-b679-0831e8cb0a73-tls-certs\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.684646 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.684643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-model-cache\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.684871 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.684666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-home\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.684871 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.684816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-tmp-dir\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.684871 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.684858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fr9c\" (UniqueName: \"kubernetes.io/projected/f10750c3-c02b-4948-b679-0831e8cb0a73-kube-api-access-7fr9c\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.684980 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.684910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-dshm\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.685096 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.685077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-model-cache\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.685164 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.685099    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-home\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.685164 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.685143    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-tmp-dir\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.687153 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.687130    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-dshm\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.687383 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.687365    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10750c3-c02b-4948-b679-0831e8cb0a73-tls-certs\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.694842 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.694808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fr9c\" (UniqueName: \"kubernetes.io/projected/f10750c3-c02b-4948-b679-0831e8cb0a73-kube-api-access-7fr9c\") pod \"e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") " pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.786050 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.785986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:20.935816 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:20.935794    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"]
Jul 17 19:18:20.938628 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:18:20.938598    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf10750c3_c02b_4948_b679_0831e8cb0a73.slice/crio-ad9faf262c8f8133814fcde6bacf598651d5d46172b0ab5b67edd4ca2cdf7bdc WatchSource:0}: Error finding container ad9faf262c8f8133814fcde6bacf598651d5d46172b0ab5b67edd4ca2cdf7bdc: Status 404 returned error can't find the container with id ad9faf262c8f8133814fcde6bacf598651d5d46172b0ab5b67edd4ca2cdf7bdc
Jul 17 19:18:21.777420 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:21.777387    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8" event={"ID":"f10750c3-c02b-4948-b679-0831e8cb0a73","Type":"ContainerStarted","Data":"9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7"}
Jul 17 19:18:21.777830 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:21.777429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8" event={"ID":"f10750c3-c02b-4948-b679-0831e8cb0a73","Type":"ContainerStarted","Data":"ad9faf262c8f8133814fcde6bacf598651d5d46172b0ab5b67edd4ca2cdf7bdc"}
Jul 17 19:18:21.797946 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:21.797890    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8" podStartSLOduration=1.797870508 podStartE2EDuration="1.797870508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:18:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:18:21.796621519 +0000 UTC m=+2021.790987533" watchObservedRunningTime="2026-07-17 19:18:21.797870508 +0000 UTC m=+2021.792236523"
Jul 17 19:18:30.786457 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:30.786420    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:30.786848 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:30.786471    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:30.799658 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:30.799636    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:18:30.832857 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:18:30.832836    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:19:27.529577 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:27.529542    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"]
Jul 17 19:19:42.550035 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.550002    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8" podUID="f10750c3-c02b-4948-b679-0831e8cb0a73" containerName="main" containerID="cri-o://9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7" gracePeriod=45
Jul 17 19:19:42.806842 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.806783    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:19:42.905577 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.905550    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10750c3-c02b-4948-b679-0831e8cb0a73-tls-certs\") pod \"f10750c3-c02b-4948-b679-0831e8cb0a73\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") "
Jul 17 19:19:42.905738 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.905592    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-tmp-dir\") pod \"f10750c3-c02b-4948-b679-0831e8cb0a73\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") "
Jul 17 19:19:42.905738 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.905657    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fr9c\" (UniqueName: \"kubernetes.io/projected/f10750c3-c02b-4948-b679-0831e8cb0a73-kube-api-access-7fr9c\") pod \"f10750c3-c02b-4948-b679-0831e8cb0a73\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") "
Jul 17 19:19:42.905738 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.905692    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-model-cache\") pod \"f10750c3-c02b-4948-b679-0831e8cb0a73\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") "
Jul 17 19:19:42.905738 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.905709    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-dshm\") pod \"f10750c3-c02b-4948-b679-0831e8cb0a73\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") "
Jul 17 19:19:42.905964 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.905744    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-home\") pod \"f10750c3-c02b-4948-b679-0831e8cb0a73\" (UID: \"f10750c3-c02b-4948-b679-0831e8cb0a73\") "
Jul 17 19:19:42.905964 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.905904    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f10750c3-c02b-4948-b679-0831e8cb0a73" (UID: "f10750c3-c02b-4948-b679-0831e8cb0a73"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:19:42.905964 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.905914    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-model-cache" (OuterVolumeSpecName: "model-cache") pod "f10750c3-c02b-4948-b679-0831e8cb0a73" (UID: "f10750c3-c02b-4948-b679-0831e8cb0a73"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:19:42.906109 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.906043    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-home" (OuterVolumeSpecName: "home") pod "f10750c3-c02b-4948-b679-0831e8cb0a73" (UID: "f10750c3-c02b-4948-b679-0831e8cb0a73"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:19:42.906109 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.906061    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-model-cache\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:19:42.906109 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.906076    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-tmp-dir\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:19:42.907898 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.907868    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f10750c3-c02b-4948-b679-0831e8cb0a73-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f10750c3-c02b-4948-b679-0831e8cb0a73" (UID: "f10750c3-c02b-4948-b679-0831e8cb0a73"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:19:42.907898 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.907892    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-dshm" (OuterVolumeSpecName: "dshm") pod "f10750c3-c02b-4948-b679-0831e8cb0a73" (UID: "f10750c3-c02b-4948-b679-0831e8cb0a73"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:19:42.908038 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:42.907945    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f10750c3-c02b-4948-b679-0831e8cb0a73-kube-api-access-7fr9c" (OuterVolumeSpecName: "kube-api-access-7fr9c") pod "f10750c3-c02b-4948-b679-0831e8cb0a73" (UID: "f10750c3-c02b-4948-b679-0831e8cb0a73"). InnerVolumeSpecName "kube-api-access-7fr9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:19:43.007387 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.007355    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fr9c\" (UniqueName: \"kubernetes.io/projected/f10750c3-c02b-4948-b679-0831e8cb0a73-kube-api-access-7fr9c\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:19:43.007387 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.007380    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-dshm\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:19:43.007387 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.007390    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f10750c3-c02b-4948-b679-0831e8cb0a73-home\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:19:43.007605 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.007398    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10750c3-c02b-4948-b679-0831e8cb0a73-tls-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:19:43.176055 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.176020    2581 generic.go:356] "Generic (PLEG): container finished" podID="f10750c3-c02b-4948-b679-0831e8cb0a73" containerID="9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7" exitCode=0
Jul 17 19:19:43.176224 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.176068    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"
Jul 17 19:19:43.176224 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.176105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8" event={"ID":"f10750c3-c02b-4948-b679-0831e8cb0a73","Type":"ContainerDied","Data":"9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7"}
Jul 17 19:19:43.176224 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.176146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8" event={"ID":"f10750c3-c02b-4948-b679-0831e8cb0a73","Type":"ContainerDied","Data":"ad9faf262c8f8133814fcde6bacf598651d5d46172b0ab5b67edd4ca2cdf7bdc"}
Jul 17 19:19:43.176224 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.176165    2581 scope.go:117] "RemoveContainer" containerID="9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7"
Jul 17 19:19:43.185486 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.185467    2581 scope.go:117] "RemoveContainer" containerID="9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7"
Jul 17 19:19:43.185760 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:19:43.185741    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7\": container with ID starting with 9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7 not found: ID does not exist" containerID="9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7"
Jul 17 19:19:43.185809 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.185770    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7"} err="failed to get container status \"9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7\": rpc error: code = NotFound desc = could not find container \"9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7\": container with ID starting with 9e81060da5dd602568a9aa0782830a255a87b923d20d5c8ff3b0c100b4cf34a7 not found: ID does not exist"
Jul 17 19:19:43.204583 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.204562    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"]
Jul 17 19:19:43.211314 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:43.211295    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-dc79a049/e2e-lifecycle-model-dc79a049-kserve-6fdd99bfff-mnjw8"]
Jul 17 19:19:44.492481 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:19:44.492437    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f10750c3-c02b-4948-b679-0831e8cb0a73" path="/var/lib/kubelet/pods/f10750c3-c02b-4948-b679-0831e8cb0a73/volumes"
Jul 17 19:20:11.227817 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:11.227781    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"]
Jul 17 19:20:11.228215 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:11.228000    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy" containerID="cri-o://3322f8c03598e61f26754857d831fac59c39f178e1cb247237ee1bfaed18f584" gracePeriod=30
Jul 17 19:20:16.348428 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.348394    2581 generic.go:356] "Generic (PLEG): container finished" podID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerID="3322f8c03598e61f26754857d831fac59c39f178e1cb247237ee1bfaed18f584" exitCode=0
Jul 17 19:20:16.348965 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.348449    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" event={"ID":"99a23a6d-85f9-46d5-a80a-0d1aae6416e8","Type":"ContainerDied","Data":"3322f8c03598e61f26754857d831fac59c39f178e1cb247237ee1bfaed18f584"}
Jul 17 19:20:16.348965 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.348499    2581 scope.go:117] "RemoveContainer" containerID="cb3c2d24799e3234b8695c239fa788c28d9f5bb08ca55c8b79af3205d159abc8"
Jul 17 19:20:16.489099 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.489033    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:20:16.599821 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.599787    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-socket\") pod \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") "
Jul 17 19:20:16.600000 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.599837    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncqwz\" (UniqueName: \"kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-kube-api-access-ncqwz\") pod \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") "
Jul 17 19:20:16.600000 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.599856    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-credential-socket\") pod \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") "
Jul 17 19:20:16.600000 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.599882    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istiod-ca-cert\") pod \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") "
Jul 17 19:20:16.600000 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.599902    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-token\") pod \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") "
Jul 17 19:20:16.600000 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.599929    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-podinfo\") pod \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") "
Jul 17 19:20:16.600000 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.599950    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-envoy\") pod \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") "
Jul 17 19:20:16.600000 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.599986    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-certs\") pod \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") "
Jul 17 19:20:16.600410 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.600041    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-data\") pod \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\" (UID: \"99a23a6d-85f9-46d5-a80a-0d1aae6416e8\") "
Jul 17 19:20:16.600410 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.600140    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99a23a6d-85f9-46d5-a80a-0d1aae6416e8" (UID: "99a23a6d-85f9-46d5-a80a-0d1aae6416e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:20:16.600410 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.600163    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99a23a6d-85f9-46d5-a80a-0d1aae6416e8" (UID: "99a23a6d-85f9-46d5-a80a-0d1aae6416e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:20:16.600410 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.600379    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99a23a6d-85f9-46d5-a80a-0d1aae6416e8" (UID: "99a23a6d-85f9-46d5-a80a-0d1aae6416e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:20:16.600410 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.600391    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:20:16.600410 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.600411    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:20:16.600701 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.600421    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99a23a6d-85f9-46d5-a80a-0d1aae6416e8" (UID: "99a23a6d-85f9-46d5-a80a-0d1aae6416e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:20:16.601375 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.601347    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "99a23a6d-85f9-46d5-a80a-0d1aae6416e8" (UID: "99a23a6d-85f9-46d5-a80a-0d1aae6416e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:20:16.602249 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.602224    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-kube-api-access-ncqwz" (OuterVolumeSpecName: "kube-api-access-ncqwz") pod "99a23a6d-85f9-46d5-a80a-0d1aae6416e8" (UID: "99a23a6d-85f9-46d5-a80a-0d1aae6416e8"). InnerVolumeSpecName "kube-api-access-ncqwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:20:16.602394 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.602358    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "99a23a6d-85f9-46d5-a80a-0d1aae6416e8" (UID: "99a23a6d-85f9-46d5-a80a-0d1aae6416e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:20:16.602504 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.602433    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99a23a6d-85f9-46d5-a80a-0d1aae6416e8" (UID: "99a23a6d-85f9-46d5-a80a-0d1aae6416e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:20:16.602693 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.602672    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99a23a6d-85f9-46d5-a80a-0d1aae6416e8" (UID: "99a23a6d-85f9-46d5-a80a-0d1aae6416e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:20:16.701406 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.701379    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncqwz\" (UniqueName: \"kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-kube-api-access-ncqwz\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:20:16.701406 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.701404    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:20:16.701406 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.701413    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:20:16.701623 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.701421    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:20:16.701623 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.701429    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:20:16.701623 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.701435    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:20:16.701623 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:16.701442    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99a23a6d-85f9-46d5-a80a-0d1aae6416e8-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:20:17.355529 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:17.355499    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"
Jul 17 19:20:17.355955 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:17.355505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2" event={"ID":"99a23a6d-85f9-46d5-a80a-0d1aae6416e8","Type":"ContainerDied","Data":"925d7668da2ccbb8d449f1687f5344e277b4b194c7722342c9fc64b3c11e5f77"}
Jul 17 19:20:17.355955 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:17.355634    2581 scope.go:117] "RemoveContainer" containerID="3322f8c03598e61f26754857d831fac59c39f178e1cb247237ee1bfaed18f584"
Jul 17 19:20:17.377368 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:17.377341    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"]
Jul 17 19:20:17.382010 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:17.381988    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dc79a049-openshift-default-5895ff58c9-x7fd2"]
Jul 17 19:20:18.486560 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:20:18.486515    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" path="/var/lib/kubelet/pods/99a23a6d-85f9-46d5-a80a-0d1aae6416e8/volumes"
Jul 17 19:21:07.737960 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.737926    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"]
Jul 17 19:21:07.738476 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.738461    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy"
Jul 17 19:21:07.738532 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.738480    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy"
Jul 17 19:21:07.738532 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.738497    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy"
Jul 17 19:21:07.738532 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.738505    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy"
Jul 17 19:21:07.738532 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.738513    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f10750c3-c02b-4948-b679-0831e8cb0a73" containerName="main"
Jul 17 19:21:07.738532 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.738523    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f10750c3-c02b-4948-b679-0831e8cb0a73" containerName="main"
Jul 17 19:21:07.738705 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.738626    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy"
Jul 17 19:21:07.738705 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.738637    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f10750c3-c02b-4948-b679-0831e8cb0a73" containerName="main"
Jul 17 19:21:07.742077 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.742055    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.744968 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.744948    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-26d0e5-openshift-default-dockercfg-q4lfg\""
Jul 17 19:21:07.756916 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.756896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"]
Jul 17 19:21:07.846278 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.846249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmvv5\" (UniqueName: \"kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-kube-api-access-pmvv5\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.846446 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.846287    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istiod-ca-cert\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.846446 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.846344    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-certs\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.846446 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.846359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-token\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.846446 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.846383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-socket\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.846446 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.846396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-data\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.846617 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.846445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-credential-socket\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.846617 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.846478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-envoy\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.846617 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.846536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-podinfo\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.947447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-credential-socket\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.947447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-envoy\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.947703 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-podinfo\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.947703 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmvv5\" (UniqueName: \"kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-kube-api-access-pmvv5\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.947703 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istiod-ca-cert\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.947703 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-certs\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.947703 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-token\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.948026 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-socket\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.948026 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-data\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.948026 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947845    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-credential-socket\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.948026 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.947981    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-certs\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.948289 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.948078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-data\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.948468 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.948441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-socket\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.948608 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.948584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istiod-ca-cert\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.950039 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.950017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-envoy\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.950213 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.950177    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-podinfo\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.957121 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.957099    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-token\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:07.957499 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:07.957479    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmvv5\" (UniqueName: \"kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-kube-api-access-pmvv5\") pod \"e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") " pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:08.052165 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:08.052081    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:08.190942 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:08.190819    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"]
Jul 17 19:21:08.193913 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:21:08.193869    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ebd0574_5ea0_45e6_8dcb_1e4a1a451ffd.slice/crio-2a5fd0d04bfa0388a38f13f77233dfc113b1f4719709d901960bac9de148a79c WatchSource:0}: Error finding container 2a5fd0d04bfa0388a38f13f77233dfc113b1f4719709d901960bac9de148a79c: Status 404 returned error can't find the container with id 2a5fd0d04bfa0388a38f13f77233dfc113b1f4719709d901960bac9de148a79c
Jul 17 19:21:08.195986 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:08.195942    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:08.196054 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:08.196041    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:08.196103 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:08.196086    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:08.607435 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:08.607402    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" event={"ID":"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd","Type":"ContainerStarted","Data":"996283ed00fd046b90138644a38fc4e20ba552c0a7fc4678b2223058a0c918dd"}
Jul 17 19:21:08.607603 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:08.607447    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" event={"ID":"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd","Type":"ContainerStarted","Data":"2a5fd0d04bfa0388a38f13f77233dfc113b1f4719709d901960bac9de148a79c"}
Jul 17 19:21:08.630696 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:08.630646    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" podStartSLOduration=1.630630851 podStartE2EDuration="1.630630851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:21:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:21:08.628529033 +0000 UTC m=+2188.622895047" watchObservedRunningTime="2026-07-17 19:21:08.630630851 +0000 UTC m=+2188.624996866"
Jul 17 19:21:09.053138 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:09.053106    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:09.058071 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:09.058048    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:09.612228 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:09.612172    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:09.613091 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:09.613066    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:15.682121 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.682086    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"]
Jul 17 19:21:15.683235 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.683193    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a23a6d-85f9-46d5-a80a-0d1aae6416e8" containerName="istio-proxy"
Jul 17 19:21:15.686673 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.686651    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.689274 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.689250    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-912ad7-openshift-default-dockercfg-6t2zb\""
Jul 17 19:21:15.697954 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.697930    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"]
Jul 17 19:21:15.820294 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.820265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-envoy\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.820485 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.820309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cdcd69c-8727-42ec-9971-d004c509b281-istio-podinfo\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.820485 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.820331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmfp7\" (UniqueName: \"kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-kube-api-access-lmfp7\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.820485 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.820401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-data\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.820664 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.820576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-socket\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.820664 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.820611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-credential-socket\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.820664 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.820638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-certs\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.820834 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.820680    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-istio-token\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.820834 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.820735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cdcd69c-8727-42ec-9971-d004c509b281-istiod-ca-cert\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.921956 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.921928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-envoy\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922134 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.921964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cdcd69c-8727-42ec-9971-d004c509b281-istio-podinfo\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922134 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.921979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmfp7\" (UniqueName: \"kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-kube-api-access-lmfp7\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922134 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.922000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-data\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922134 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.922072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-socket\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922372 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.922223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-credential-socket\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922372 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.922269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-certs\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922372 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.922298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-istio-token\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922372 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.922345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cdcd69c-8727-42ec-9971-d004c509b281-istiod-ca-cert\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922587 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.922442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-data\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922786 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.922765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-credential-socket\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922885 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.922795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-socket\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.922970 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.922949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-certs\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.923357 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.923340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cdcd69c-8727-42ec-9971-d004c509b281-istiod-ca-cert\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.924366 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.924348    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-envoy\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.924666 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.924650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cdcd69c-8727-42ec-9971-d004c509b281-istio-podinfo\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.931039 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.931008    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmfp7\" (UniqueName: \"kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-kube-api-access-lmfp7\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.931604 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.931573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-istio-token\") pod \"e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") " pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:15.999948 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:15.999890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:16.144075 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:16.144051    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"]
Jul 17 19:21:16.146266 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:21:16.146237    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cdcd69c_8727_42ec_9971_d004c509b281.slice/crio-591d5d13692ad39602443a0c7b507646f5ecdbc903f274d76eb73050c817a75f WatchSource:0}: Error finding container 591d5d13692ad39602443a0c7b507646f5ecdbc903f274d76eb73050c817a75f: Status 404 returned error can't find the container with id 591d5d13692ad39602443a0c7b507646f5ecdbc903f274d76eb73050c817a75f
Jul 17 19:21:16.148526 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:16.148491    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:16.148637 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:16.148573    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:16.148637 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:16.148618    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:16.650522 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:16.650485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" event={"ID":"1cdcd69c-8727-42ec-9971-d004c509b281","Type":"ContainerStarted","Data":"7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be"}
Jul 17 19:21:16.650693 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:16.650540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" event={"ID":"1cdcd69c-8727-42ec-9971-d004c509b281","Type":"ContainerStarted","Data":"591d5d13692ad39602443a0c7b507646f5ecdbc903f274d76eb73050c817a75f"}
Jul 17 19:21:16.675636 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:16.675580    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" podStartSLOduration=1.675562021 podStartE2EDuration="1.675562021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:21:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:21:16.672961648 +0000 UTC m=+2196.667327654" watchObservedRunningTime="2026-07-17 19:21:16.675562021 +0000 UTC m=+2196.669928036"
Jul 17 19:21:17.000519 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:17.000443    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:17.006343 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:17.006318    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:17.655054 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:17.655024    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:17.656164 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:17.656145    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:24.660976 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:24.660358    2581 patch_prober.go:28] interesting pod/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:43838->10.133.0.55:15021: read: connection reset by peer" start-of-body=
Jul 17 19:21:24.660976 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:24.660422    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:43838->10.133.0.55:15021: read: connection reset by peer"
Jul 17 19:21:24.714823 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:24.714786    2581 generic.go:356] "Generic (PLEG): container finished" podID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerID="996283ed00fd046b90138644a38fc4e20ba552c0a7fc4678b2223058a0c918dd" exitCode=0
Jul 17 19:21:24.714997 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:24.714860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" event={"ID":"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd","Type":"ContainerDied","Data":"996283ed00fd046b90138644a38fc4e20ba552c0a7fc4678b2223058a0c918dd"}
Jul 17 19:21:24.715290 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:24.715275    2581 scope.go:117] "RemoveContainer" containerID="996283ed00fd046b90138644a38fc4e20ba552c0a7fc4678b2223058a0c918dd"
Jul 17 19:21:24.716319 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:24.716285    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:24.716447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:24.716355    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:24.716447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:24.716402    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:25.724605 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:25.724562    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" event={"ID":"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd","Type":"ContainerStarted","Data":"43a1eaa72f89e971168a609e64cf4dcc1ca44dc89433a02e7f91a018f0820ee7"}
Jul 17 19:21:26.052596 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.052508    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:26.052753 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.052609    2581 patch_prober.go:28] interesting pod/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 17 19:21:26.052753 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.052656    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 17 19:21:26.458932 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.458900    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"]
Jul 17 19:21:26.463271 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.463250    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.465950 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.465928    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-26d0e5\"/\"kube-root-ca.crt\""
Jul 17 19:21:26.466171 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.465956    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-26d0e5\"/\"openshift-service-ca.crt\""
Jul 17 19:21:26.466299 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.466037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-26d0e5\"/\"default-dockercfg-prxt6\""
Jul 17 19:21:26.466958 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.466942    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-26d0e5\"/\"test-model-26d0e5-kserve-self-signed-certs\""
Jul 17 19:21:26.471331 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.471262    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"]
Jul 17 19:21:26.534686 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.534644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-home\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.535263 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.534932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-dshm\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.535263 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.534982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-tmp-dir\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.535263 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.535020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-model-cache\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.535263 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.535049    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/652a8586-99ef-4508-86b3-628e440f624c-tls-certs\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.535263 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.535094    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m7cc\" (UniqueName: \"kubernetes.io/projected/652a8586-99ef-4508-86b3-628e440f624c-kube-api-access-7m7cc\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.636482 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.636445    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-home\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.636655 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.636490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-dshm\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.636655 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.636519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-tmp-dir\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.636655 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.636552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-model-cache\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.636655 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.636581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/652a8586-99ef-4508-86b3-628e440f624c-tls-certs\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.636655 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.636622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m7cc\" (UniqueName: \"kubernetes.io/projected/652a8586-99ef-4508-86b3-628e440f624c-kube-api-access-7m7cc\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.637455 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.637416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-home\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.637632 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.637608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-tmp-dir\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.637863 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.637502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-model-cache\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.640076 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.640054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/652a8586-99ef-4508-86b3-628e440f624c-tls-certs\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.640289 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.640271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-dshm\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.645919 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.645898    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m7cc\" (UniqueName: \"kubernetes.io/projected/652a8586-99ef-4508-86b3-628e440f624c-kube-api-access-7m7cc\") pod \"test-model-26d0e5-kserve-c84cb687c-gjqhq\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") " pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.775067 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.774988    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:26.977175 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:26.977151    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"]
Jul 17 19:21:26.979137 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:21:26.979105    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod652a8586_99ef_4508_86b3_628e440f624c.slice/crio-ea5fddf10875d5581c315027655c8cd1370a6d54846afcad5fba4ba384e29f63 WatchSource:0}: Error finding container ea5fddf10875d5581c315027655c8cd1370a6d54846afcad5fba4ba384e29f63: Status 404 returned error can't find the container with id ea5fddf10875d5581c315027655c8cd1370a6d54846afcad5fba4ba384e29f63
Jul 17 19:21:27.052725 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:27.052691    2581 patch_prober.go:28] interesting pod/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 17 19:21:27.052922 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:27.052752    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 17 19:21:27.735647 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:27.735605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq" event={"ID":"652a8586-99ef-4508-86b3-628e440f624c","Type":"ContainerStarted","Data":"72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969"}
Jul 17 19:21:27.735815 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:27.735656    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq" event={"ID":"652a8586-99ef-4508-86b3-628e440f624c","Type":"ContainerStarted","Data":"ea5fddf10875d5581c315027655c8cd1370a6d54846afcad5fba4ba384e29f63"}
Jul 17 19:21:27.754872 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:27.754814    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq" podStartSLOduration=1.754792793 podStartE2EDuration="1.754792793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:21:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:21:27.754620269 +0000 UTC m=+2207.748986284" watchObservedRunningTime="2026-07-17 19:21:27.754792793 +0000 UTC m=+2207.749158823"
Jul 17 19:21:28.052963 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:28.052873    2581 patch_prober.go:28] interesting pod/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 17 19:21:28.052963 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:28.052942    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 17 19:21:29.053259 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:29.053217    2581 patch_prober.go:28] interesting pod/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 17 19:21:29.053623 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:29.053293    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 17 19:21:30.055875 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:30.055850    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:30.056277 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:30.056228    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:30.056832 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:30.056815    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:21:30.751649 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:30.751614    2581 generic.go:356] "Generic (PLEG): container finished" podID="1cdcd69c-8727-42ec-9971-d004c509b281" containerID="7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be" exitCode=0
Jul 17 19:21:30.751820 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:30.751687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" event={"ID":"1cdcd69c-8727-42ec-9971-d004c509b281","Type":"ContainerDied","Data":"7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be"}
Jul 17 19:21:30.752183 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:30.752167    2581 scope.go:117] "RemoveContainer" containerID="7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be"
Jul 17 19:21:30.753114 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:30.753089    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:30.753226 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:30.753149    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:30.753226 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:30.753181    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:21:31.758481 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:31.758446    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" event={"ID":"1cdcd69c-8727-42ec-9971-d004c509b281","Type":"ContainerStarted","Data":"f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48"}
Jul 17 19:21:32.000386 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:32.000339    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:32.001373 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:32.001338    2581 patch_prober.go:28] interesting pod/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 17 19:21:32.001538 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:32.001399    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 17 19:21:32.654960 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:32.654930    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:33.002129 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:33.002022    2581 patch_prober.go:28] interesting pod/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 17 19:21:33.002129 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:33.002109    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 17 19:21:34.001376 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:34.001335    2581 patch_prober.go:28] interesting pod/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 17 19:21:34.001695 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:34.001661    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 17 19:21:35.001170 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:35.001132    2581 patch_prober.go:28] interesting pod/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 17 19:21:35.001809 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:35.001777    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 17 19:21:36.004696 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:36.004662    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:36.005968 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:36.005947    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:21:36.775647 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:36.775619    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:36.775932 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:36.775803    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:36.788630 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:36.788605    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:21:37.797475 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:21:37.797449    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:22:27.079281 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:27.079246    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"]
Jul 17 19:22:42.099690 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.099622    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq" podUID="652a8586-99ef-4508-86b3-628e440f624c" containerName="main" containerID="cri-o://72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969" gracePeriod=45
Jul 17 19:22:42.356646 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.356588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:22:42.428398 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428371    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-model-cache\") pod \"652a8586-99ef-4508-86b3-628e440f624c\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") "
Jul 17 19:22:42.428540 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428406    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-dshm\") pod \"652a8586-99ef-4508-86b3-628e440f624c\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") "
Jul 17 19:22:42.428540 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428448    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-home\") pod \"652a8586-99ef-4508-86b3-628e440f624c\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") "
Jul 17 19:22:42.428540 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428470    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-tmp-dir\") pod \"652a8586-99ef-4508-86b3-628e440f624c\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") "
Jul 17 19:22:42.428713 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428546    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m7cc\" (UniqueName: \"kubernetes.io/projected/652a8586-99ef-4508-86b3-628e440f624c-kube-api-access-7m7cc\") pod \"652a8586-99ef-4508-86b3-628e440f624c\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") "
Jul 17 19:22:42.428713 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428610    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/652a8586-99ef-4508-86b3-628e440f624c-tls-certs\") pod \"652a8586-99ef-4508-86b3-628e440f624c\" (UID: \"652a8586-99ef-4508-86b3-628e440f624c\") "
Jul 17 19:22:42.428713 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428630    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-model-cache" (OuterVolumeSpecName: "model-cache") pod "652a8586-99ef-4508-86b3-628e440f624c" (UID: "652a8586-99ef-4508-86b3-628e440f624c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:22:42.428713 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428697    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-home" (OuterVolumeSpecName: "home") pod "652a8586-99ef-4508-86b3-628e440f624c" (UID: "652a8586-99ef-4508-86b3-628e440f624c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:22:42.428916 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428784    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "652a8586-99ef-4508-86b3-628e440f624c" (UID: "652a8586-99ef-4508-86b3-628e440f624c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:22:42.428991 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428972    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-model-cache\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:42.429043 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.428998    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-home\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:42.429043 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.429012    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-tmp-dir\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:42.430765 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.430743    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-dshm" (OuterVolumeSpecName: "dshm") pod "652a8586-99ef-4508-86b3-628e440f624c" (UID: "652a8586-99ef-4508-86b3-628e440f624c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:22:42.430873 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.430824    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/652a8586-99ef-4508-86b3-628e440f624c-kube-api-access-7m7cc" (OuterVolumeSpecName: "kube-api-access-7m7cc") pod "652a8586-99ef-4508-86b3-628e440f624c" (UID: "652a8586-99ef-4508-86b3-628e440f624c"). InnerVolumeSpecName "kube-api-access-7m7cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:22:42.430873 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.430830    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/652a8586-99ef-4508-86b3-628e440f624c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "652a8586-99ef-4508-86b3-628e440f624c" (UID: "652a8586-99ef-4508-86b3-628e440f624c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:22:42.529855 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.529829    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m7cc\" (UniqueName: \"kubernetes.io/projected/652a8586-99ef-4508-86b3-628e440f624c-kube-api-access-7m7cc\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:42.529855 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.529854    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/652a8586-99ef-4508-86b3-628e440f624c-tls-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:42.530006 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:42.529865    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/652a8586-99ef-4508-86b3-628e440f624c-dshm\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:43.120616 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:43.120581    2581 generic.go:356] "Generic (PLEG): container finished" podID="652a8586-99ef-4508-86b3-628e440f624c" containerID="72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969" exitCode=0
Jul 17 19:22:43.121024 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:43.120624    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"
Jul 17 19:22:43.121024 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:43.120654    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq" event={"ID":"652a8586-99ef-4508-86b3-628e440f624c","Type":"ContainerDied","Data":"72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969"}
Jul 17 19:22:43.121024 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:43.120690    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq" event={"ID":"652a8586-99ef-4508-86b3-628e440f624c","Type":"ContainerDied","Data":"ea5fddf10875d5581c315027655c8cd1370a6d54846afcad5fba4ba384e29f63"}
Jul 17 19:22:43.121024 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:43.120709    2581 scope.go:117] "RemoveContainer" containerID="72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969"
Jul 17 19:22:43.129336 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:43.129306    2581 scope.go:117] "RemoveContainer" containerID="72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969"
Jul 17 19:22:43.129576 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:22:43.129556    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969\": container with ID starting with 72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969 not found: ID does not exist" containerID="72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969"
Jul 17 19:22:43.129642 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:43.129586    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969"} err="failed to get container status \"72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969\": rpc error: code = NotFound desc = could not find container \"72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969\": container with ID starting with 72533176ce6287e254e1644bf24e23960b5fe7091a9ade1a590235f4707d7969 not found: ID does not exist"
Jul 17 19:22:43.141763 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:43.141739    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"]
Jul 17 19:22:43.145930 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:43.145911    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-26d0e5/test-model-26d0e5-kserve-c84cb687c-gjqhq"]
Jul 17 19:22:44.487929 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:44.487886    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="652a8586-99ef-4508-86b3-628e440f624c" path="/var/lib/kubelet/pods/652a8586-99ef-4508-86b3-628e440f624c/volumes"
Jul 17 19:22:50.025367 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:50.025332    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"]
Jul 17 19:22:50.025914 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:50.025599    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy" containerID="cri-o://43a1eaa72f89e971168a609e64cf4dcc1ca44dc89433a02e7f91a018f0820ee7" gracePeriod=30
Jul 17 19:22:55.181366 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.181330    2581 generic.go:356] "Generic (PLEG): container finished" podID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerID="43a1eaa72f89e971168a609e64cf4dcc1ca44dc89433a02e7f91a018f0820ee7" exitCode=0
Jul 17 19:22:55.181846 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.181401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" event={"ID":"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd","Type":"ContainerDied","Data":"43a1eaa72f89e971168a609e64cf4dcc1ca44dc89433a02e7f91a018f0820ee7"}
Jul 17 19:22:55.181846 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.181476    2581 scope.go:117] "RemoveContainer" containerID="996283ed00fd046b90138644a38fc4e20ba552c0a7fc4678b2223058a0c918dd"
Jul 17 19:22:55.292732 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.292669    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:22:55.351610 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.351579    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmvv5\" (UniqueName: \"kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-kube-api-access-pmvv5\") pod \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") "
Jul 17 19:22:55.351610 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.351615    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-podinfo\") pod \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") "
Jul 17 19:22:55.351830 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.351644    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-envoy\") pod \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") "
Jul 17 19:22:55.351830 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.351682    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-token\") pod \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") "
Jul 17 19:22:55.351830 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.351729    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-credential-socket\") pod \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") "
Jul 17 19:22:55.352018 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.351862    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-socket\") pod \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") "
Jul 17 19:22:55.352018 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.351982    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-certs\") pod \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") "
Jul 17 19:22:55.352018 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.352009    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" (UID: "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:22:55.352173 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.352055    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istiod-ca-cert\") pod \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") "
Jul 17 19:22:55.352173 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.352087    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" (UID: "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:22:55.352173 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.352112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-data\") pod \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\" (UID: \"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd\") "
Jul 17 19:22:55.352372 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.352259    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" (UID: "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:22:55.352510 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.352455    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" (UID: "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:22:55.352647 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.352628    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:55.352686 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.352654    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:55.352686 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.352667    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:55.352686 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.352682    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:55.353139 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.353118    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" (UID: "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:22:55.354067 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.354034    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" (UID: "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:22:55.354188 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.354169    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-kube-api-access-pmvv5" (OuterVolumeSpecName: "kube-api-access-pmvv5") pod "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" (UID: "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd"). InnerVolumeSpecName "kube-api-access-pmvv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:22:55.354607 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.354577    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" (UID: "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:22:55.354607 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.354586    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" (UID: "9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:22:55.453341 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.453313    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:55.453341 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.453339    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmvv5\" (UniqueName: \"kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-kube-api-access-pmvv5\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:55.453503 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.453354    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:55.453503 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.453366    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:55.453503 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:55.453376    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:22:56.187719 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:56.187684    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl" event={"ID":"9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd","Type":"ContainerDied","Data":"2a5fd0d04bfa0388a38f13f77233dfc113b1f4719709d901960bac9de148a79c"}
Jul 17 19:22:56.187719 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:56.187701    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"
Jul 17 19:22:56.188251 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:56.187740    2581 scope.go:117] "RemoveContainer" containerID="43a1eaa72f89e971168a609e64cf4dcc1ca44dc89433a02e7f91a018f0820ee7"
Jul 17 19:22:56.211044 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:56.211018    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"]
Jul 17 19:22:56.213585 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:56.213566    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-26d0e5-openshift-default-88b8fcfbf-86pnl"]
Jul 17 19:22:56.487692 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:22:56.487604    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" path="/var/lib/kubelet/pods/9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd/volumes"
Jul 17 19:23:12.367837 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:12.367805    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"]
Jul 17 19:23:12.368463 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:12.368146    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy" containerID="cri-o://f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48" gracePeriod=30
Jul 17 19:23:13.270505 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.270470    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"]
Jul 17 19:23:13.271124 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.271103    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy"
Jul 17 19:23:13.271124 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.271123    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy"
Jul 17 19:23:13.271304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.271134    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy"
Jul 17 19:23:13.271304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.271143    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy"
Jul 17 19:23:13.271304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.271157    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652a8586-99ef-4508-86b3-628e440f624c" containerName="main"
Jul 17 19:23:13.271304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.271162    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="652a8586-99ef-4508-86b3-628e440f624c" containerName="main"
Jul 17 19:23:13.271304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.271251    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy"
Jul 17 19:23:13.271304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.271261    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ebd0574-5ea0-45e6-8dcb-1e4a1a451ffd" containerName="istio-proxy"
Jul 17 19:23:13.271304 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.271266    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="652a8586-99ef-4508-86b3-628e440f624c" containerName="main"
Jul 17 19:23:13.275787 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.275771    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.278535 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.278512    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-55c341-openshift-default-dockercfg-md29c\""
Jul 17 19:23:13.288332 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.288307    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"]
Jul 17 19:23:13.321484 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.321458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-envoy\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.321484 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.321486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-data\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.321671 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.321501    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-token\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.321671 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.321624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-certs\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.321671 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.321658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5d559a-3992-481c-b2af-a21ecbac85d4-istiod-ca-cert\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.321795 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.321723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-podinfo\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.321795 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.321775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mckg4\" (UniqueName: \"kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-kube-api-access-mckg4\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.321795 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.321793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-socket\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.321909 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.321833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-credential-socket\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.422388 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mckg4\" (UniqueName: \"kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-kube-api-access-mckg4\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.422862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-socket\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.422862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-credential-socket\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.422862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-envoy\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.422862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-data\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.422862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-token\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.422862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-certs\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.422862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5d559a-3992-481c-b2af-a21ecbac85d4-istiod-ca-cert\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.422862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-socket\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.422862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-podinfo\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.423346 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.422864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-credential-socket\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.423346 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.423054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-data\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.423346 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.423115    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-certs\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.423520 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.423500    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5d559a-3992-481c-b2af-a21ecbac85d4-istiod-ca-cert\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.424996 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.424973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-envoy\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.425621 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.425598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-podinfo\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.431439 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.431417    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-token\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.431699 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.431680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mckg4\" (UniqueName: \"kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-kube-api-access-mckg4\") pod \"e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") " pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.586842 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.586756    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:13.736065 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.736035    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"]
Jul 17 19:23:13.738679 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:23:13.738647    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5d559a_3992_481c_b2af_a21ecbac85d4.slice/crio-0db19fd58a8842c9f6ad1a16ba10a20e47bc2d9fc5b1d6ff7cbdb0eaa0b115e3 WatchSource:0}: Error finding container 0db19fd58a8842c9f6ad1a16ba10a20e47bc2d9fc5b1d6ff7cbdb0eaa0b115e3: Status 404 returned error can't find the container with id 0db19fd58a8842c9f6ad1a16ba10a20e47bc2d9fc5b1d6ff7cbdb0eaa0b115e3
Jul 17 19:23:13.740749 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.740714    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:13.740839 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.740788    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:13.740839 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:13.740817    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:14.279009 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:14.278963    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" event={"ID":"1d5d559a-3992-481c-b2af-a21ecbac85d4","Type":"ContainerStarted","Data":"f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd"}
Jul 17 19:23:14.279220 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:14.279026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" event={"ID":"1d5d559a-3992-481c-b2af-a21ecbac85d4","Type":"ContainerStarted","Data":"0db19fd58a8842c9f6ad1a16ba10a20e47bc2d9fc5b1d6ff7cbdb0eaa0b115e3"}
Jul 17 19:23:14.302646 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:14.302598    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" podStartSLOduration=1.302583373 podStartE2EDuration="1.302583373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:23:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:23:14.300572076 +0000 UTC m=+2314.294938091" watchObservedRunningTime="2026-07-17 19:23:14.302583373 +0000 UTC m=+2314.296949388"
Jul 17 19:23:14.587922 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:14.587830    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:14.592331 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:14.592308    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:15.284496 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:15.284463    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:15.285367 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:15.285348    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:17.623964 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.623942    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:23:17.764842 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.764815    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-credential-socket\") pod \"1cdcd69c-8727-42ec-9971-d004c509b281\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") "
Jul 17 19:23:17.765112 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.764859    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-certs\") pod \"1cdcd69c-8727-42ec-9971-d004c509b281\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") "
Jul 17 19:23:17.765112 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.764884    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-envoy\") pod \"1cdcd69c-8727-42ec-9971-d004c509b281\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") "
Jul 17 19:23:17.765112 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.764910    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-socket\") pod \"1cdcd69c-8727-42ec-9971-d004c509b281\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") "
Jul 17 19:23:17.765112 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.764968    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmfp7\" (UniqueName: \"kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-kube-api-access-lmfp7\") pod \"1cdcd69c-8727-42ec-9971-d004c509b281\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") "
Jul 17 19:23:17.765112 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.764991    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-data\") pod \"1cdcd69c-8727-42ec-9971-d004c509b281\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") "
Jul 17 19:23:17.765112 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765030    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-istio-token\") pod \"1cdcd69c-8727-42ec-9971-d004c509b281\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") "
Jul 17 19:23:17.765112 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765064    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cdcd69c-8727-42ec-9971-d004c509b281-istio-podinfo\") pod \"1cdcd69c-8727-42ec-9971-d004c509b281\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") "
Jul 17 19:23:17.765638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765097    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1cdcd69c-8727-42ec-9971-d004c509b281" (UID: "1cdcd69c-8727-42ec-9971-d004c509b281"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:23:17.765638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765107    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cdcd69c-8727-42ec-9971-d004c509b281-istiod-ca-cert\") pod \"1cdcd69c-8727-42ec-9971-d004c509b281\" (UID: \"1cdcd69c-8727-42ec-9971-d004c509b281\") "
Jul 17 19:23:17.765638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765164    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1cdcd69c-8727-42ec-9971-d004c509b281" (UID: "1cdcd69c-8727-42ec-9971-d004c509b281"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:23:17.765638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765317    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1cdcd69c-8727-42ec-9971-d004c509b281" (UID: "1cdcd69c-8727-42ec-9971-d004c509b281"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:23:17.765638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765481    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:23:17.765638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765503    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:23:17.765638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765526    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:23:17.765638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765538    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cdcd69c-8727-42ec-9971-d004c509b281-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1cdcd69c-8727-42ec-9971-d004c509b281" (UID: "1cdcd69c-8727-42ec-9971-d004c509b281"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:23:17.766250 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.765911    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-data" (OuterVolumeSpecName: "istio-data") pod "1cdcd69c-8727-42ec-9971-d004c509b281" (UID: "1cdcd69c-8727-42ec-9971-d004c509b281"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:23:17.767458 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.767433    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-kube-api-access-lmfp7" (OuterVolumeSpecName: "kube-api-access-lmfp7") pod "1cdcd69c-8727-42ec-9971-d004c509b281" (UID: "1cdcd69c-8727-42ec-9971-d004c509b281"). InnerVolumeSpecName "kube-api-access-lmfp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:23:17.767631 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.767609    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-istio-token" (OuterVolumeSpecName: "istio-token") pod "1cdcd69c-8727-42ec-9971-d004c509b281" (UID: "1cdcd69c-8727-42ec-9971-d004c509b281"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:23:17.767841 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.767820    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1cdcd69c-8727-42ec-9971-d004c509b281" (UID: "1cdcd69c-8727-42ec-9971-d004c509b281"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:23:17.767950 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.767860    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1cdcd69c-8727-42ec-9971-d004c509b281-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1cdcd69c-8727-42ec-9971-d004c509b281" (UID: "1cdcd69c-8727-42ec-9971-d004c509b281"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:23:17.866923 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.866892    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:23:17.866923 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.866918    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cdcd69c-8727-42ec-9971-d004c509b281-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:23:17.866923 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.866929    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cdcd69c-8727-42ec-9971-d004c509b281-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:23:17.867150 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.866939    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:23:17.867150 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.866947    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmfp7\" (UniqueName: \"kubernetes.io/projected/1cdcd69c-8727-42ec-9971-d004c509b281-kube-api-access-lmfp7\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:23:17.867150 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:17.866955    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cdcd69c-8727-42ec-9971-d004c509b281-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:23:18.301375 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.301341    2581 generic.go:356] "Generic (PLEG): container finished" podID="1cdcd69c-8727-42ec-9971-d004c509b281" containerID="f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48" exitCode=0
Jul 17 19:23:18.301566 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.301398    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"
Jul 17 19:23:18.301566 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.301427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" event={"ID":"1cdcd69c-8727-42ec-9971-d004c509b281","Type":"ContainerDied","Data":"f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48"}
Jul 17 19:23:18.301566 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.301523    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t" event={"ID":"1cdcd69c-8727-42ec-9971-d004c509b281","Type":"ContainerDied","Data":"591d5d13692ad39602443a0c7b507646f5ecdbc903f274d76eb73050c817a75f"}
Jul 17 19:23:18.301566 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.301555    2581 scope.go:117] "RemoveContainer" containerID="f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48"
Jul 17 19:23:18.311472 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.311456    2581 scope.go:117] "RemoveContainer" containerID="7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be"
Jul 17 19:23:18.321395 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.321369    2581 scope.go:117] "RemoveContainer" containerID="f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48"
Jul 17 19:23:18.321626 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:23:18.321610    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48\": container with ID starting with f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48 not found: ID does not exist" containerID="f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48"
Jul 17 19:23:18.321678 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.321634    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48"} err="failed to get container status \"f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48\": rpc error: code = NotFound desc = could not find container \"f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48\": container with ID starting with f9551149c25778056fa023f7c90868caac1415fcc0002b96e2f3fda9c6caaf48 not found: ID does not exist"
Jul 17 19:23:18.321678 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.321649    2581 scope.go:117] "RemoveContainer" containerID="7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be"
Jul 17 19:23:18.321868 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:23:18.321845    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be\": container with ID starting with 7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be not found: ID does not exist" containerID="7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be"
Jul 17 19:23:18.321911 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.321865    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be"} err="failed to get container status \"7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be\": rpc error: code = NotFound desc = could not find container \"7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be\": container with ID starting with 7eb9553c852df8b754215f4d4c11953dde91c5e002b564d4c1ce67e18c1585be not found: ID does not exist"
Jul 17 19:23:18.336296 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.336270    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"]
Jul 17 19:23:18.352573 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.352544    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-912ad7-openshift-default-6bc848744c-9sh8t"]
Jul 17 19:23:18.487380 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:18.487344    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" path="/var/lib/kubelet/pods/1cdcd69c-8727-42ec-9971-d004c509b281/volumes"
Jul 17 19:23:21.692458 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.692428    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"]
Jul 17 19:23:21.692816 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.692797    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy"
Jul 17 19:23:21.692816 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.692808    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy"
Jul 17 19:23:21.692889 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.692823    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy"
Jul 17 19:23:21.692889 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.692828    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy"
Jul 17 19:23:21.692956 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.692891    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy"
Jul 17 19:23:21.696093 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.696072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.698916 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.698900    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8fe1d7-openshift-default-dockercfg-2rdmb\""
Jul 17 19:23:21.716133 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.716111    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"]
Jul 17 19:23:21.804141 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.804109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istiod-ca-cert\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.804313 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.804156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-envoy\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.804313 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.804190    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-socket\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.804313 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.804236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-credential-socket\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.804313 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.804267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw6kc\" (UniqueName: \"kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-kube-api-access-kw6kc\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.804453 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.804324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-data\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.804453 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.804385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-token\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.804453 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.804409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-certs\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.804453 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.804436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-podinfo\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.905433 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.905399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-token\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.905626 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.905439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-certs\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.905626 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.905470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-podinfo\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.905626 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.905510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istiod-ca-cert\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.905626 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.905568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-envoy\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.905626 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.905614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-socket\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.905892 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.905638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-credential-socket\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.905892 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.905689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6kc\" (UniqueName: \"kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-kube-api-access-kw6kc\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.905892 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.905716    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-data\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.906025 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.905901    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-certs\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.906025 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.906007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-socket\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.906241 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.906192    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-credential-socket\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.906340 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.906254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-data\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.906340 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.906263    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istiod-ca-cert\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.907974 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.907958    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-envoy\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.908088 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.908069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-podinfo\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.917363 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.917335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw6kc\" (UniqueName: \"kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-kube-api-access-kw6kc\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:21.918306 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:21.918286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-token\") pod \"e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") " pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:22.008522 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:22.008428    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:22.165159 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:22.165128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"]
Jul 17 19:23:22.166576 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:23:22.166548    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3c90ae_7642_43fe_b10e_1ffba32cb5e8.slice/crio-449e361a1ae904e9325fce32752f435619e6ec2128e278439247f245e3c1b2ec WatchSource:0}: Error finding container 449e361a1ae904e9325fce32752f435619e6ec2128e278439247f245e3c1b2ec: Status 404 returned error can't find the container with id 449e361a1ae904e9325fce32752f435619e6ec2128e278439247f245e3c1b2ec
Jul 17 19:23:22.168813 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:22.168781    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:22.168899 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:22.168843    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:22.168899 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:22.168869    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:22.324149 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:22.324055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" event={"ID":"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8","Type":"ContainerStarted","Data":"0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a"}
Jul 17 19:23:22.324149 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:22.324126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" event={"ID":"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8","Type":"ContainerStarted","Data":"449e361a1ae904e9325fce32752f435619e6ec2128e278439247f245e3c1b2ec"}
Jul 17 19:23:22.348168 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:22.348116    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" podStartSLOduration=1.348099797 podStartE2EDuration="1.348099797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:23:22.347268249 +0000 UTC m=+2322.341634264" watchObservedRunningTime="2026-07-17 19:23:22.348099797 +0000 UTC m=+2322.342465812"
Jul 17 19:23:23.009024 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:23.008965    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:23.014803 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:23.014774    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:23.330028 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:23.329949    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:23.330915 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:23.330899    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:30.285792 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:30.285752    2581 patch_prober.go:28] interesting pod/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 17 19:23:30.286246 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:30.285809    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 17 19:23:30.366623 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:30.366588    2581 generic.go:356] "Generic (PLEG): container finished" podID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerID="f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd" exitCode=0
Jul 17 19:23:30.366774 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:30.366659    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" event={"ID":"1d5d559a-3992-481c-b2af-a21ecbac85d4","Type":"ContainerDied","Data":"f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd"}
Jul 17 19:23:30.367056 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:30.367040    2581 scope.go:117] "RemoveContainer" containerID="f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd"
Jul 17 19:23:30.368079 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:30.368053    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:30.368140 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:30.368118    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:30.368181 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:30.368150    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:31.374071 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:31.373995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" event={"ID":"1d5d559a-3992-481c-b2af-a21ecbac85d4","Type":"ContainerStarted","Data":"c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1"}
Jul 17 19:23:31.587730 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:31.587689    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:31.587941 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:31.587738    2581 patch_prober.go:28] interesting pod/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 17 19:23:31.587941 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:31.587824    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 17 19:23:32.594225 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:32.587676    2581 patch_prober.go:28] interesting pod/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 17 19:23:32.594225 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:32.587747    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 17 19:23:33.587941 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:33.587904    2581 patch_prober.go:28] interesting pod/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 17 19:23:33.588247 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:33.588192    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 17 19:23:34.587409 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:34.587370    2581 patch_prober.go:28] interesting pod/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 17 19:23:34.587905 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:34.587442    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 17 19:23:35.601339 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:35.601304    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:35.602154 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:35.602131    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:35.605452 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:35.605422    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:23:39.371354 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:39.371314    2581 patch_prober.go:28] interesting pod/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 19:23:39.371755 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:39.371379    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 19:23:40.430524 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:40.430489    2581 generic.go:356] "Generic (PLEG): container finished" podID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerID="0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a" exitCode=0
Jul 17 19:23:40.430921 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:40.430575    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" event={"ID":"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8","Type":"ContainerDied","Data":"0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a"}
Jul 17 19:23:40.431044 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:40.431019    2581 scope.go:117] "RemoveContainer" containerID="0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a"
Jul 17 19:23:40.432017 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:40.431990    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:40.432078 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:40.432063    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:40.432120 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:40.432100    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:23:41.438269 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:41.438234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" event={"ID":"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8","Type":"ContainerStarted","Data":"91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04"}
Jul 17 19:23:42.008675 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:42.008639    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:42.008889 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:42.008861    2581 patch_prober.go:28] interesting pod/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 17 19:23:42.008950 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:42.008926    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 17 19:23:43.008859 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:43.008818    2581 patch_prober.go:28] interesting pod/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 17 19:23:43.009309 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:43.008880    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 17 19:23:44.008951 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:44.008912    2581 patch_prober.go:28] interesting pod/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 17 19:23:44.009443 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:44.008989    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 17 19:23:45.009505 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:45.009469    2581 patch_prober.go:28] interesting pod/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 17 19:23:45.009911 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:45.009531    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 17 19:23:46.013250 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:46.013193    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:46.013631 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:46.013620    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:23:46.014234 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:23:46.014186    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:24:04.025597 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:04.025557    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"]
Jul 17 19:24:04.026028 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:04.025815    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy" containerID="cri-o://c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1" gracePeriod=30
Jul 17 19:24:05.604695 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:05.604656    2581 patch_prober.go:28] interesting pod/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 19:24:05.605144 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:05.604740    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 19:24:09.278722 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.278699    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:24:09.352825 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.352762    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mckg4\" (UniqueName: \"kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-kube-api-access-mckg4\") pod \"1d5d559a-3992-481c-b2af-a21ecbac85d4\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") "
Jul 17 19:24:09.352825 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.352804    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-podinfo\") pod \"1d5d559a-3992-481c-b2af-a21ecbac85d4\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") "
Jul 17 19:24:09.353022 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.352832    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-envoy\") pod \"1d5d559a-3992-481c-b2af-a21ecbac85d4\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") "
Jul 17 19:24:09.353022 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.352856    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5d559a-3992-481c-b2af-a21ecbac85d4-istiod-ca-cert\") pod \"1d5d559a-3992-481c-b2af-a21ecbac85d4\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") "
Jul 17 19:24:09.353022 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.352893    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-socket\") pod \"1d5d559a-3992-481c-b2af-a21ecbac85d4\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") "
Jul 17 19:24:09.353022 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.352909    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-token\") pod \"1d5d559a-3992-481c-b2af-a21ecbac85d4\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") "
Jul 17 19:24:09.353022 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.352931    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-data\") pod \"1d5d559a-3992-481c-b2af-a21ecbac85d4\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") "
Jul 17 19:24:09.353022 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.352950    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-certs\") pod \"1d5d559a-3992-481c-b2af-a21ecbac85d4\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") "
Jul 17 19:24:09.353022 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.352979    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-credential-socket\") pod \"1d5d559a-3992-481c-b2af-a21ecbac85d4\" (UID: \"1d5d559a-3992-481c-b2af-a21ecbac85d4\") "
Jul 17 19:24:09.353421 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.353249    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d5d559a-3992-481c-b2af-a21ecbac85d4" (UID: "1d5d559a-3992-481c-b2af-a21ecbac85d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:24:09.353421 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.353406    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d5d559a-3992-481c-b2af-a21ecbac85d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d5d559a-3992-481c-b2af-a21ecbac85d4" (UID: "1d5d559a-3992-481c-b2af-a21ecbac85d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:24:09.353706 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.353437    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d5d559a-3992-481c-b2af-a21ecbac85d4" (UID: "1d5d559a-3992-481c-b2af-a21ecbac85d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:24:09.353706 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.353440    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:09.353813 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.353780    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d5d559a-3992-481c-b2af-a21ecbac85d4" (UID: "1d5d559a-3992-481c-b2af-a21ecbac85d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:24:09.353992 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.353967    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d5d559a-3992-481c-b2af-a21ecbac85d4" (UID: "1d5d559a-3992-481c-b2af-a21ecbac85d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:24:09.355164 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.355144    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-kube-api-access-mckg4" (OuterVolumeSpecName: "kube-api-access-mckg4") pod "1d5d559a-3992-481c-b2af-a21ecbac85d4" (UID: "1d5d559a-3992-481c-b2af-a21ecbac85d4"). InnerVolumeSpecName "kube-api-access-mckg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:24:09.355307 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.355185    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d5d559a-3992-481c-b2af-a21ecbac85d4" (UID: "1d5d559a-3992-481c-b2af-a21ecbac85d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:24:09.355585 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.355559    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d5d559a-3992-481c-b2af-a21ecbac85d4" (UID: "1d5d559a-3992-481c-b2af-a21ecbac85d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:24:09.355695 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.355629    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d5d559a-3992-481c-b2af-a21ecbac85d4" (UID: "1d5d559a-3992-481c-b2af-a21ecbac85d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:24:09.454522 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.454493    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:09.454522 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.454521    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:09.454723 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.454535    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:09.454723 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.454546    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:09.454723 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.454557    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mckg4\" (UniqueName: \"kubernetes.io/projected/1d5d559a-3992-481c-b2af-a21ecbac85d4-kube-api-access-mckg4\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:09.454723 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.454568    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:09.454723 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.454580    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5d559a-3992-481c-b2af-a21ecbac85d4-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:09.454723 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.454590    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5d559a-3992-481c-b2af-a21ecbac85d4-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:09.569157 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.569124    2581 generic.go:356] "Generic (PLEG): container finished" podID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerID="c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1" exitCode=0
Jul 17 19:24:09.569376 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.569173    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"
Jul 17 19:24:09.569376 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.569190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" event={"ID":"1d5d559a-3992-481c-b2af-a21ecbac85d4","Type":"ContainerDied","Data":"c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1"}
Jul 17 19:24:09.569376 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.569264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b" event={"ID":"1d5d559a-3992-481c-b2af-a21ecbac85d4","Type":"ContainerDied","Data":"0db19fd58a8842c9f6ad1a16ba10a20e47bc2d9fc5b1d6ff7cbdb0eaa0b115e3"}
Jul 17 19:24:09.569376 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.569285    2581 scope.go:117] "RemoveContainer" containerID="c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1"
Jul 17 19:24:09.578740 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.578719    2581 scope.go:117] "RemoveContainer" containerID="f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd"
Jul 17 19:24:09.586900 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.586877    2581 scope.go:117] "RemoveContainer" containerID="c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1"
Jul 17 19:24:09.587135 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:24:09.587111    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1\": container with ID starting with c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1 not found: ID does not exist" containerID="c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1"
Jul 17 19:24:09.587189 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.587148    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1"} err="failed to get container status \"c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1\": rpc error: code = NotFound desc = could not find container \"c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1\": container with ID starting with c2b0a28a004a90c8150236ce73bcebeffcae0696dbad04b3637d38ead97b5bf1 not found: ID does not exist"
Jul 17 19:24:09.587189 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.587168    2581 scope.go:117] "RemoveContainer" containerID="f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd"
Jul 17 19:24:09.587448 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:24:09.587432    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd\": container with ID starting with f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd not found: ID does not exist" containerID="f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd"
Jul 17 19:24:09.587499 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.587453    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd"} err="failed to get container status \"f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd\": rpc error: code = NotFound desc = could not find container \"f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd\": container with ID starting with f27f7cf87b460dad7c5e9cee46a826f83eb5d48ef0bfc3ef2d7e8658d07ecccd not found: ID does not exist"
Jul 17 19:24:09.591684 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.591664    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"]
Jul 17 19:24:09.595837 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:09.595814    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-55c341-openshift-default-6b9c498dd9-t647b"]
Jul 17 19:24:10.486764 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:10.486731    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" path="/var/lib/kubelet/pods/1d5d559a-3992-481c-b2af-a21ecbac85d4/volumes"
Jul 17 19:24:32.870544 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:32.870512    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"]
Jul 17 19:24:32.871081 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:32.870791    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy" containerID="cri-o://91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04" gracePeriod=30
Jul 17 19:24:33.851166 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.851130    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"]
Jul 17 19:24:33.851715 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.851700    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy"
Jul 17 19:24:33.851777 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.851729    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy"
Jul 17 19:24:33.851874 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.851855    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cdcd69c-8727-42ec-9971-d004c509b281" containerName="istio-proxy"
Jul 17 19:24:33.851874 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.851876    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy"
Jul 17 19:24:33.852023 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.851887    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy"
Jul 17 19:24:33.855298 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.855281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.858950 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.858929    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-14077d-openshift-default-dockercfg-9zcb2\""
Jul 17 19:24:33.859409 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.859387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-socket\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.859510 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.859418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-data\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.859510 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.859450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqjv6\" (UniqueName: \"kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-kube-api-access-qqjv6\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.859640 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.859542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-token\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.859640 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.859589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-certs\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.859640 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.859609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-envoy\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.859640 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.859630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-podinfo\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.859847 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.859732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2abe7de0-49c5-43bf-be2e-24791d3d5159-istiod-ca-cert\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.859847 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.859784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-credential-socket\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.870457 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.870432    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"]
Jul 17 19:24:33.960121 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-credential-socket\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.960121 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-socket\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.960667 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-data\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.960667 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqjv6\" (UniqueName: \"kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-kube-api-access-qqjv6\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.960667 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-token\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.960667 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-certs\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.960667 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-envoy\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.960667 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-podinfo\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.960667 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2abe7de0-49c5-43bf-be2e-24791d3d5159-istiod-ca-cert\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.960667 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960562    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-credential-socket\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.960667 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.960594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-socket\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.961246 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.961029    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-data\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.961246 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.961155    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-certs\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.961357 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.961338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2abe7de0-49c5-43bf-be2e-24791d3d5159-istiod-ca-cert\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.962847 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.962826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-envoy\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.962992 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.962975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-podinfo\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.972649 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.972629    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqjv6\" (UniqueName: \"kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-kube-api-access-qqjv6\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:33.972845 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:33.972829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-token\") pod \"e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") " pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:34.166299 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:34.166271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:34.358006 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:34.357974    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"]
Jul 17 19:24:34.358510 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:24:34.358482    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abe7de0_49c5_43bf_be2e_24791d3d5159.slice/crio-e3d360574336bfb962ff035046b59875552e589825151b54301c967996c97ae7 WatchSource:0}: Error finding container e3d360574336bfb962ff035046b59875552e589825151b54301c967996c97ae7: Status 404 returned error can't find the container with id e3d360574336bfb962ff035046b59875552e589825151b54301c967996c97ae7
Jul 17 19:24:34.360560 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:34.360527    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:34.360653 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:34.360594    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:34.360653 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:34.360623    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:34.691763 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:34.691733    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" event={"ID":"2abe7de0-49c5-43bf-be2e-24791d3d5159","Type":"ContainerStarted","Data":"ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d"}
Jul 17 19:24:34.691934 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:34.691783    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" event={"ID":"2abe7de0-49c5-43bf-be2e-24791d3d5159","Type":"ContainerStarted","Data":"e3d360574336bfb962ff035046b59875552e589825151b54301c967996c97ae7"}
Jul 17 19:24:35.166847 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:35.166818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:35.171682 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:35.171653    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:35.194286 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:35.194246    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" podStartSLOduration=2.194231879 podStartE2EDuration="2.194231879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:24:34.748254723 +0000 UTC m=+2394.742620738" watchObservedRunningTime="2026-07-17 19:24:35.194231879 +0000 UTC m=+2395.188597890"
Jul 17 19:24:35.696778 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:35.696751    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:35.697575 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:35.697548    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:38.128061 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.128033    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:24:38.203236 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203183    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-socket\") pod \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") "
Jul 17 19:24:38.203413 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203293    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-certs\") pod \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") "
Jul 17 19:24:38.203413 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203358    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-podinfo\") pod \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") "
Jul 17 19:24:38.203413 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203391    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-envoy\") pod \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") "
Jul 17 19:24:38.203578 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203419    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-credential-socket\") pod \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") "
Jul 17 19:24:38.203578 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203446    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-token\") pod \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") "
Jul 17 19:24:38.203578 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203473    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istiod-ca-cert\") pod \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") "
Jul 17 19:24:38.203578 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203492    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" (UID: "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:24:38.203578 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203538    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-data\") pod \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") "
Jul 17 19:24:38.203578 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203563    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw6kc\" (UniqueName: \"kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-kube-api-access-kw6kc\") pod \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\" (UID: \"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8\") "
Jul 17 19:24:38.203876 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203619    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" (UID: "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:24:38.203876 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" (UID: "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:24:38.203980 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203948    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:38.203980 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203968    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:38.204068 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203982    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:38.204068 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.203992    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" (UID: "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:24:38.204725 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.204700    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" (UID: "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:24:38.205791 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.205770    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" (UID: "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:24:38.205886 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.205826    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-kube-api-access-kw6kc" (OuterVolumeSpecName: "kube-api-access-kw6kc") pod "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" (UID: "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8"). InnerVolumeSpecName "kube-api-access-kw6kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:24:38.206249 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.206227    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" (UID: "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:24:38.206334 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.206254    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" (UID: "dc3c90ae-7642-43fe-b10e-1ffba32cb5e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:24:38.305414 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.305381    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:38.305414 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.305408    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:38.305414 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.305418    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:38.305650 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.305425    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:38.305650 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.305432    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:38.305650 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.305440    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw6kc\" (UniqueName: \"kubernetes.io/projected/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8-kube-api-access-kw6kc\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:24:38.712237 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.712179    2581 generic.go:356] "Generic (PLEG): container finished" podID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerID="91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04" exitCode=0
Jul 17 19:24:38.712399 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.712257    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"
Jul 17 19:24:38.712399 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.712266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" event={"ID":"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8","Type":"ContainerDied","Data":"91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04"}
Jul 17 19:24:38.712399 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.712317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw" event={"ID":"dc3c90ae-7642-43fe-b10e-1ffba32cb5e8","Type":"ContainerDied","Data":"449e361a1ae904e9325fce32752f435619e6ec2128e278439247f245e3c1b2ec"}
Jul 17 19:24:38.712399 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.712336    2581 scope.go:117] "RemoveContainer" containerID="91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04"
Jul 17 19:24:38.721350 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.721330    2581 scope.go:117] "RemoveContainer" containerID="0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a"
Jul 17 19:24:38.729062 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.729045    2581 scope.go:117] "RemoveContainer" containerID="91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04"
Jul 17 19:24:38.729355 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:24:38.729333    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04\": container with ID starting with 91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04 not found: ID does not exist" containerID="91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04"
Jul 17 19:24:38.729431 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.729365    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04"} err="failed to get container status \"91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04\": rpc error: code = NotFound desc = could not find container \"91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04\": container with ID starting with 91521ecb4c1b7f2290e1cdb6f5021612f447c71b18df319f35f74cdb998f8b04 not found: ID does not exist"
Jul 17 19:24:38.729431 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.729389    2581 scope.go:117] "RemoveContainer" containerID="0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a"
Jul 17 19:24:38.729719 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:24:38.729694    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a\": container with ID starting with 0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a not found: ID does not exist" containerID="0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a"
Jul 17 19:24:38.729777 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.729730    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a"} err="failed to get container status \"0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a\": rpc error: code = NotFound desc = could not find container \"0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a\": container with ID starting with 0ab4030ba18c7d7390bc4e2ae9a649a2d13116d2689c588318d3e34ebbc8b58a not found: ID does not exist"
Jul 17 19:24:38.736552 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.736531    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"]
Jul 17 19:24:38.741478 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:38.741457    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8fe1d7-openshift-default-6d44886ddc-q6qcw"]
Jul 17 19:24:40.491957 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:40.491925    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" path="/var/lib/kubelet/pods/dc3c90ae-7642-43fe-b10e-1ffba32cb5e8/volumes"
Jul 17 19:24:41.969211 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.969176    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"]
Jul 17 19:24:41.969600 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.969586    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy"
Jul 17 19:24:41.969646 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.969602    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy"
Jul 17 19:24:41.969646 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.969614    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy"
Jul 17 19:24:41.969646 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.969619    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d5d559a-3992-481c-b2af-a21ecbac85d4" containerName="istio-proxy"
Jul 17 19:24:41.969646 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.969625    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy"
Jul 17 19:24:41.969646 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.969630    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy"
Jul 17 19:24:41.969808 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.969692    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy"
Jul 17 19:24:41.969808 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.969700    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc3c90ae-7642-43fe-b10e-1ffba32cb5e8" containerName="istio-proxy"
Jul 17 19:24:41.974339 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.974320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:41.978448 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.978413    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-2dc31c-openshift-default-dockercfg-hc2wl\""
Jul 17 19:24:41.995990 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:41.995965    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"]
Jul 17 19:24:42.034390 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.034364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-podinfo\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.034528 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.034396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7705f2e-24c6-49ea-ad21-83fa10182702-istiod-ca-cert\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.034528 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.034424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-token\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.034528 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.034497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zbfw\" (UniqueName: \"kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-kube-api-access-9zbfw\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.034662 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.034542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-credential-socket\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.034662 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.034560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-certs\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.034662 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.034583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-envoy\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.034662 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.034622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-socket\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.034662 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.034641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-data\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.135774 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.135737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-token\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.135972 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.135789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zbfw\" (UniqueName: \"kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-kube-api-access-9zbfw\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.135972 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.135823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-credential-socket\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.135972 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.135840    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-certs\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.135972 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.135858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-envoy\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.135972 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.135885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-socket\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.135972 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.135915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-data\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.136318 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.135981    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-podinfo\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.136318 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.136002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7705f2e-24c6-49ea-ad21-83fa10182702-istiod-ca-cert\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.136318 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.136278    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-certs\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.136530 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.136427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-credential-socket\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.136530 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.136480    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-data\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.136530 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.136502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-socket\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.136756 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.136734    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7705f2e-24c6-49ea-ad21-83fa10182702-istiod-ca-cert\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.138320 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.138303    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-envoy\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.138562 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.138544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-podinfo\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.146647 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.146623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zbfw\" (UniqueName: \"kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-kube-api-access-9zbfw\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.148500 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.148481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-token\") pod \"e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") " pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.285302 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.285210    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:42.433455 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.433427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"]
Jul 17 19:24:42.436066 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:24:42.436036    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7705f2e_24c6_49ea_ad21_83fa10182702.slice/crio-3eebdec98a22c9165c5558b8d9bd48d0299499ccda875ef381bac747eb96f848 WatchSource:0}: Error finding container 3eebdec98a22c9165c5558b8d9bd48d0299499ccda875ef381bac747eb96f848: Status 404 returned error can't find the container with id 3eebdec98a22c9165c5558b8d9bd48d0299499ccda875ef381bac747eb96f848
Jul 17 19:24:42.438297 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.438260    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:42.438395 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.438342    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:42.438467 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.438413    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:42.736336 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.736303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" event={"ID":"a7705f2e-24c6-49ea-ad21-83fa10182702","Type":"ContainerStarted","Data":"aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d"}
Jul 17 19:24:42.736496 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.736363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" event={"ID":"a7705f2e-24c6-49ea-ad21-83fa10182702","Type":"ContainerStarted","Data":"3eebdec98a22c9165c5558b8d9bd48d0299499ccda875ef381bac747eb96f848"}
Jul 17 19:24:42.759009 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:42.758959    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" podStartSLOduration=1.758946001 podStartE2EDuration="1.758946001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:24:42.757372051 +0000 UTC m=+2402.751738066" watchObservedRunningTime="2026-07-17 19:24:42.758946001 +0000 UTC m=+2402.753312016"
Jul 17 19:24:43.286081 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:43.286051    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:43.291445 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:43.291422    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:43.747037 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:43.743989    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:43.747968 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:43.747943    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:51.140661 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:51.139773    2581 patch_prober.go:28] interesting pod/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:40666->10.133.0.60:15021: read: connection reset by peer" start-of-body=
Jul 17 19:24:51.140661 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:51.139852    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:40666->10.133.0.60:15021: read: connection reset by peer"
Jul 17 19:24:51.783700 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:51.783655    2581 generic.go:356] "Generic (PLEG): container finished" podID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerID="ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d" exitCode=0
Jul 17 19:24:51.783904 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:51.783715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" event={"ID":"2abe7de0-49c5-43bf-be2e-24791d3d5159","Type":"ContainerDied","Data":"ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d"}
Jul 17 19:24:51.784226 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:51.784173    2581 scope.go:117] "RemoveContainer" containerID="ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d"
Jul 17 19:24:51.785574 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:51.785533    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:51.785680 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:51.785623    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:51.785680 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:51.785667    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:52.794398 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:52.794360    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" event={"ID":"2abe7de0-49c5-43bf-be2e-24791d3d5159","Type":"ContainerStarted","Data":"5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686"}
Jul 17 19:24:53.167136 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:53.167106    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:53.167339 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:53.167320    2581 patch_prober.go:28] interesting pod/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 17 19:24:53.167398 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:53.167379    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 17 19:24:54.167001 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:54.166963    2581 patch_prober.go:28] interesting pod/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 17 19:24:54.167416 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:54.167018    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 17 19:24:55.167118 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:55.167082    2581 patch_prober.go:28] interesting pod/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 17 19:24:55.167523 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:55.167133    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 17 19:24:56.167354 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:56.167319    2581 patch_prober.go:28] interesting pod/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 17 19:24:56.167715 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:56.167370    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 17 19:24:56.820934 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:56.820857    2581 generic.go:356] "Generic (PLEG): container finished" podID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerID="aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d" exitCode=0
Jul 17 19:24:56.821110 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:56.820932    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" event={"ID":"a7705f2e-24c6-49ea-ad21-83fa10182702","Type":"ContainerDied","Data":"aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d"}
Jul 17 19:24:56.821345 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:56.821332    2581 scope.go:117] "RemoveContainer" containerID="aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d"
Jul 17 19:24:56.822400 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:56.822372    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:56.822509 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:56.822439    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:56.822509 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:56.822469    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Jul 17 19:24:57.170584 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:57.170559    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:57.171016 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:57.170940    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:57.171560 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:57.171543    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:24:57.828210 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:57.828168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" event={"ID":"a7705f2e-24c6-49ea-ad21-83fa10182702","Type":"ContainerStarted","Data":"a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9"}
Jul 17 19:24:58.285726 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:58.285685    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:58.287110 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:58.287069    2581 patch_prober.go:28] interesting pod/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 17 19:24:58.287383 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:58.287328    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 17 19:24:58.744404 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:58.744372    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:24:59.286549 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:59.286509    2581 patch_prober.go:28] interesting pod/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 17 19:24:59.287030 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:24:59.286577    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 17 19:25:00.290996 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:00.290568    2581 patch_prober.go:28] interesting pod/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 17 19:25:00.290996 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:00.290629    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 17 19:25:01.286624 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:01.286527    2581 patch_prober.go:28] interesting pod/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 17 19:25:01.286624 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:01.286599    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 17 19:25:02.289832 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:02.289801    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:25:02.290766 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:02.290747    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:25:35.799268 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.799229    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"]
Jul 17 19:25:35.802980 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.802959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:35.807440 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.807421    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"default-dockercfg-wj7qc\""
Jul 17 19:25:35.808458 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.808437    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"openshift-service-ca.crt\""
Jul 17 19:25:35.808589 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.808458    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"auth-test-model-2dc31c-kserve-self-signed-certs\""
Jul 17 19:25:35.808589 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.808476    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2dc31c\"/\"kube-root-ca.crt\""
Jul 17 19:25:35.823302 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.823282    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"]
Jul 17 19:25:35.936758 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.936725    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e94f706c-4396-46c4-a4d2-93120617f5f6-tls-certs\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:35.936758 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.936760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-tmp-dir\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:35.936955 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.936839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nf2x\" (UniqueName: \"kubernetes.io/projected/e94f706c-4396-46c4-a4d2-93120617f5f6-kube-api-access-7nf2x\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:35.936955 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.936881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-dshm\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:35.936955 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.936903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-model-cache\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:35.937059 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:35.936976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-home\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.037726 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.037695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-home\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.037726 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.037728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e94f706c-4396-46c4-a4d2-93120617f5f6-tls-certs\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.038283 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.037755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-tmp-dir\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.038283 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.037807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nf2x\" (UniqueName: \"kubernetes.io/projected/e94f706c-4396-46c4-a4d2-93120617f5f6-kube-api-access-7nf2x\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.038283 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.037843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-dshm\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.038283 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.037862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-model-cache\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.038283 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.038155    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-tmp-dir\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.038283 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.038166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-home\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.038543 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.038292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-model-cache\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.040283 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.040259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-dshm\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.040531 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.040515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e94f706c-4396-46c4-a4d2-93120617f5f6-tls-certs\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.054693 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.054627    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nf2x\" (UniqueName: \"kubernetes.io/projected/e94f706c-4396-46c4-a4d2-93120617f5f6-kube-api-access-7nf2x\") pod \"auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") " pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.112754 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.112720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:36.277984 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:36.277962    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"]
Jul 17 19:25:36.280038 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:25:36.280012    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode94f706c_4396_46c4_a4d2_93120617f5f6.slice/crio-191ccd1fce108d97aeaef9ac0a12d9ce3a4728252a8badf49a75cae76379c4c0 WatchSource:0}: Error finding container 191ccd1fce108d97aeaef9ac0a12d9ce3a4728252a8badf49a75cae76379c4c0: Status 404 returned error can't find the container with id 191ccd1fce108d97aeaef9ac0a12d9ce3a4728252a8badf49a75cae76379c4c0
Jul 17 19:25:37.023940 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:37.023905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt" event={"ID":"e94f706c-4396-46c4-a4d2-93120617f5f6","Type":"ContainerStarted","Data":"03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d"}
Jul 17 19:25:37.023940 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:37.023943    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt" event={"ID":"e94f706c-4396-46c4-a4d2-93120617f5f6","Type":"ContainerStarted","Data":"191ccd1fce108d97aeaef9ac0a12d9ce3a4728252a8badf49a75cae76379c4c0"}
Jul 17 19:25:37.068886 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:37.068838    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt" podStartSLOduration=2.06882423 podStartE2EDuration="2.06882423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:25:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:25:37.067799924 +0000 UTC m=+2457.062165951" watchObservedRunningTime="2026-07-17 19:25:37.06882423 +0000 UTC m=+2457.063190256"
Jul 17 19:25:46.113671 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:46.113634    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:46.113671 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:46.113677    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:46.126478 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:46.126456    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:25:47.085513 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:25:47.085475    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:27:55.218948 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:27:55.218917    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"]
Jul 17 19:28:10.239325 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.239285    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt" podUID="e94f706c-4396-46c4-a4d2-93120617f5f6" containerName="main" containerID="cri-o://03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d" gracePeriod=45
Jul 17 19:28:10.505781 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.505759    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:28:10.583288 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.583259    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e94f706c-4396-46c4-a4d2-93120617f5f6-tls-certs\") pod \"e94f706c-4396-46c4-a4d2-93120617f5f6\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") "
Jul 17 19:28:10.583447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.583320    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nf2x\" (UniqueName: \"kubernetes.io/projected/e94f706c-4396-46c4-a4d2-93120617f5f6-kube-api-access-7nf2x\") pod \"e94f706c-4396-46c4-a4d2-93120617f5f6\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") "
Jul 17 19:28:10.583447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.583379    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-home\") pod \"e94f706c-4396-46c4-a4d2-93120617f5f6\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") "
Jul 17 19:28:10.583447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.583415    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-tmp-dir\") pod \"e94f706c-4396-46c4-a4d2-93120617f5f6\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") "
Jul 17 19:28:10.583447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.583444    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-dshm\") pod \"e94f706c-4396-46c4-a4d2-93120617f5f6\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") "
Jul 17 19:28:10.583680 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.583478    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-model-cache\") pod \"e94f706c-4396-46c4-a4d2-93120617f5f6\" (UID: \"e94f706c-4396-46c4-a4d2-93120617f5f6\") "
Jul 17 19:28:10.583680 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.583601    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-home" (OuterVolumeSpecName: "home") pod "e94f706c-4396-46c4-a4d2-93120617f5f6" (UID: "e94f706c-4396-46c4-a4d2-93120617f5f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:28:10.583795 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.583700    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e94f706c-4396-46c4-a4d2-93120617f5f6" (UID: "e94f706c-4396-46c4-a4d2-93120617f5f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:28:10.583795 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.583775    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-home\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:28:10.583795 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.583785    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "e94f706c-4396-46c4-a4d2-93120617f5f6" (UID: "e94f706c-4396-46c4-a4d2-93120617f5f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:28:10.585694 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.585669    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-dshm" (OuterVolumeSpecName: "dshm") pod "e94f706c-4396-46c4-a4d2-93120617f5f6" (UID: "e94f706c-4396-46c4-a4d2-93120617f5f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:28:10.585800 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.585772    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e94f706c-4396-46c4-a4d2-93120617f5f6-kube-api-access-7nf2x" (OuterVolumeSpecName: "kube-api-access-7nf2x") pod "e94f706c-4396-46c4-a4d2-93120617f5f6" (UID: "e94f706c-4396-46c4-a4d2-93120617f5f6"). InnerVolumeSpecName "kube-api-access-7nf2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:28:10.585842 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.585803    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e94f706c-4396-46c4-a4d2-93120617f5f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e94f706c-4396-46c4-a4d2-93120617f5f6" (UID: "e94f706c-4396-46c4-a4d2-93120617f5f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:28:10.684603 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.684579    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-dshm\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:28:10.684603 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.684602    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-model-cache\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:28:10.684766 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.684611    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e94f706c-4396-46c4-a4d2-93120617f5f6-tls-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:28:10.684766 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.684623    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nf2x\" (UniqueName: \"kubernetes.io/projected/e94f706c-4396-46c4-a4d2-93120617f5f6-kube-api-access-7nf2x\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:28:10.684766 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.684632    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e94f706c-4396-46c4-a4d2-93120617f5f6-tmp-dir\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:28:10.788978 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.788898    2581 generic.go:356] "Generic (PLEG): container finished" podID="e94f706c-4396-46c4-a4d2-93120617f5f6" containerID="03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d" exitCode=0
Jul 17 19:28:10.788978 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.788943    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"
Jul 17 19:28:10.789153 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.788982    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt" event={"ID":"e94f706c-4396-46c4-a4d2-93120617f5f6","Type":"ContainerDied","Data":"03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d"}
Jul 17 19:28:10.789153 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.789024    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt" event={"ID":"e94f706c-4396-46c4-a4d2-93120617f5f6","Type":"ContainerDied","Data":"191ccd1fce108d97aeaef9ac0a12d9ce3a4728252a8badf49a75cae76379c4c0"}
Jul 17 19:28:10.789153 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.789046    2581 scope.go:117] "RemoveContainer" containerID="03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d"
Jul 17 19:28:10.803666 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.803637    2581 scope.go:117] "RemoveContainer" containerID="03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d"
Jul 17 19:28:10.804022 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:28:10.803988    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d\": container with ID starting with 03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d not found: ID does not exist" containerID="03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d"
Jul 17 19:28:10.804109 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.804037    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d"} err="failed to get container status \"03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d\": rpc error: code = NotFound desc = could not find container \"03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d\": container with ID starting with 03cc9d1e9203c262d8143ebcac40a98c38d058c9abc09b87708e56f17864703d not found: ID does not exist"
Jul 17 19:28:10.823556 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.823536    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"]
Jul 17 19:28:10.829187 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:10.829167    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2dc31c/auth-test-model-2dc31c-kserve-54f6c47d67-zb9vt"]
Jul 17 19:28:12.486996 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:28:12.486963    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e94f706c-4396-46c4-a4d2-93120617f5f6" path="/var/lib/kubelet/pods/e94f706c-4396-46c4-a4d2-93120617f5f6/volumes"
Jul 17 19:29:34.146962 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.146880    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"]
Jul 17 19:29:34.147434 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.147321    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e94f706c-4396-46c4-a4d2-93120617f5f6" containerName="main"
Jul 17 19:29:34.147434 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.147334    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e94f706c-4396-46c4-a4d2-93120617f5f6" containerName="main"
Jul 17 19:29:34.147434 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.147390    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e94f706c-4396-46c4-a4d2-93120617f5f6" containerName="main"
Jul 17 19:29:34.150467 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.150446    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.154046 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.154025    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-14077d\"/\"kube-root-ca.crt\""
Jul 17 19:29:34.154046 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.154036    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-14077d\"/\"rate-test-model-14077d-kserve-self-signed-certs\""
Jul 17 19:29:34.154245 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.154026    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-14077d\"/\"default-dockercfg-fzqhn\""
Jul 17 19:29:34.154245 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.154066    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-14077d\"/\"openshift-service-ca.crt\""
Jul 17 19:29:34.162984 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.162965    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"]
Jul 17 19:29:34.315251 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.315211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-home\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.315429 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.315271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shv78\" (UniqueName: \"kubernetes.io/projected/18213d5d-b8ba-4530-8230-c24f2c72617f-kube-api-access-shv78\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.315429 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.315298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-model-cache\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.315429 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.315362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18213d5d-b8ba-4530-8230-c24f2c72617f-tls-certs\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.315429 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.315404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-dshm\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.315568 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.315432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-tmp-dir\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.416663 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.416620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18213d5d-b8ba-4530-8230-c24f2c72617f-tls-certs\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.416880 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.416675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-dshm\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.416880 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.416787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-tmp-dir\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.417011 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.416924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-home\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.417011 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.416969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shv78\" (UniqueName: \"kubernetes.io/projected/18213d5d-b8ba-4530-8230-c24f2c72617f-kube-api-access-shv78\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.417011 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.417002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-model-cache\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.417176 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.417151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-tmp-dir\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.417349 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.417332    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-model-cache\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.417598 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.417327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-home\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.419214 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.419175    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-dshm\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.419433 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.419415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18213d5d-b8ba-4530-8230-c24f2c72617f-tls-certs\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.426183 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.426165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shv78\" (UniqueName: \"kubernetes.io/projected/18213d5d-b8ba-4530-8230-c24f2c72617f-kube-api-access-shv78\") pod \"rate-test-model-14077d-kserve-65c94f6df9-9wplt\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") " pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.459651 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.459626    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:34.600717 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:34.600688    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"]
Jul 17 19:29:34.602764 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:29:34.602729    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18213d5d_b8ba_4530_8230_c24f2c72617f.slice/crio-4e6d74019f805e38df36ae6c1b107b617ce4337f5d7630e600e05b821abef23d WatchSource:0}: Error finding container 4e6d74019f805e38df36ae6c1b107b617ce4337f5d7630e600e05b821abef23d: Status 404 returned error can't find the container with id 4e6d74019f805e38df36ae6c1b107b617ce4337f5d7630e600e05b821abef23d
Jul 17 19:29:35.207333 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:35.207296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt" event={"ID":"18213d5d-b8ba-4530-8230-c24f2c72617f","Type":"ContainerStarted","Data":"c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415"}
Jul 17 19:29:35.207333 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:35.207342    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt" event={"ID":"18213d5d-b8ba-4530-8230-c24f2c72617f","Type":"ContainerStarted","Data":"4e6d74019f805e38df36ae6c1b107b617ce4337f5d7630e600e05b821abef23d"}
Jul 17 19:29:35.227545 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:35.227501    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt" podStartSLOduration=1.2274843930000001 podStartE2EDuration="1.227484393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:29:35.225086364 +0000 UTC m=+2695.219452380" watchObservedRunningTime="2026-07-17 19:29:35.227484393 +0000 UTC m=+2695.221850407"
Jul 17 19:29:44.460114 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:44.460080    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:44.460584 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:44.460234    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:44.472931 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:44.472909    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:29:45.267952 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:29:45.267909    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:30:38.739136 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:38.739099    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"]
Jul 17 19:30:53.759793 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:53.759721    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt" podUID="18213d5d-b8ba-4530-8230-c24f2c72617f" containerName="main" containerID="cri-o://c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415" gracePeriod=45
Jul 17 19:30:54.022002 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.021944    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:30:54.151240 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151168    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-model-cache\") pod \"18213d5d-b8ba-4530-8230-c24f2c72617f\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") "
Jul 17 19:30:54.151447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151283    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18213d5d-b8ba-4530-8230-c24f2c72617f-tls-certs\") pod \"18213d5d-b8ba-4530-8230-c24f2c72617f\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") "
Jul 17 19:30:54.151447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151319    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-tmp-dir\") pod \"18213d5d-b8ba-4530-8230-c24f2c72617f\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") "
Jul 17 19:30:54.151447 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151351    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-home\") pod \"18213d5d-b8ba-4530-8230-c24f2c72617f\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") "
Jul 17 19:30:54.151616 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151448    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-model-cache" (OuterVolumeSpecName: "model-cache") pod "18213d5d-b8ba-4530-8230-c24f2c72617f" (UID: "18213d5d-b8ba-4530-8230-c24f2c72617f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:30:54.151616 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151489    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-dshm\") pod \"18213d5d-b8ba-4530-8230-c24f2c72617f\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") "
Jul 17 19:30:54.151616 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151571    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shv78\" (UniqueName: \"kubernetes.io/projected/18213d5d-b8ba-4530-8230-c24f2c72617f-kube-api-access-shv78\") pod \"18213d5d-b8ba-4530-8230-c24f2c72617f\" (UID: \"18213d5d-b8ba-4530-8230-c24f2c72617f\") "
Jul 17 19:30:54.151616 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151589    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "18213d5d-b8ba-4530-8230-c24f2c72617f" (UID: "18213d5d-b8ba-4530-8230-c24f2c72617f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:30:54.151815 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151613    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-home" (OuterVolumeSpecName: "home") pod "18213d5d-b8ba-4530-8230-c24f2c72617f" (UID: "18213d5d-b8ba-4530-8230-c24f2c72617f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:30:54.151867 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151828    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-home\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:30:54.151867 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151839    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-model-cache\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:30:54.151867 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.151849    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-tmp-dir\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:30:54.153806 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.153783    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18213d5d-b8ba-4530-8230-c24f2c72617f-kube-api-access-shv78" (OuterVolumeSpecName: "kube-api-access-shv78") pod "18213d5d-b8ba-4530-8230-c24f2c72617f" (UID: "18213d5d-b8ba-4530-8230-c24f2c72617f"). InnerVolumeSpecName "kube-api-access-shv78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:30:54.153806 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.153793    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18213d5d-b8ba-4530-8230-c24f2c72617f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "18213d5d-b8ba-4530-8230-c24f2c72617f" (UID: "18213d5d-b8ba-4530-8230-c24f2c72617f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:30:54.153806 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.153804    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-dshm" (OuterVolumeSpecName: "dshm") pod "18213d5d-b8ba-4530-8230-c24f2c72617f" (UID: "18213d5d-b8ba-4530-8230-c24f2c72617f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:30:54.252455 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.252431    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18213d5d-b8ba-4530-8230-c24f2c72617f-tls-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:30:54.252455 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.252450    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18213d5d-b8ba-4530-8230-c24f2c72617f-dshm\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:30:54.252455 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.252459    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shv78\" (UniqueName: \"kubernetes.io/projected/18213d5d-b8ba-4530-8230-c24f2c72617f-kube-api-access-shv78\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:30:54.596508 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.596475    2581 generic.go:356] "Generic (PLEG): container finished" podID="18213d5d-b8ba-4530-8230-c24f2c72617f" containerID="c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415" exitCode=0
Jul 17 19:30:54.596643 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.596522    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"
Jul 17 19:30:54.596643 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.596564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt" event={"ID":"18213d5d-b8ba-4530-8230-c24f2c72617f","Type":"ContainerDied","Data":"c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415"}
Jul 17 19:30:54.596643 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.596613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt" event={"ID":"18213d5d-b8ba-4530-8230-c24f2c72617f","Type":"ContainerDied","Data":"4e6d74019f805e38df36ae6c1b107b617ce4337f5d7630e600e05b821abef23d"}
Jul 17 19:30:54.596643 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.596635    2581 scope.go:117] "RemoveContainer" containerID="c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415"
Jul 17 19:30:54.605423 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.605399    2581 scope.go:117] "RemoveContainer" containerID="c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415"
Jul 17 19:30:54.605683 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:30:54.605665    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415\": container with ID starting with c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415 not found: ID does not exist" containerID="c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415"
Jul 17 19:30:54.605747 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.605690    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415"} err="failed to get container status \"c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415\": rpc error: code = NotFound desc = could not find container \"c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415\": container with ID starting with c7700da9c338c0d9c179620e2e15a798acc0d01964f09bb51f7b35b54cfef415 not found: ID does not exist"
Jul 17 19:30:54.613578 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.613553    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"]
Jul 17 19:30:54.617429 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:54.617409    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-14077d/rate-test-model-14077d-kserve-65c94f6df9-9wplt"]
Jul 17 19:30:56.486980 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:30:56.486945    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18213d5d-b8ba-4530-8230-c24f2c72617f" path="/var/lib/kubelet/pods/18213d5d-b8ba-4530-8230-c24f2c72617f/volumes"
Jul 17 19:31:21.483098 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:21.483064    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"]
Jul 17 19:31:21.483617 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:21.483335    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerName="istio-proxy" containerID="cri-o://5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686" gracePeriod=30
Jul 17 19:31:26.749706 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.749639    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:31:26.750040 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.749744    2581 generic.go:356] "Generic (PLEG): container finished" podID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerID="5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686" exitCode=0
Jul 17 19:31:26.750040 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.749843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" event={"ID":"2abe7de0-49c5-43bf-be2e-24791d3d5159","Type":"ContainerDied","Data":"5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686"}
Jul 17 19:31:26.750040 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.749900    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h" event={"ID":"2abe7de0-49c5-43bf-be2e-24791d3d5159","Type":"ContainerDied","Data":"e3d360574336bfb962ff035046b59875552e589825151b54301c967996c97ae7"}
Jul 17 19:31:26.750040 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.749923    2581 scope.go:117] "RemoveContainer" containerID="5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686"
Jul 17 19:31:26.761092 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.760824    2581 scope.go:117] "RemoveContainer" containerID="ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d"
Jul 17 19:31:26.769656 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.769634    2581 scope.go:117] "RemoveContainer" containerID="5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686"
Jul 17 19:31:26.770041 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:31:26.769999    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686\": container with ID starting with 5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686 not found: ID does not exist" containerID="5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686"
Jul 17 19:31:26.770091 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.770064    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686"} err="failed to get container status \"5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686\": rpc error: code = NotFound desc = could not find container \"5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686\": container with ID starting with 5f2515d056f0e385fcf150c0082ed394d592cdbf6c89d9f65cc8039599922686 not found: ID does not exist"
Jul 17 19:31:26.770134 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.770099    2581 scope.go:117] "RemoveContainer" containerID="ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d"
Jul 17 19:31:26.770494 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:31:26.770460    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d\": container with ID starting with ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d not found: ID does not exist" containerID="ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d"
Jul 17 19:31:26.770599 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.770508    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d"} err="failed to get container status \"ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d\": rpc error: code = NotFound desc = could not find container \"ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d\": container with ID starting with ce390c9bb3c101f38653eb730999914c0e3ccadf0373f693bd3905226d72c98d not found: ID does not exist"
Jul 17 19:31:26.849687 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.849656    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2abe7de0-49c5-43bf-be2e-24791d3d5159-istiod-ca-cert\") pod \"2abe7de0-49c5-43bf-be2e-24791d3d5159\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") "
Jul 17 19:31:26.849862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.849719    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-socket\") pod \"2abe7de0-49c5-43bf-be2e-24791d3d5159\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") "
Jul 17 19:31:26.849862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.849756    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-token\") pod \"2abe7de0-49c5-43bf-be2e-24791d3d5159\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") "
Jul 17 19:31:26.849862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.849790    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-certs\") pod \"2abe7de0-49c5-43bf-be2e-24791d3d5159\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") "
Jul 17 19:31:26.849862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.849813    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-envoy\") pod \"2abe7de0-49c5-43bf-be2e-24791d3d5159\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") "
Jul 17 19:31:26.850085 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.849865    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-credential-socket\") pod \"2abe7de0-49c5-43bf-be2e-24791d3d5159\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") "
Jul 17 19:31:26.850085 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.849937    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-data\") pod \"2abe7de0-49c5-43bf-be2e-24791d3d5159\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") "
Jul 17 19:31:26.850085 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.849971    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-podinfo\") pod \"2abe7de0-49c5-43bf-be2e-24791d3d5159\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") "
Jul 17 19:31:26.850085 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.850000    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqjv6\" (UniqueName: \"kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-kube-api-access-qqjv6\") pod \"2abe7de0-49c5-43bf-be2e-24791d3d5159\" (UID: \"2abe7de0-49c5-43bf-be2e-24791d3d5159\") "
Jul 17 19:31:26.850325 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.850086    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2abe7de0-49c5-43bf-be2e-24791d3d5159" (UID: "2abe7de0-49c5-43bf-be2e-24791d3d5159"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:31:26.850325 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.850103    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2abe7de0-49c5-43bf-be2e-24791d3d5159" (UID: "2abe7de0-49c5-43bf-be2e-24791d3d5159"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:31:26.850325 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.850120    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2abe7de0-49c5-43bf-be2e-24791d3d5159-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2abe7de0-49c5-43bf-be2e-24791d3d5159" (UID: "2abe7de0-49c5-43bf-be2e-24791d3d5159"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:31:26.850505 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.850392    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2abe7de0-49c5-43bf-be2e-24791d3d5159" (UID: "2abe7de0-49c5-43bf-be2e-24791d3d5159"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:31:26.850564 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.850535    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:26.850624 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.850553    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:26.850624 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.850586    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2abe7de0-49c5-43bf-be2e-24791d3d5159-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:26.850624 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.850599    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:26.850963 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.850941    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-data" (OuterVolumeSpecName: "istio-data") pod "2abe7de0-49c5-43bf-be2e-24791d3d5159" (UID: "2abe7de0-49c5-43bf-be2e-24791d3d5159"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:31:26.852425 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.852395    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-token" (OuterVolumeSpecName: "istio-token") pod "2abe7de0-49c5-43bf-be2e-24791d3d5159" (UID: "2abe7de0-49c5-43bf-be2e-24791d3d5159"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:31:26.852547 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.852437    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-kube-api-access-qqjv6" (OuterVolumeSpecName: "kube-api-access-qqjv6") pod "2abe7de0-49c5-43bf-be2e-24791d3d5159" (UID: "2abe7de0-49c5-43bf-be2e-24791d3d5159"). InnerVolumeSpecName "kube-api-access-qqjv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:31:26.852708 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.852688    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2abe7de0-49c5-43bf-be2e-24791d3d5159" (UID: "2abe7de0-49c5-43bf-be2e-24791d3d5159"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:31:26.852778 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.852746    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2abe7de0-49c5-43bf-be2e-24791d3d5159" (UID: "2abe7de0-49c5-43bf-be2e-24791d3d5159"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:31:26.951751 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.951720    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:26.951751 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.951746    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:26.951924 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.951756    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqjv6\" (UniqueName: \"kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-kube-api-access-qqjv6\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:26.951924 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.951767    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:26.951924 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:26.951776    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2abe7de0-49c5-43bf-be2e-24791d3d5159-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:27.755423 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:27.755394    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"
Jul 17 19:31:27.783256 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:27.783229    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"]
Jul 17 19:31:27.790270 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:27.790245    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-14077d-openshift-default-9bbb89967-vdt8h"]
Jul 17 19:31:28.486851 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:28.486812    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" path="/var/lib/kubelet/pods/2abe7de0-49c5-43bf-be2e-24791d3d5159/volumes"
Jul 17 19:31:44.501557 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:44.501524    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"]
Jul 17 19:31:44.502025 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:44.501754    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerName="istio-proxy" containerID="cri-o://a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9" gracePeriod=30
Jul 17 19:31:47.292894 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:47.292845    2581 patch_prober.go:28] interesting pod/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 19:31:47.293374 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:47.292917    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 19:31:49.760473 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.760449    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:31:49.855061 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.854975    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zbfw\" (UniqueName: \"kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-kube-api-access-9zbfw\") pod \"a7705f2e-24c6-49ea-ad21-83fa10182702\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") "
Jul 17 19:31:49.855256 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855101    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-socket\") pod \"a7705f2e-24c6-49ea-ad21-83fa10182702\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") "
Jul 17 19:31:49.855256 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855140    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-data\") pod \"a7705f2e-24c6-49ea-ad21-83fa10182702\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") "
Jul 17 19:31:49.855256 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855163    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-podinfo\") pod \"a7705f2e-24c6-49ea-ad21-83fa10182702\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") "
Jul 17 19:31:49.855256 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855183    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7705f2e-24c6-49ea-ad21-83fa10182702-istiod-ca-cert\") pod \"a7705f2e-24c6-49ea-ad21-83fa10182702\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") "
Jul 17 19:31:49.855256 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855242    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-credential-socket\") pod \"a7705f2e-24c6-49ea-ad21-83fa10182702\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") "
Jul 17 19:31:49.855532 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855396    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-certs\") pod \"a7705f2e-24c6-49ea-ad21-83fa10182702\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") "
Jul 17 19:31:49.855532 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855460    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-envoy\") pod \"a7705f2e-24c6-49ea-ad21-83fa10182702\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") "
Jul 17 19:31:49.855532 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855465    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7705f2e-24c6-49ea-ad21-83fa10182702" (UID: "a7705f2e-24c6-49ea-ad21-83fa10182702"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:31:49.855668 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855528    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7705f2e-24c6-49ea-ad21-83fa10182702" (UID: "a7705f2e-24c6-49ea-ad21-83fa10182702"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:31:49.855668 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855605    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7705f2e-24c6-49ea-ad21-83fa10182702-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7705f2e-24c6-49ea-ad21-83fa10182702" (UID: "a7705f2e-24c6-49ea-ad21-83fa10182702"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:31:49.855934 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855676    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7705f2e-24c6-49ea-ad21-83fa10182702" (UID: "a7705f2e-24c6-49ea-ad21-83fa10182702"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:31:49.855934 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855837    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7705f2e-24c6-49ea-ad21-83fa10182702-istiod-ca-cert\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:49.855934 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855857    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-credential-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:49.855934 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855870    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-certs\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:49.855934 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.855883    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-workload-socket\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:49.856236 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.856181    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7705f2e-24c6-49ea-ad21-83fa10182702" (UID: "a7705f2e-24c6-49ea-ad21-83fa10182702"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:31:49.857586 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.857540    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7705f2e-24c6-49ea-ad21-83fa10182702" (UID: "a7705f2e-24c6-49ea-ad21-83fa10182702"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 19:31:49.857704 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.857648    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-kube-api-access-9zbfw" (OuterVolumeSpecName: "kube-api-access-9zbfw") pod "a7705f2e-24c6-49ea-ad21-83fa10182702" (UID: "a7705f2e-24c6-49ea-ad21-83fa10182702"). InnerVolumeSpecName "kube-api-access-9zbfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:31:49.858100 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.858073    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7705f2e-24c6-49ea-ad21-83fa10182702" (UID: "a7705f2e-24c6-49ea-ad21-83fa10182702"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:31:49.862551 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.862525    2581 generic.go:356] "Generic (PLEG): container finished" podID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerID="a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9" exitCode=0
Jul 17 19:31:49.862677 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.862587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" event={"ID":"a7705f2e-24c6-49ea-ad21-83fa10182702","Type":"ContainerDied","Data":"a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9"}
Jul 17 19:31:49.862677 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.862586    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"
Jul 17 19:31:49.862677 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.862635    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz" event={"ID":"a7705f2e-24c6-49ea-ad21-83fa10182702","Type":"ContainerDied","Data":"3eebdec98a22c9165c5558b8d9bd48d0299499ccda875ef381bac747eb96f848"}
Jul 17 19:31:49.862831 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.862659    2581 scope.go:117] "RemoveContainer" containerID="a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9"
Jul 17 19:31:49.876191 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.876167    2581 scope.go:117] "RemoveContainer" containerID="aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d"
Jul 17 19:31:49.884159 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.884139    2581 scope.go:117] "RemoveContainer" containerID="a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9"
Jul 17 19:31:49.884484 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:31:49.884464    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9\": container with ID starting with a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9 not found: ID does not exist" containerID="a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9"
Jul 17 19:31:49.884549 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.884506    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9"} err="failed to get container status \"a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9\": rpc error: code = NotFound desc = could not find container \"a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9\": container with ID starting with a9f409b8ce38dad92d38048c8dbadeb618b5e8c8a44d454a15d8c2a5833772f9 not found: ID does not exist"
Jul 17 19:31:49.884549 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.884523    2581 scope.go:117] "RemoveContainer" containerID="aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d"
Jul 17 19:31:49.884780 ip-10-0-137-97 kubenswrapper[2581]: E0717 19:31:49.884765    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d\": container with ID starting with aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d not found: ID does not exist" containerID="aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d"
Jul 17 19:31:49.884817 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.884785    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d"} err="failed to get container status \"aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d\": rpc error: code = NotFound desc = could not find container \"aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d\": container with ID starting with aed34b8c07d178ac4f1fdeaa92ef6fdaa99e289a98a2626825313a2564407b9d not found: ID does not exist"
Jul 17 19:31:49.956217 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.956161    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-token\") pod \"a7705f2e-24c6-49ea-ad21-83fa10182702\" (UID: \"a7705f2e-24c6-49ea-ad21-83fa10182702\") "
Jul 17 19:31:49.956374 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.956332    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-data\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:49.956374 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.956343    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-podinfo\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:49.956374 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.956351    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-envoy\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:49.956374 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.956359    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zbfw\" (UniqueName: \"kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-kube-api-access-9zbfw\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:49.958339 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:49.958317    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7705f2e-24c6-49ea-ad21-83fa10182702" (UID: "a7705f2e-24c6-49ea-ad21-83fa10182702"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:31:50.057095 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:50.057062    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7705f2e-24c6-49ea-ad21-83fa10182702-istio-token\") on node \"ip-10-0-137-97.ec2.internal\" DevicePath \"\""
Jul 17 19:31:50.186797 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:50.186765    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"]
Jul 17 19:31:50.193384 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:50.193346    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-2dc31c-openshift-default-c78d567b7-vkjgz"]
Jul 17 19:31:50.492696 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:50.492616    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" path="/var/lib/kubelet/pods/a7705f2e-24c6-49ea-ad21-83fa10182702/volumes"
Jul 17 19:31:50.923621 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:50.923597    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xv658_ede9e12e-7711-420f-a38f-8bde4fb2465c/manager/0.log"
Jul 17 19:31:51.048704 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:51.048676    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r4xtq_33fc2e02-02eb-4def-8d52-925a5fca89ed/manager/0.log"
Jul 17 19:31:51.183843 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:51.183772    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76855646fc-vblmm_a3baac5e-e097-436d-b668-ff2a7b7c7a7e/manager/0.log"
Jul 17 19:31:51.312629 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:51.312603    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-z9wc7_9b041fd2-82b4-4fb8-9969-59f093c99ec2/server/0.log"
Jul 17 19:31:51.450965 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:51.450888    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xnjqq_1b614c3d-09b4-4244-aacb-d4a4cc04506d/manager/0.log"
Jul 17 19:31:51.721212 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:51.721125    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68969b7c46-6sgfl_9b71fbf1-06b3-4e7c-85a0-94375ed14697/copy-manifests/0.log"
Jul 17 19:31:51.730527 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:51.730504    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68969b7c46-6sgfl_9b71fbf1-06b3-4e7c-85a0-94375ed14697/manager/0.log"
Jul 17 19:31:52.275524 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:52.275495    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-768b5d7fc7-4k8tc_c25d8e16-441c-4dd9-bf58-664ad8873489/maas-api/0.log"
Jul 17 19:31:52.822451 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:52.822421    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-b82tf_4649beac-4e47-4b85-b60b-89655cb9e0d8/postgres/0.log"
Jul 17 19:31:54.380374 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:54.380344    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bppl7_ff3c898a-7698-4b63-960b-f4ecfa2b94fe/manager/0.log"
Jul 17 19:31:54.507463 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:54.507434    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-snjzz_81697aaf-6bdf-4062-8053-8f250af6bf47/manager/0.log"
Jul 17 19:31:54.638632 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:54.638553    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sgfh2_0b51a14e-ee10-48cf-a826-ca0cc962c6ae/kuadrant-console-plugin/0.log"
Jul 17 19:31:54.765718 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:54.765692    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-489sm_d9263662-4d16-4701-9871-d3219b8ade7f/registry-server/0.log"
Jul 17 19:31:55.171364 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:55.171337    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9p2ml_ef2af7c4-b849-4879-bbdc-116a02a5494f/manager/0.log"
Jul 17 19:31:55.538862 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:55.538783    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49hp6s_2ac788fc-b861-47d0-a419-30e8ac40b183/istio-proxy/0.log"
Jul 17 19:31:55.899979 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:55.899955    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f857f879-xflcc_83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9/kube-auth-proxy/0.log"
Jul 17 19:31:56.025042 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:56.025016    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-62rjv_fb7d507d-b164-4843-8d11-82d74270351d/istio-proxy/1.log"
Jul 17 19:31:56.149608 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:56.149579    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-cppg4_5c738dd9-1a42-4fd7-8f62-fad1d918fc8e/payload-pre-processing/0.log"
Jul 17 19:31:56.271732 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:56.271652    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-wwnbx_47032b35-5243-46dd-93bf-21574e71a004/payload-processing/0.log"
Jul 17 19:31:57.145823 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:57.145790    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbncdxg_7af51847-c793-4681-8af2-9055fcd4741f/main/0.log"
Jul 17 19:31:57.263329 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:57.263303    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rvxlj_58dbfd41-78da-4224-bfba-9633e68d3141/main/0.log"
Jul 17 19:31:57.380240 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:31:57.380189    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-ttrq4_39865097-253c-4937-9915-5b7288d166bc/main/0.log"
Jul 17 19:32:06.440736 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:06.440706    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fjrb2_3950912b-a457-4769-9d09-a5f1b30f3eec/global-pull-secret-syncer/0.log"
Jul 17 19:32:06.684768 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:06.684733    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9kkfc_0b99890e-d27a-4aa7-8c31-b0572eba43dc/konnectivity-agent/0.log"
Jul 17 19:32:06.802439 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:06.802364    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-97.ec2.internal_f0b6aa9c2776624cde641ff04a58f3d9/haproxy/0.log"
Jul 17 19:32:12.693435 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:12.693403    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bppl7_ff3c898a-7698-4b63-960b-f4ecfa2b94fe/manager/0.log"
Jul 17 19:32:12.789983 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:12.789959    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-snjzz_81697aaf-6bdf-4062-8053-8f250af6bf47/manager/0.log"
Jul 17 19:32:12.864215 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:12.864169    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sgfh2_0b51a14e-ee10-48cf-a826-ca0cc962c6ae/kuadrant-console-plugin/0.log"
Jul 17 19:32:13.024977 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:13.024893    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-489sm_d9263662-4d16-4701-9871-d3219b8ade7f/registry-server/0.log"
Jul 17 19:32:13.727803 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:13.727773    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9p2ml_ef2af7c4-b849-4879-bbdc-116a02a5494f/manager/0.log"
Jul 17 19:32:15.624288 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.624253    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fntx7_a4f3abf3-cf58-4820-81e6-d165979a05e7/node-exporter/0.log"
Jul 17 19:32:15.656749 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.656723    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fntx7_a4f3abf3-cf58-4820-81e6-d165979a05e7/kube-rbac-proxy/0.log"
Jul 17 19:32:15.683280 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.683260    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fntx7_a4f3abf3-cf58-4820-81e6-d165979a05e7/init-textfile/0.log"
Jul 17 19:32:15.799928 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.799900    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"]
Jul 17 19:32:15.800284 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800271    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerName="istio-proxy"
Jul 17 19:32:15.800332 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800285    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerName="istio-proxy"
Jul 17 19:32:15.800332 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800298    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerName="istio-proxy"
Jul 17 19:32:15.800332 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800304    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerName="istio-proxy"
Jul 17 19:32:15.800332 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800318    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18213d5d-b8ba-4530-8230-c24f2c72617f" containerName="main"
Jul 17 19:32:15.800332 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800324    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="18213d5d-b8ba-4530-8230-c24f2c72617f" containerName="main"
Jul 17 19:32:15.800489 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800380    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="18213d5d-b8ba-4530-8230-c24f2c72617f" containerName="main"
Jul 17 19:32:15.800489 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800387    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerName="istio-proxy"
Jul 17 19:32:15.800489 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800394    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2abe7de0-49c5-43bf-be2e-24791d3d5159" containerName="istio-proxy"
Jul 17 19:32:15.800489 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800399    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerName="istio-proxy"
Jul 17 19:32:15.800489 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.800405    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7705f2e-24c6-49ea-ad21-83fa10182702" containerName="istio-proxy"
Jul 17 19:32:15.805016 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.805000    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.807750 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.807730    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sqxlf\"/\"openshift-service-ca.crt\""
Jul 17 19:32:15.807874 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.807755    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sqxlf\"/\"kube-root-ca.crt\""
Jul 17 19:32:15.808714 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.808696    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sqxlf\"/\"default-dockercfg-r7slb\""
Jul 17 19:32:15.815530 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.815508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"]
Jul 17 19:32:15.874639 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.874566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-proc\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.874639 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.874596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-podres\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.874639 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.874624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-sys\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.874881 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.874705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2922x\" (UniqueName: \"kubernetes.io/projected/679a12f2-3194-4185-883c-ee383e5ae232-kube-api-access-2922x\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.874881 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.874819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-lib-modules\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.975439 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.975416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-lib-modules\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.975560 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.975462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-proc\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.975560 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.975480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-podres\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.975560 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.975506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-sys\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.975560 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.975542    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-proc\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.975734 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.975545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2922x\" (UniqueName: \"kubernetes.io/projected/679a12f2-3194-4185-883c-ee383e5ae232-kube-api-access-2922x\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.975734 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.975594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-lib-modules\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.975734 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.975606    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-sys\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.975734 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.975631    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/679a12f2-3194-4185-883c-ee383e5ae232-podres\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:15.984489 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:15.984468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2922x\" (UniqueName: \"kubernetes.io/projected/679a12f2-3194-4185-883c-ee383e5ae232-kube-api-access-2922x\") pod \"perf-node-gather-daemonset-cw5xv\" (UID: \"679a12f2-3194-4185-883c-ee383e5ae232\") " pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:16.115543 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:16.115517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:16.250303 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:16.250266    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"]
Jul 17 19:32:16.252426 ip-10-0-137-97 kubenswrapper[2581]: W0717 19:32:16.252401    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod679a12f2_3194_4185_883c_ee383e5ae232.slice/crio-d9f94987748a913df2c73c4acd9e036c26c939045a4247d47a4a30a270af7fa9 WatchSource:0}: Error finding container d9f94987748a913df2c73c4acd9e036c26c939045a4247d47a4a30a270af7fa9: Status 404 returned error can't find the container with id d9f94987748a913df2c73c4acd9e036c26c939045a4247d47a4a30a270af7fa9
Jul 17 19:32:16.990980 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:16.990946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv" event={"ID":"679a12f2-3194-4185-883c-ee383e5ae232","Type":"ContainerStarted","Data":"969cb618c5ff0c642c87b3dd81bfa880158fc079e7281e4b6983f865ab0e242b"}
Jul 17 19:32:16.991418 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:16.990997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv" event={"ID":"679a12f2-3194-4185-883c-ee383e5ae232","Type":"ContainerStarted","Data":"d9f94987748a913df2c73c4acd9e036c26c939045a4247d47a4a30a270af7fa9"}
Jul 17 19:32:16.991418 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:16.991098    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:17.008502 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:17.008445    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv" podStartSLOduration=2.008430119 podStartE2EDuration="2.008430119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:32:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:32:17.007293327 +0000 UTC m=+2857.001659352" watchObservedRunningTime="2026-07-17 19:32:17.008430119 +0000 UTC m=+2857.002796135"
Jul 17 19:32:20.760917 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:20.760881    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xn4lr_6eef5af9-ca64-4b9d-ba2a-f92daeac138a/dns/0.log"
Jul 17 19:32:20.796802 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:20.796775    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xn4lr_6eef5af9-ca64-4b9d-ba2a-f92daeac138a/kube-rbac-proxy/0.log"
Jul 17 19:32:20.841376 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:20.841354    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ftftv_f3c6d7b5-2b6b-4fb2-9799-0f9d8684cc01/dns-node-resolver/0.log"
Jul 17 19:32:21.724139 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:21.724109    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nn2j5_fea7de92-7c33-4085-99cd-5960f46575ba/node-ca/0.log"
Jul 17 19:32:22.842908 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:22.842877    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49hp6s_2ac788fc-b861-47d0-a419-30e8ac40b183/istio-proxy/0.log"
Jul 17 19:32:23.005876 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:23.005849    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sqxlf/perf-node-gather-daemonset-cw5xv"
Jul 17 19:32:23.198876 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:23.198852    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f857f879-xflcc_83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9/kube-auth-proxy/0.log"
Jul 17 19:32:23.233887 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:23.233848    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-62rjv_fb7d507d-b164-4843-8d11-82d74270351d/istio-proxy/0.log"
Jul 17 19:32:23.261616 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:23.261587    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-62rjv_fb7d507d-b164-4843-8d11-82d74270351d/istio-proxy/1.log"
Jul 17 19:32:23.299333 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:23.299307    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-cppg4_5c738dd9-1a42-4fd7-8f62-fad1d918fc8e/payload-pre-processing/0.log"
Jul 17 19:32:23.339097 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:23.339065    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-wwnbx_47032b35-5243-46dd-93bf-21574e71a004/payload-processing/0.log"
Jul 17 19:32:24.401241 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:24.400671    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wqjbd_da03649e-9174-41e4-ab07-1769081c3209/serve-healthcheck-canary/0.log"
Jul 17 19:32:25.219581 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:25.219508    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d8kxm_b3fb781a-3188-4e0e-b0ab-66086575e954/kube-rbac-proxy/0.log"
Jul 17 19:32:25.252417 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:25.252393    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d8kxm_b3fb781a-3188-4e0e-b0ab-66086575e954/exporter/0.log"
Jul 17 19:32:25.279103 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:25.279083    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d8kxm_b3fb781a-3188-4e0e-b0ab-66086575e954/extractor/0.log"
Jul 17 19:32:27.110848 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:27.110769    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49hp6s_2ac788fc-b861-47d0-a419-30e8ac40b183/istio-proxy/0.log"
Jul 17 19:32:27.384979 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:27.384905    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f857f879-xflcc_83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9/kube-auth-proxy/0.log"
Jul 17 19:32:27.413538 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:27.413511    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-62rjv_fb7d507d-b164-4843-8d11-82d74270351d/istio-proxy/0.log"
Jul 17 19:32:27.440588 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:27.440564    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-62rjv_fb7d507d-b164-4843-8d11-82d74270351d/istio-proxy/1.log"
Jul 17 19:32:27.467386 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:27.467368    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-cppg4_5c738dd9-1a42-4fd7-8f62-fad1d918fc8e/payload-pre-processing/0.log"
Jul 17 19:32:27.488601 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:27.488583    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-wwnbx_47032b35-5243-46dd-93bf-21574e71a004/payload-processing/0.log"
Jul 17 19:32:27.985756 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:27.985724    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xv658_ede9e12e-7711-420f-a38f-8bde4fb2465c/manager/0.log"
Jul 17 19:32:28.195937 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:28.195907    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r4xtq_33fc2e02-02eb-4def-8d52-925a5fca89ed/manager/0.log"
Jul 17 19:32:28.319044 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:28.318962    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76855646fc-vblmm_a3baac5e-e097-436d-b668-ff2a7b7c7a7e/manager/0.log"
Jul 17 19:32:28.349756 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:28.349734    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-z9wc7_9b041fd2-82b4-4fb8-9969-59f093c99ec2/server/0.log"
Jul 17 19:32:28.430193 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:28.430153    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xnjqq_1b614c3d-09b4-4244-aacb-d4a4cc04506d/manager/0.log"
Jul 17 19:32:28.519401 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:28.519365    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68969b7c46-6sgfl_9b71fbf1-06b3-4e7c-85a0-94375ed14697/manager/0.log"
Jul 17 19:32:28.548886 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:28.548863    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68969b7c46-6sgfl_9b71fbf1-06b3-4e7c-85a0-94375ed14697/copy-manifests/0.log"
Jul 17 19:32:28.667469 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:28.667434    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf49hp6s_2ac788fc-b861-47d0-a419-30e8ac40b183/istio-proxy/0.log"
Jul 17 19:32:28.973438 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:28.973365    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f857f879-xflcc_83e7e1e6-24e2-4e41-b69e-af9ffd3d3fb9/kube-auth-proxy/0.log"
Jul 17 19:32:29.010638 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:29.010612    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-62rjv_fb7d507d-b164-4843-8d11-82d74270351d/istio-proxy/0.log"
Jul 17 19:32:29.036766 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:29.036741    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-62rjv_fb7d507d-b164-4843-8d11-82d74270351d/istio-proxy/1.log"
Jul 17 19:32:29.065788 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:29.065763    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-cppg4_5c738dd9-1a42-4fd7-8f62-fad1d918fc8e/payload-pre-processing/0.log"
Jul 17 19:32:29.096569 ip-10-0-137-97 kubenswrapper[2581]: I0717 19:32:29.096531    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-wwnbx_47032b35-5243-46dd-93bf-21574e71a004/payload-processing/0.log"