Jul 02 23:10:31.716443 ip-10-0-137-25 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.110895    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115276    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115288    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115292    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115296    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115298    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115301    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115304    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:32.147594 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115307    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115309    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115312    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115314    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115317    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115319    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115322    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115324    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115327    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115330    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115332    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115336    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115339    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115342    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115344    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115347    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115350    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115353    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115355    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:32.150042 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115358    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115361    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115363    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115366    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115369    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115371    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115374    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115376    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115379    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115382    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115385    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115387    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115391    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115393    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115396    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115399    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115401    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115405    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115407    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115410    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:32.150641 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115413    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115415    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115418    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115420    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115423    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115425    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115428    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115431    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115433    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115438    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115441    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115444    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115447    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115450    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115453    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115455    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115458    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115460    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115463    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:32.151247 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115465    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115467    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115470    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115473    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115476    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115479    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115481    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115484    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115486    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115489    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115492    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115495    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115497    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115500    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115502    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115505    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115507    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115509    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115512    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115516    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:32.151809 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115518    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115521    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115523    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115526    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115528    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115531    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115535    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115539    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115544    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115547    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115549    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115553    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115556    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.115559    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117787    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117796    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117800    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117803    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117806    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:32.152391 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117809    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117812    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117815    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117817    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117820    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117823    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117826    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117828    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117831    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117833    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117836    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117839    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117841    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117843    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117846    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117849    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117851    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117854    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117857    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117859    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:32.152924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117862    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117865    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117867    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117870    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117872    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117875    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117878    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117880    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117883    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117885    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117888    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117891    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117894    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117896    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117899    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117902    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117904    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117907    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117909    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117912    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:32.153492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117914    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117917    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117920    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117923    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117926    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117928    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117931    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117933    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117936    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117940    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117943    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117946    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117951    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117954    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117957    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117960    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117963    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117965    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117968    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:32.154214 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117972    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117975    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117978    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117981    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117984    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117987    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117990    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117993    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.117995    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118000    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118003    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118005    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118008    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118011    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118014    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118016    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118019    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118021    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118024    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118026    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:32.154721 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118030    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118032    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118035    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118037    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118040    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118045    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118048    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118050    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118053    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118056    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118058    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118061    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118063    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118066    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118069    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118451    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118456    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118460    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118462    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118465    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:32.155351 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118468    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118472    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118475    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118477    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118480    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118483    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118485    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118487    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118490    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118493    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118495    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118498    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118500    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118503    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118505    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118507    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118510    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118515    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118517    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118520    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:32.155872 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118522    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118525    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118527    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118530    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118532    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118535    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118537    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118540    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118542    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118545    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118548    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118552    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118555    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118560    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118563    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118566    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118569    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118572    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118574    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:32.294737 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118577    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:32.191510 ip-10-0-137-25 systemd[1]: Started Kubernetes Kubelet.
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118579    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118581    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118584    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118587    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118589    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118591    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118594    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118597    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118600    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118603    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118606    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118608    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118612    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118616    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118620    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118623    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118626    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118629    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:32.311992 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118632    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118634    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118639    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118641    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118644    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118647    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118650    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118656    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118659    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118661    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118664    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118666    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118669    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118671    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118674    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118677    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118679    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118682    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118684    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118686    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:32.313113 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118689    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118691    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118694    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118698    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118700    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118703    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118705    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118707    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118710    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118712    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118715    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118718    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118720    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118723    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118725    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.118727    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118793    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118804    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118811    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118816    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118820    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 23:10:32.314278 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118824    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118827    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118831    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118834    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118837    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118841    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118844    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118847    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118850    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118852    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118855    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118858    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118861    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118865    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118869    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118872    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118875    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118878    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118882    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118885    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118888    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118891    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118894    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118897    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 23:10:32.315455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118900    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118903    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118906    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118910    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118913    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118915    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118920    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118923    2568 flags.go:64] FLAG: --enable-server="true"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118926    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118930    2568 flags.go:64] FLAG: --event-burst="100"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118933    2568 flags.go:64] FLAG: --event-qps="50"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118936    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118939    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118942    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118945    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118948    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118951    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118954    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118957    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118960    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118963    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118965    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118969    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118972    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118975    2568 flags.go:64] FLAG: --feature-gates=""
Jul 02 23:10:32.316457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118979    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118981    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118984    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118987    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118990    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118993    2568 flags.go:64] FLAG: --help="false"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118996    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-137-25.ec2.internal"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.118999    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119002    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119005    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119008    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119012    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119014    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119018    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119022    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119024    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119027    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119030    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119033    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119036    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119038    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119041    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119044    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119047    2568 flags.go:64] FLAG: --lock-file=""
Jul 02 23:10:32.317501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119049    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119052    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119055    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119060    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119064    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119068    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119071    2568 flags.go:64] FLAG: --logging-format="text"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119073    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119077    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119080    2568 flags.go:64] FLAG: --manifest-url=""
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119082    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119089    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119092    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119096    2568 flags.go:64] FLAG: --max-pods="110"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119099    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119102    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119105    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119108    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119111    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119114    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119116    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119124    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119127    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119130    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 23:10:32.318324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119133    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119136    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119141    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119145    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119147    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119150    2568 flags.go:64] FLAG: --port="10250"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119153    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119156    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05fd2aa9ef56be777"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119176    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119179    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119182    2568 flags.go:64] FLAG: --register-node="true"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119185    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119189    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119192    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119195    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119198    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119202    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119205    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119208    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119210    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119213    2568 flags.go:64] FLAG: --runonce="false"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119216    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119219    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119222    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119225    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 23:10:32.319055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119228    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119230    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119233    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119236    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119240    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119243    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119246    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119249    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119252    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119255    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119258    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119263    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119266    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119268    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119272    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119275    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119277    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119280    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119283    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119286    2568 flags.go:64] FLAG: --v="2"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119290    2568 flags.go:64] FLAG: --version="false"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119295    2568 flags.go:64] FLAG: --vmodule=""
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119299    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.119302    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119411    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:32.320043 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119414    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119418    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119420    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119423    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119426    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119429    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119432    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119435    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119438    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119441    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119443    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119448    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119451    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119454    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119456    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119460    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119463    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119465    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119468    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119470    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:32.320839 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119473    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119475    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119478    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119481    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119483    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119486    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119488    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119492    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119498    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119501    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119504    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119507    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119509    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119512    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119515    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119517    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119520    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119523    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119525    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:32.321590 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119528    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119530    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119533    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119535    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119539    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119542    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119544    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119547    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119549    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119552    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119555    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119557    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119560    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119562    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119565    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119567    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119570    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119573    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119575    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119578    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:32.322155 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119580    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119585    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119589    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119592    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119595    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119599    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119602    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119606    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119608    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119611    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119613    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119616    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119619    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119621    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119624    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119626    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119630    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119632    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119635    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:32.322799 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119637    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119640    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119642    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119646    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119648    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119651    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119654    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119656    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119659    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119661    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119664    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119666    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119669    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119671    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119676    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119678    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119681    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119684    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119686    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:32.323340 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.119689    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.120486    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.132426    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.132441    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.133262    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.133270    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133327    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133332    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133335    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133338    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133342    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133344    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133347    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133350    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133353    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:32.470735 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133356    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133359    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133362    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133365    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133368    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133371    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133374    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133376    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133379    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133382    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133385    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133388    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133391    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133394    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133397    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133399    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133402    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133405    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133410    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133413    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:32.471547 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133416    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133418    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133422    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133425    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133428    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133430    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133433    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133436    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133438    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133442    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133446    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133449    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133452    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133455    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133458    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133461    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133464    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133467    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133470    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:32.472921 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133472    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133475    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133478    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133480    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133483    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133485    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133489    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133493    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133496    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133498    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133501    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133505    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133508    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133511    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133513    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133518    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133521    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133524    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133527    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:32.473492 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133530    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133534    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133538    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133541    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133544    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133546    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133549    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133552    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133554    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133557    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133560    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133562    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133565    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133568    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133571    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133573    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133576    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133578    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133581    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:32.474073 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133583    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133586    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133588    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133591    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133593    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133597    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133599    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133602    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133604    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133609    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133612    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133615    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133617    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.133622    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133733    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:32.475083 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133738    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133741    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133744    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133747    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133750    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133753    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133756    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133759    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133762    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133765    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133767    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133770    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133773    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133775    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133778    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133780    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133783    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133785    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133787    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133790    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:32.475552 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133793    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133795    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133799    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133802    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133804    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133807    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133810    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133813    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133816    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133818    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133821    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133823    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133826    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133828    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133831    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133833    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133836    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133838    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133841    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133844    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:32.476103 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133846    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133849    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133851    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133854    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133858    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133862    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133864    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133867    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133869    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133872    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133874    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133877    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133879    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133882    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133887    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133889    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133892    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133895    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133897    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:32.476751 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133901    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133904    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133906    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133909    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133911    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133914    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133916    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133919    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133922    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133924    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133927    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133929    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133932    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133934    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133937    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133940    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133942    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133945    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133949    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:32.477322 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133953    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133957    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133960    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133962    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133965    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133968    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133971    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133974    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133977    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133980    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133983    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133985    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133988    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133991    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133994    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133997    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.133999    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.134002    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.134005    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:32.477924 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:32.134007    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.134012    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.134113    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.136305    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.137639    2568 server.go:1019] "Starting client certificate rotation"
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.137744    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.137772    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.140291    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.141589    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.153366    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.155641    2568 log.go:25] "Validated CRI v1 image API"
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.156481    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 23:10:32.478622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.159415    2568 fs.go:135] Filesystem UUIDs: map[04fa37e2-2c1c-44ae-881b-51ea8792d8d1:/dev/nvme0n1p4 4a11274d-4e7f-4ffd-8879-51783fcd8705:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 02 23:10:32.479005 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.159430    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 23:10:32.479200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.166754    2568 manager.go:216] Machine: {Timestamp:2026-07-02 23:10:32.165043894 +0000 UTC m=+0.341811546 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114248 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a895217e39ebfe4c502d4a219026 SystemUUID:ec21a895-217e-39eb-fe4c-502d4a219026 BootID:3cc84ab9-d558-4c7d-a373-9a9d427a93c6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b4:f9:65:e6:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b4:f9:65:e6:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:5d:7b:32:b1:ea Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 23:10:32.479200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.167080    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 23:10:32.479200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.167228    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 23:10:32.479200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.170609    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:10:32.479200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.170819    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 23:10:32.479200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.170850    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 23:10:32.479200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.171481    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.171490    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.171498    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.172049    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.173622    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.177180    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.177300    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.177329    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.177339    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.177354    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.177362    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.177370    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.177682    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.177696    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.179552    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.181380    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.181408    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182410    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182426    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182432    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182438    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182449    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182458    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182470    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182479    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182489    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182495    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182503    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182510    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182536    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.182542    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.187918    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zctfg"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.189303    2568 server.go:1268] "Started kubelet"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.189774    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.189840    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.190360    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.190463    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.190615    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.190684    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.191061    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 23:10:32.479536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.192140    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.192810    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-25.ec2.internal.18be9bd2ce2547ad  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-25.ec2.internal,UID:ip-10-0-137-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-25.ec2.internal,},FirstTimestamp:2026-07-02 23:10:32.189282221 +0000 UTC m=+0.366049872,LastTimestamp:2026-07-02 23:10:32.189282221 +0000 UTC m=+0.366049872,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-25.ec2.internal,}"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.195562    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zctfg"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.197172    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.200675    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.200690    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.200748    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201237    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201275    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201290    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201382    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201390    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201525    2568 factory.go:55] Registering systemd factory
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201537    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201736    2568 factory.go:153] Registering CRI-O factory
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201749    2568 factory.go:223] Registration of the crio container factory successfully
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201790    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201809    2568 factory.go:103] Registering Raw factory
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.201823    2568 manager.go:1196] Started watching for new ooms in manager
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.202423    2568 manager.go:349] Starting recovery of all containers
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.213675    2568 manager.go:354] Recovery completed
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.218003    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.219952    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.219980    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.219993    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.220090    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.220140    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.220596    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.220610    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.220628    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.220611    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.221342    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:34.365759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.221367    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.221375    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.224801    2568 policy_none.go:49] "None policy: Start"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.224815    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.224825    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.225892    2568 policy_none.go:47] "Start"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.288847    2568 manager.go:337] "Starting Device Plugin manager"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.288887    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.288900    2568 server.go:87] "Starting device plugin registration server"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.289242    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.289255    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.289336    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.289426    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.289437    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.290128    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.290195    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.350555    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.351928    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.351967    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.351993    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.352032    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.355017    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.390289    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.391547    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.391581    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.391595    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.391624    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.398327    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.398346    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-25.ec2.internal\": node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.410196    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.452540    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal"]
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.452608    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.453979    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.453999    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.454022    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.455436    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.455623    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.455664    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:34.367192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.457284    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.457300    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.457309    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.457498    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.457513    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.457521    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.458565    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.458583    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.459180    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.459205    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:32.459214    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.493762    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-25.ec2.internal\" not found" node="ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.498218    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-25.ec2.internal\" not found" node="ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:32.513111    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.325558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/473300bc9019cc21b12b801a14fc1b1d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-25.ec2.internal\" (UID: \"473300bc9019cc21b12b801a14fc1b1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.325587    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02e998e40fba42fc181152b7daac8401-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal\" (UID: \"02e998e40fba42fc181152b7daac8401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.325608    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02e998e40fba42fc181152b7daac8401-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal\" (UID: \"02e998e40fba42fc181152b7daac8401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.368247 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:34.334094    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.495912 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.426170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/473300bc9019cc21b12b801a14fc1b1d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-25.ec2.internal\" (UID: \"473300bc9019cc21b12b801a14fc1b1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.495912 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.426189    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/473300bc9019cc21b12b801a14fc1b1d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-25.ec2.internal\" (UID: \"473300bc9019cc21b12b801a14fc1b1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.495912 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.426220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02e998e40fba42fc181152b7daac8401-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal\" (UID: \"02e998e40fba42fc181152b7daac8401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.495912 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.426268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02e998e40fba42fc181152b7daac8401-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal\" (UID: \"02e998e40fba42fc181152b7daac8401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.495912 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.426302    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02e998e40fba42fc181152b7daac8401-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal\" (UID: \"02e998e40fba42fc181152b7daac8401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.495912 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.426305    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02e998e40fba42fc181152b7daac8401-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal\" (UID: \"02e998e40fba42fc181152b7daac8401\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.495912 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:34.434188    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.594350 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.517396    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.594350 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.520997    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:34.594350 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:34.535215    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.794803 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:34.635706    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.794803 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:34.736158    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.949712 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:34.836872    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-25.ec2.internal\" not found"
Jul 02 23:10:34.949712 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.858015    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 23:10:34.949712 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.858128    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 23:10:34.949712 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.922778    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 23:05:33 +0000 UTC" deadline="2028-03-08 01:38:38.74388284 +0000 UTC"
Jul 02 23:10:34.949712 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.922813    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14738h28m3.821075131s"
Jul 02 23:10:34.949712 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:34.933146    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:35.062739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.022114    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:35.062739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.031510    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:10:35.062739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.033272    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal"
Jul 02 23:10:35.062739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.042847    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:10:35.210977 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:35.144810    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e998e40fba42fc181152b7daac8401.slice/crio-34255a217df4d7928cb02480138d55f4cb44817675f7dfc2e1669c0a2c0ab9f3 WatchSource:0}: Error finding container 34255a217df4d7928cb02480138d55f4cb44817675f7dfc2e1669c0a2c0ab9f3: Status 404 returned error can't find the container with id 34255a217df4d7928cb02480138d55f4cb44817675f7dfc2e1669c0a2c0ab9f3
Jul 02 23:10:35.210977 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:35.145209    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473300bc9019cc21b12b801a14fc1b1d.slice/crio-6de821339af2dfc409c73141c4c6201847312a39bc9891f49dabc6d817b431d1 WatchSource:0}: Error finding container 6de821339af2dfc409c73141c4c6201847312a39bc9891f49dabc6d817b431d1: Status 404 returned error can't find the container with id 6de821339af2dfc409c73141c4c6201847312a39bc9891f49dabc6d817b431d1
Jul 02 23:10:35.210977 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.149404    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:10:35.502364 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.502322    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:35.504170 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.504152    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:35.900062 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.900031    2568 apiserver.go:52] "Watching apiserver"
Jul 02 23:10:35.905833 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.905793    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 23:10:35.907145 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.907121    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-6x2mn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq","openshift-cluster-node-tuning-operator/tuned-n6drb","openshift-dns/node-resolver-wng7s","openshift-multus/multus-additional-cni-plugins-rgmhn","openshift-network-operator/iptables-alerter-zpmlt","openshift-ovn-kubernetes/ovnkube-node-dssnd","kube-system/global-pull-secret-syncer-62bxx","kube-system/konnectivity-agent-jddwq","kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal","openshift-image-registry/node-ca-fvxjh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal","openshift-multus/multus-hm7qm","openshift-multus/network-metrics-daemon-95xd7"]
Jul 02 23:10:35.908979 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.908958    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:35.910425 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.910409    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:35.912049 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.911560    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 23:10:35.912049 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.911577    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 23:10:35.912049 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.911767    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 23:10:35.912049 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.911851    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 23:10:35.912049 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.911927    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 23:10:35.912049 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.912016    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xqlnh\""
Jul 02 23:10:35.912434 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.912108    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 23:10:35.912530 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.912498    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9f7ph\""
Jul 02 23:10:35.912594 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.912574    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 23:10:35.912640 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.912631    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 23:10:35.912870 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.912848    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 23:10:35.913040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.913025    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 23:10:35.915127 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.913397    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:35.915127 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.914528    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:35.917849 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.916499    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:35.917849 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.916863    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:35.917849 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.917079    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9sl5w\""
Jul 02 23:10:35.917849 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.917244    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 23:10:35.917849 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.917486    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 23:10:35.917849 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.917700    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 23:10:35.919634 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.919262    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:35.920552 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.920023    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qwbg9\""
Jul 02 23:10:35.921315 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.920954    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 23:10:35.921315 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.920972    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sjgtt\""
Jul 02 23:10:35.921755 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.921493    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:35.922398 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.922335    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 23:10:35.922473 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.922428    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 23:10:35.922848 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.922800    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 23:10:35.923295 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.923279    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2756p\""
Jul 02 23:10:35.923776 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.922343    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 23:10:35.925626 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.925608    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:35.925747 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:35.925707    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:35.926138 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.926121    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:35.926227 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.926208    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 23:10:35.926472 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.926449    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rgs2g\""
Jul 02 23:10:35.926695 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.926664    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:35.926776 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.926667    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 23:10:35.930411 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.930394    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 23:10:35.930583 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.930463    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 23:10:35.930694 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.930654    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:35.930778 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:35.930754    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:35.931258 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.931235    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rzkxm\""
Jul 02 23:10:35.931403 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.931369    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 23:10:35.932501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.932360    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:35.933460 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.933439    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:35.933577 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:35.933515    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:35.934448 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.934428    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 23:10:35.934658 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.934642    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 23:10:35.934896 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.934881    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 23:10:35.935318 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.935301    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mj9d8\""
Jul 02 23:10:35.937088 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.937066    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:10:35.960607 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.960587    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2t9nq"
Jul 02 23:10:35.968293 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:35.968273    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2t9nq"
Jul 02 23:10:36.009449 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009424    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7nhk\" (UniqueName: \"kubernetes.io/projected/f22aa5c9-7486-43c8-9f4a-f8079561f43d-kube-api-access-d7nhk\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.009554 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-system-cni-dir\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.009554 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-hostroot\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.009554 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009532    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2-tmp-dir\") pod \"node-resolver-wng7s\" (UID: \"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2\") " pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:36.009655 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-cnibin\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.009655 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009577    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f22aa5c9-7486-43c8-9f4a-f8079561f43d-cni-binary-copy\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.009655 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009599    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/536d7d82-a22e-44e5-be71-fb5d9d271e55-ovnkube-script-lib\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.009655 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009622    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-var-lib-cni-multus\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.009655 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009645    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trdzz\" (UniqueName: \"kubernetes.io/projected/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-kube-api-access-trdzz\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.009910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-run\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.009910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009711    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f22aa5c9-7486-43c8-9f4a-f8079561f43d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.009910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009743    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-cni-netd\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.009910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009768    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/536d7d82-a22e-44e5-be71-fb5d9d271e55-ovnkube-config\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.009910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-os-release\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.009910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009816    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-systemd-units\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.009910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009840    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-run-multus-certs\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.009910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009860    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-sysctl-d\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.009910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009890    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-lib-modules\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-run-openvswitch\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009938    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/536d7d82-a22e-44e5-be71-fb5d9d271e55-ovn-node-metrics-cert\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-sysconfig\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.009997    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18d6352c-e630-4530-ab2b-246bd97aae1d-agent-certs\") pod \"konnectivity-agent-jddwq\" (UID: \"18d6352c-e630-4530-ab2b-246bd97aae1d\") " pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010020    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slmm6\" (UniqueName: \"kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6\") pod \"network-check-target-6x2mn\" (UID: \"d5a92ab5-3480-4de0-99e0-189894ce5f0e\") " pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010048    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-run-systemd\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010070    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-node-log\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010091    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-run-ovn\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010115    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-log-socket\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010138    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f22aa5c9-7486-43c8-9f4a-f8079561f43d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/143a77db-bc3b-4f80-8fd8-8532250c8df1-host-slash\") pod \"iptables-alerter-zpmlt\" (UID: \"143a77db-bc3b-4f80-8fd8-8532250c8df1\") " pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-slash\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010240    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-var-lib-openvswitch\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010265    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-var-lib-kubelet\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010288    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjvlf\" (UniqueName: \"kubernetes.io/projected/990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2-kube-api-access-jjvlf\") pod \"node-resolver-wng7s\" (UID: \"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2\") " pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010312    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-etc-openvswitch\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80be22ab-b20c-450f-9be4-915d96bb2566-tmp\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010358    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-cni-bin\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010388    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010412    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-cni-binary-copy\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010434    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-kubelet\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010457    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-run-k8s-cni-cncf-io\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-daemon-config\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010559    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-modprobe-d\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010584    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-kubernetes\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-run-ovn-kubernetes\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010640    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-socket-dir-parent\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.010963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010664    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-systemd\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010737    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-system-cni-dir\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010773    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18d6352c-e630-4530-ab2b-246bd97aae1d-konnectivity-ca\") pod \"konnectivity-agent-jddwq\" (UID: \"18d6352c-e630-4530-ab2b-246bd97aae1d\") " pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010814    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/536d7d82-a22e-44e5-be71-fb5d9d271e55-env-overrides\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010842    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-run-netns\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010866    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-sysctl-conf\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010892    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-os-release\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-cni-dir\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010955    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-cnibin\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.010986    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-etc-kubernetes\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011025    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-var-lib-kubelet\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011053    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-host\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011082    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/143a77db-bc3b-4f80-8fd8-8532250c8df1-iptables-alerter-script\") pod \"iptables-alerter-zpmlt\" (UID: \"143a77db-bc3b-4f80-8fd8-8532250c8df1\") " pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011113    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfqqd\" (UniqueName: \"kubernetes.io/projected/143a77db-bc3b-4f80-8fd8-8532250c8df1-kube-api-access-xfqqd\") pod \"iptables-alerter-zpmlt\" (UID: \"143a77db-bc3b-4f80-8fd8-8532250c8df1\") " pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:36.011584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011143    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwxsl\" (UniqueName: \"kubernetes.io/projected/536d7d82-a22e-44e5-be71-fb5d9d271e55-kube-api-access-lwxsl\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.012233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011165    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-var-lib-cni-bin\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.012233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-conf-dir\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.012233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-sys\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.012233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011248    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80be22ab-b20c-450f-9be4-915d96bb2566-etc-tuned\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.012233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011270    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w72xb\" (UniqueName: \"kubernetes.io/projected/80be22ab-b20c-450f-9be4-915d96bb2566-kube-api-access-w72xb\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.012233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011288    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.012233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011302    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-run-netns\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.012233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.011316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2-hosts-file\") pod \"node-resolver-wng7s\" (UID: \"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2\") " pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:36.023359 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.023337    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 23:10:36.086719 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.086648    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal" event={"ID":"02e998e40fba42fc181152b7daac8401","Type":"ContainerStarted","Data":"34255a217df4d7928cb02480138d55f4cb44817675f7dfc2e1669c0a2c0ab9f3"}
Jul 02 23:10:36.087900 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.087875    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal" event={"ID":"473300bc9019cc21b12b801a14fc1b1d","Type":"ContainerStarted","Data":"6de821339af2dfc409c73141c4c6201847312a39bc9891f49dabc6d817b431d1"}
Jul 02 23:10:36.111638 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-sys-fs\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.111638 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111635    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:36.111805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111651    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6cxf\" (UniqueName: \"kubernetes.io/projected/f98f8c84-58ec-4aa4-b876-0b85ee7c203f-kube-api-access-s6cxf\") pod \"node-ca-fvxjh\" (UID: \"f98f8c84-58ec-4aa4-b876-0b85ee7c203f\") " pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:36.111805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111688    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18d6352c-e630-4530-ab2b-246bd97aae1d-agent-certs\") pod \"konnectivity-agent-jddwq\" (UID: \"18d6352c-e630-4530-ab2b-246bd97aae1d\") " pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:36.111805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111713    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmm6\" (UniqueName: \"kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6\") pod \"network-check-target-6x2mn\" (UID: \"d5a92ab5-3480-4de0-99e0-189894ce5f0e\") " pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:36.111805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-run-systemd\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.111992 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111814    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-run-systemd\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.111992 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-node-log\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.111992 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111881    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/13d09a11-ac14-43c3-915a-34f5c085d0d4-dbus\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:36.111992 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111914    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-run-ovn\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.111992 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f98f8c84-58ec-4aa4-b876-0b85ee7c203f-host\") pod \"node-ca-fvxjh\" (UID: \"f98f8c84-58ec-4aa4-b876-0b85ee7c203f\") " pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:36.111992 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111935    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-node-log\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.111992 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.111976    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-log-socket\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112006    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-run-ovn\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112031    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f22aa5c9-7486-43c8-9f4a-f8079561f43d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.112313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/143a77db-bc3b-4f80-8fd8-8532250c8df1-host-slash\") pod \"iptables-alerter-zpmlt\" (UID: \"143a77db-bc3b-4f80-8fd8-8532250c8df1\") " pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:36.112313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112088    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-slash\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112139    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/143a77db-bc3b-4f80-8fd8-8532250c8df1-host-slash\") pod \"iptables-alerter-zpmlt\" (UID: \"143a77db-bc3b-4f80-8fd8-8532250c8df1\") " pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:36.112313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112140    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-slash\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112160    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 23:10:36.112313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-var-lib-openvswitch\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112264    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-var-lib-kubelet\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.112313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112281    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjvlf\" (UniqueName: \"kubernetes.io/projected/990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2-kube-api-access-jjvlf\") pod \"node-resolver-wng7s\" (UID: \"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2\") " pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112341    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-log-socket\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112359    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-var-lib-kubelet\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112364    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-registration-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112416    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-var-lib-openvswitch\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112420    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-etc-openvswitch\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112447    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80be22ab-b20c-450f-9be4-915d96bb2566-tmp\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f98f8c84-58ec-4aa4-b876-0b85ee7c203f-serviceca\") pod \"node-ca-fvxjh\" (UID: \"f98f8c84-58ec-4aa4-b876-0b85ee7c203f\") " pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112505    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-cni-bin\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-cni-binary-copy\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112583    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112591    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-cni-bin\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112529    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-etc-openvswitch\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.112805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112589    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-device-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112581    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f22aa5c9-7486-43c8-9f4a-f8079561f43d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112691    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-kubelet\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-run-k8s-cni-cncf-io\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112767    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-run-k8s-cni-cncf-io\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112770    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-kubelet\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112811    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-daemon-config\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-modprobe-d\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112864    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-kubernetes\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112894    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/13d09a11-ac14-43c3-915a-34f5c085d0d4-kubelet-config\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112927    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-run-ovn-kubernetes\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112948    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-modprobe-d\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112950    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-socket-dir-parent\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.113724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112960    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-kubernetes\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.112991    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-systemd\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113015    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-system-cni-dir\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113055    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-socket-dir-parent\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18d6352c-e630-4530-ab2b-246bd97aae1d-konnectivity-ca\") pod \"konnectivity-agent-jddwq\" (UID: \"18d6352c-e630-4530-ab2b-246bd97aae1d\") " pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113092    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/536d7d82-a22e-44e5-be71-fb5d9d271e55-env-overrides\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113091    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-cni-binary-copy\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113121    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-run-netns\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113133    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-run-ovn-kubernetes\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113146    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-sysctl-conf\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113174    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd5xd\" (UniqueName: \"kubernetes.io/projected/f9b03d41-3bec-45a0-9655-41c67a514ff4-kube-api-access-nd5xd\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113187    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-systemd\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-os-release\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-cni-dir\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-cnibin\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.114422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113284    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-daemon-config\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113291    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-etc-kubernetes\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-var-lib-kubelet\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113338    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-host\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113362    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7bx7\" (UniqueName: \"kubernetes.io/projected/026c3575-2cc8-4c9a-a2e2-344a301e0559-kube-api-access-r7bx7\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113365    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-system-cni-dir\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/143a77db-bc3b-4f80-8fd8-8532250c8df1-iptables-alerter-script\") pod \"iptables-alerter-zpmlt\" (UID: \"143a77db-bc3b-4f80-8fd8-8532250c8df1\") " pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113412    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfqqd\" (UniqueName: \"kubernetes.io/projected/143a77db-bc3b-4f80-8fd8-8532250c8df1-kube-api-access-xfqqd\") pod \"iptables-alerter-zpmlt\" (UID: \"143a77db-bc3b-4f80-8fd8-8532250c8df1\") " pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113413    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-run-netns\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113437    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwxsl\" (UniqueName: \"kubernetes.io/projected/536d7d82-a22e-44e5-be71-fb5d9d271e55-kube-api-access-lwxsl\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-var-lib-cni-bin\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-conf-dir\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113489    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/536d7d82-a22e-44e5-be71-fb5d9d271e55-env-overrides\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113509    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-sys\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.115251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113527    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-sysctl-conf\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113536    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80be22ab-b20c-450f-9be4-915d96bb2566-etc-tuned\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113546    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-host\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113579    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-cnibin\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113582    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-etc-kubernetes\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113614    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-var-lib-kubelet\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113646    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-os-release\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113689    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18d6352c-e630-4530-ab2b-246bd97aae1d-konnectivity-ca\") pod \"konnectivity-agent-jddwq\" (UID: \"18d6352c-e630-4530-ab2b-246bd97aae1d\") " pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113777    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-cni-dir\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113805    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w72xb\" (UniqueName: \"kubernetes.io/projected/80be22ab-b20c-450f-9be4-915d96bb2566-kube-api-access-w72xb\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113831    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-run-netns\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2-hosts-file\") pod \"node-resolver-wng7s\" (UID: \"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2\") " pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113948    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2-hosts-file\") pod \"node-resolver-wng7s\" (UID: \"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2\") " pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113950    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-multus-conf-dir\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.116040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.113984    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-var-lib-cni-bin\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114054    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-run-netns\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114077    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-socket-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114109    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7nhk\" (UniqueName: \"kubernetes.io/projected/f22aa5c9-7486-43c8-9f4a-f8079561f43d-kube-api-access-d7nhk\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-system-cni-dir\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114192    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-hostroot\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114218    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2-tmp-dir\") pod \"node-resolver-wng7s\" (UID: \"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2\") " pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114234    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114249    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114289    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-hostroot\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114297    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-system-cni-dir\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114324    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-cnibin\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114364    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/143a77db-bc3b-4f80-8fd8-8532250c8df1-iptables-alerter-script\") pod \"iptables-alerter-zpmlt\" (UID: \"143a77db-bc3b-4f80-8fd8-8532250c8df1\") " pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114444    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f22aa5c9-7486-43c8-9f4a-f8079561f43d-cni-binary-copy\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.116639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/536d7d82-a22e-44e5-be71-fb5d9d271e55-ovnkube-script-lib\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114485    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f22aa5c9-7486-43c8-9f4a-f8079561f43d-cnibin\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-var-lib-cni-multus\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114531    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-sys\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114558    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trdzz\" (UniqueName: \"kubernetes.io/projected/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-kube-api-access-trdzz\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114585    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2-tmp-dir\") pod \"node-resolver-wng7s\" (UID: \"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2\") " pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114622    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-run\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f22aa5c9-7486-43c8-9f4a-f8079561f43d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114790    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-cni-netd\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114816    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/536d7d82-a22e-44e5-be71-fb5d9d271e55-ovnkube-config\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-os-release\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114908    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-host-cni-netd\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.114963    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-var-lib-cni-multus\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115005    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-run\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115030    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/536d7d82-a22e-44e5-be71-fb5d9d271e55-ovnkube-script-lib\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.117336 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115032    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f22aa5c9-7486-43c8-9f4a-f8079561f43d-cni-binary-copy\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115064    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-os-release\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-systemd-units\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115129    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-run-multus-certs\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115162    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-sysctl-d\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115166    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-host-run-multus-certs\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115218    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-systemd-units\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115231    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-lib-modules\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115307    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-sysctl-d\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-run-openvswitch\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115356    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/536d7d82-a22e-44e5-be71-fb5d9d271e55-ovn-node-metrics-cert\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115361    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536d7d82-a22e-44e5-be71-fb5d9d271e55-run-openvswitch\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115366    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-lib-modules\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115394    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-sysconfig\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.118093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115436    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80be22ab-b20c-450f-9be4-915d96bb2566-etc-sysconfig\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.118792 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.115635    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/536d7d82-a22e-44e5-be71-fb5d9d271e55-ovnkube-config\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.118792 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.116150    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f22aa5c9-7486-43c8-9f4a-f8079561f43d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.118792 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.116623    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80be22ab-b20c-450f-9be4-915d96bb2566-tmp\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.118792 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.116666    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80be22ab-b20c-450f-9be4-915d96bb2566-etc-tuned\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.118792 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.116804    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18d6352c-e630-4530-ab2b-246bd97aae1d-agent-certs\") pod \"konnectivity-agent-jddwq\" (UID: \"18d6352c-e630-4530-ab2b-246bd97aae1d\") " pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:36.119120 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.119100    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:36.119197 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.119127    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:36.119197 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.119143    2568 projected.go:196] Error preparing data for projected volume kube-api-access-slmm6 for pod openshift-network-diagnostics/network-check-target-6x2mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:36.119306 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.119202    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6 podName:d5a92ab5-3480-4de0-99e0-189894ce5f0e nodeName:}" failed. No retries permitted until 2026-07-02 23:10:36.619187916 +0000 UTC m=+3.075444099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-slmm6" (UniqueName: "kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6") pod "network-check-target-6x2mn" (UID: "d5a92ab5-3480-4de0-99e0-189894ce5f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:36.119756 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.119734    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/536d7d82-a22e-44e5-be71-fb5d9d271e55-ovn-node-metrics-cert\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.122401 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.122365    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjvlf\" (UniqueName: \"kubernetes.io/projected/990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2-kube-api-access-jjvlf\") pod \"node-resolver-wng7s\" (UID: \"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2\") " pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:36.126302 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.126280    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwxsl\" (UniqueName: \"kubernetes.io/projected/536d7d82-a22e-44e5-be71-fb5d9d271e55-kube-api-access-lwxsl\") pod \"ovnkube-node-dssnd\" (UID: \"536d7d82-a22e-44e5-be71-fb5d9d271e55\") " pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.126584 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.126561    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w72xb\" (UniqueName: \"kubernetes.io/projected/80be22ab-b20c-450f-9be4-915d96bb2566-kube-api-access-w72xb\") pod \"tuned-n6drb\" (UID: \"80be22ab-b20c-450f-9be4-915d96bb2566\") " pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.127210 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.127186    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfqqd\" (UniqueName: \"kubernetes.io/projected/143a77db-bc3b-4f80-8fd8-8532250c8df1-kube-api-access-xfqqd\") pod \"iptables-alerter-zpmlt\" (UID: \"143a77db-bc3b-4f80-8fd8-8532250c8df1\") " pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:36.128714 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.128654    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trdzz\" (UniqueName: \"kubernetes.io/projected/5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484-kube-api-access-trdzz\") pod \"multus-hm7qm\" (UID: \"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484\") " pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.129076 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.129058    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7nhk\" (UniqueName: \"kubernetes.io/projected/f22aa5c9-7486-43c8-9f4a-f8079561f43d-kube-api-access-d7nhk\") pod \"multus-additional-cni-plugins-rgmhn\" (UID: \"f22aa5c9-7486-43c8-9f4a-f8079561f43d\") " pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.143208 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.143192    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:36.216031 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.215948    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7bx7\" (UniqueName: \"kubernetes.io/projected/026c3575-2cc8-4c9a-a2e2-344a301e0559-kube-api-access-r7bx7\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216031 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.215984    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-socket-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216031 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216006    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216055    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-sys-fs\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216077    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6cxf\" (UniqueName: \"kubernetes.io/projected/f98f8c84-58ec-4aa4-b876-0b85ee7c203f-kube-api-access-s6cxf\") pod \"node-ca-fvxjh\" (UID: \"f98f8c84-58ec-4aa4-b876-0b85ee7c203f\") " pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216121    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/13d09a11-ac14-43c3-915a-34f5c085d0d4-dbus\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216135    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f98f8c84-58ec-4aa4-b876-0b85ee7c203f-host\") pod \"node-ca-fvxjh\" (UID: \"f98f8c84-58ec-4aa4-b876-0b85ee7c203f\") " pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-registration-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216172    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f98f8c84-58ec-4aa4-b876-0b85ee7c203f-serviceca\") pod \"node-ca-fvxjh\" (UID: \"f98f8c84-58ec-4aa4-b876-0b85ee7c203f\") " pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216189    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-device-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/13d09a11-ac14-43c3-915a-34f5c085d0d4-kubelet-config\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216250    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd5xd\" (UniqueName: \"kubernetes.io/projected/f9b03d41-3bec-45a0-9655-41c67a514ff4-kube-api-access-nd5xd\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:36.216282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216256    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-socket-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216909 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216341    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216909 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216415    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216909 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216457    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/13d09a11-ac14-43c3-915a-34f5c085d0d4-kubelet-config\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:36.216909 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216743    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-sys-fs\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.216909 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.216766    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f98f8c84-58ec-4aa4-b876-0b85ee7c203f-host\") pod \"node-ca-fvxjh\" (UID: \"f98f8c84-58ec-4aa4-b876-0b85ee7c203f\") " pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:36.216909 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.216834    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:36.216909 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.216890    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs podName:f9b03d41-3bec-45a0-9655-41c67a514ff4 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:36.716876335 +0000 UTC m=+3.173132513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs") pod "network-metrics-daemon-95xd7" (UID: "f9b03d41-3bec-45a0-9655-41c67a514ff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:36.217284 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.217065    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f98f8c84-58ec-4aa4-b876-0b85ee7c203f-serviceca\") pod \"node-ca-fvxjh\" (UID: \"f98f8c84-58ec-4aa4-b876-0b85ee7c203f\") " pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:36.217284 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.217130    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-device-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.217284 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.217140    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:36.217284 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.217132    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/13d09a11-ac14-43c3-915a-34f5c085d0d4-dbus\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:36.217284 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.217188    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/026c3575-2cc8-4c9a-a2e2-344a301e0559-registration-dir\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.217284 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.217197    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret podName:13d09a11-ac14-43c3-915a-34f5c085d0d4 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:36.717180978 +0000 UTC m=+3.173437157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret") pod "global-pull-secret-syncer-62bxx" (UID: "13d09a11-ac14-43c3-915a-34f5c085d0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:36.224454 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.224433    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6cxf\" (UniqueName: \"kubernetes.io/projected/f98f8c84-58ec-4aa4-b876-0b85ee7c203f-kube-api-access-s6cxf\") pod \"node-ca-fvxjh\" (UID: \"f98f8c84-58ec-4aa4-b876-0b85ee7c203f\") " pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:36.224741 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.224720    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7bx7\" (UniqueName: \"kubernetes.io/projected/026c3575-2cc8-4c9a-a2e2-344a301e0559-kube-api-access-r7bx7\") pod \"aws-ebs-csi-driver-node-kbnpq\" (UID: \"026c3575-2cc8-4c9a-a2e2-344a301e0559\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.224825 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.224725    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd5xd\" (UniqueName: \"kubernetes.io/projected/f9b03d41-3bec-45a0-9655-41c67a514ff4-kube-api-access-nd5xd\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:36.227444 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.227430    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:10:36.237089 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.237067    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hm7qm"
Jul 02 23:10:36.248595 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.248570    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n6drb"
Jul 02 23:10:36.261166 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.261147    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wng7s"
Jul 02 23:10:36.266910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.266894    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rgmhn"
Jul 02 23:10:36.275482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.275462    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zpmlt"
Jul 02 23:10:36.284366 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.284348    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:36.291952 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.291936    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq"
Jul 02 23:10:36.300501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.300488    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fvxjh"
Jul 02 23:10:36.719433 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.719405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmm6\" (UniqueName: \"kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6\") pod \"network-check-target-6x2mn\" (UID: \"d5a92ab5-3480-4de0-99e0-189894ce5f0e\") " pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:36.719591 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.719454    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:36.719591 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.719510    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:36.719736 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.719581    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:36.719736 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.719608    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:36.719736 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.719611    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:36.719736 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.719623    2568 projected.go:196] Error preparing data for projected volume kube-api-access-slmm6 for pod openshift-network-diagnostics/network-check-target-6x2mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:36.719736 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.719624    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:36.719736 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.719697    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs podName:f9b03d41-3bec-45a0-9655-41c67a514ff4 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:37.719659412 +0000 UTC m=+4.175915608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs") pod "network-metrics-daemon-95xd7" (UID: "f9b03d41-3bec-45a0-9655-41c67a514ff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:36.719736 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.719719    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret podName:13d09a11-ac14-43c3-915a-34f5c085d0d4 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:37.719707836 +0000 UTC m=+4.175964016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret") pod "global-pull-secret-syncer-62bxx" (UID: "13d09a11-ac14-43c3-915a-34f5c085d0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:36.719736 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:36.719735    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6 podName:d5a92ab5-3480-4de0-99e0-189894ce5f0e nodeName:}" failed. No retries permitted until 2026-07-02 23:10:37.719725376 +0000 UTC m=+4.175981569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-slmm6" (UniqueName: "kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6") pod "network-check-target-6x2mn" (UID: "d5a92ab5-3480-4de0-99e0-189894ce5f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:36.970476 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.970402    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:05:35 +0000 UTC" deadline="2028-03-02 01:16:50.328146826 +0000 UTC"
Jul 02 23:10:36.970476 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:36.970430    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14594h6m13.357720297s"
Jul 02 23:10:37.197101 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:37.197067    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143a77db_bc3b_4f80_8fd8_8532250c8df1.slice/crio-d1e92d6f515991dc09ea9b22056180851a153552c73894e28b78fd68adc19665 WatchSource:0}: Error finding container d1e92d6f515991dc09ea9b22056180851a153552c73894e28b78fd68adc19665: Status 404 returned error can't find the container with id d1e92d6f515991dc09ea9b22056180851a153552c73894e28b78fd68adc19665
Jul 02 23:10:37.202334 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:37.202311    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0d9bba_ad6c_4a08_9b1f_3fdd616d3484.slice/crio-66814d7bcfe1fd1b8f9d9f5587a5271c76a938c1d256ec4a189d65c5f4b91fde WatchSource:0}: Error finding container 66814d7bcfe1fd1b8f9d9f5587a5271c76a938c1d256ec4a189d65c5f4b91fde: Status 404 returned error can't find the container with id 66814d7bcfe1fd1b8f9d9f5587a5271c76a938c1d256ec4a189d65c5f4b91fde
Jul 02 23:10:37.203146 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:37.203124    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf98f8c84_58ec_4aa4_b876_0b85ee7c203f.slice/crio-e47dc4e723a346aa595687235f11493b0f4386dfc3244a336ac700578ea3d9ad WatchSource:0}: Error finding container e47dc4e723a346aa595687235f11493b0f4386dfc3244a336ac700578ea3d9ad: Status 404 returned error can't find the container with id e47dc4e723a346aa595687235f11493b0f4386dfc3244a336ac700578ea3d9ad
Jul 02 23:10:37.204618 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:37.204292    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80be22ab_b20c_450f_9be4_915d96bb2566.slice/crio-3177df0a2e5955d9efc7cc4a0c7eb61060eb4f0f9eed0df5061c2a662b2affc6 WatchSource:0}: Error finding container 3177df0a2e5955d9efc7cc4a0c7eb61060eb4f0f9eed0df5061c2a662b2affc6: Status 404 returned error can't find the container with id 3177df0a2e5955d9efc7cc4a0c7eb61060eb4f0f9eed0df5061c2a662b2affc6
Jul 02 23:10:37.205514 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:37.205415    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990c5d5f_0ae0_4aaf_9b9e_5a4119ea61b2.slice/crio-9717be4c9a48d9efe17523afec6d6dd270240cd4f1a1a3a4d3c59247f18f9ba0 WatchSource:0}: Error finding container 9717be4c9a48d9efe17523afec6d6dd270240cd4f1a1a3a4d3c59247f18f9ba0: Status 404 returned error can't find the container with id 9717be4c9a48d9efe17523afec6d6dd270240cd4f1a1a3a4d3c59247f18f9ba0
Jul 02 23:10:37.206583 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:37.206565    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22aa5c9_7486_43c8_9f4a_f8079561f43d.slice/crio-c2ff2046e6422d7febf92b893368f61b486834b1584a16ff1788ff5e6076aeeb WatchSource:0}: Error finding container c2ff2046e6422d7febf92b893368f61b486834b1584a16ff1788ff5e6076aeeb: Status 404 returned error can't find the container with id c2ff2046e6422d7febf92b893368f61b486834b1584a16ff1788ff5e6076aeeb
Jul 02 23:10:37.206832 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:10:37.206815    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536d7d82_a22e_44e5_be71_fb5d9d271e55.slice/crio-a33f7cc85d9ce859ac2f3062edef181540fdfedafd4c59c768a95b72ac213cc2 WatchSource:0}: Error finding container a33f7cc85d9ce859ac2f3062edef181540fdfedafd4c59c768a95b72ac213cc2: Status 404 returned error can't find the container with id a33f7cc85d9ce859ac2f3062edef181540fdfedafd4c59c768a95b72ac213cc2
Jul 02 23:10:37.727977 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:37.727729    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:37.728239 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:37.728041    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:37.728239 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:37.728073    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmm6\" (UniqueName: \"kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6\") pod \"network-check-target-6x2mn\" (UID: \"d5a92ab5-3480-4de0-99e0-189894ce5f0e\") " pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:37.728239 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.727946    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:37.728239 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.728194    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:37.728239 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.728210    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:37.728239 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.728222    2568 projected.go:196] Error preparing data for projected volume kube-api-access-slmm6 for pod openshift-network-diagnostics/network-check-target-6x2mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:37.728560 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.728295    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:37.728560 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.728196    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret podName:13d09a11-ac14-43c3-915a-34f5c085d0d4 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:39.728174503 +0000 UTC m=+6.184430696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret") pod "global-pull-secret-syncer-62bxx" (UID: "13d09a11-ac14-43c3-915a-34f5c085d0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:37.728560 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.728364    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6 podName:d5a92ab5-3480-4de0-99e0-189894ce5f0e nodeName:}" failed. No retries permitted until 2026-07-02 23:10:39.728351325 +0000 UTC m=+6.184607515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-slmm6" (UniqueName: "kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6") pod "network-check-target-6x2mn" (UID: "d5a92ab5-3480-4de0-99e0-189894ce5f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:37.728560 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.728377    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs podName:f9b03d41-3bec-45a0-9655-41c67a514ff4 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:39.728369397 +0000 UTC m=+6.184625585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs") pod "network-metrics-daemon-95xd7" (UID: "f9b03d41-3bec-45a0-9655-41c67a514ff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:37.755665 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.755610    2568 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:28389dd118629aa9d7c2525202f3ad6359afb98b6a3bf7672cb1ecfae2418e23"
Jul 02 23:10:37.755829 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.755753    2568 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-zpmlt_openshift-network-operator(143a77db-bc3b-4f80-8fd8-8532250c8df1): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 02 23:10:37.755829 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:37.755795    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-network-operator/iptables-alerter-zpmlt" podUID="143a77db-bc3b-4f80-8fd8-8532250c8df1"
Jul 02 23:10:37.970825 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:37.970763    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:05:35 +0000 UTC" deadline="2028-01-10 14:20:13.818326296 +0000 UTC"
Jul 02 23:10:37.970825 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:37.970822    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13359h9m35.847508019s"
Jul 02 23:10:38.075587 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.075515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:38.075752 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:38.075642    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:38.076084 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.076051    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:38.076172 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:38.076159    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:38.076232 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.076219    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:38.076338 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:38.076287    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:38.098867 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.098833    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq" event={"ID":"026c3575-2cc8-4c9a-a2e2-344a301e0559","Type":"ContainerStarted","Data":"c57b7206708d02890a6e9458b75fe8484887da26dd38f60ab586e4b97ebd4089"}
Jul 02 23:10:38.101021 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.100996    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgmhn" event={"ID":"f22aa5c9-7486-43c8-9f4a-f8079561f43d","Type":"ContainerStarted","Data":"c2ff2046e6422d7febf92b893368f61b486834b1584a16ff1788ff5e6076aeeb"}
Jul 02 23:10:38.116050 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.115850    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fvxjh" event={"ID":"f98f8c84-58ec-4aa4-b876-0b85ee7c203f","Type":"ContainerStarted","Data":"e47dc4e723a346aa595687235f11493b0f4386dfc3244a336ac700578ea3d9ad"}
Jul 02 23:10:38.118573 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.118549    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n6drb" event={"ID":"80be22ab-b20c-450f-9be4-915d96bb2566","Type":"ContainerStarted","Data":"3177df0a2e5955d9efc7cc4a0c7eb61060eb4f0f9eed0df5061c2a662b2affc6"}
Jul 02 23:10:38.121851 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.121829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jddwq" event={"ID":"18d6352c-e630-4530-ab2b-246bd97aae1d","Type":"ContainerStarted","Data":"8f6ba96b311afea3595f6227e7d2ab2564c2c25ecca2030d573f17e86cd33697"}
Jul 02 23:10:38.141392 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.141365    2568 generic.go:356] "Generic (PLEG): container finished" podID="02e998e40fba42fc181152b7daac8401" containerID="35b67970e1d0a9dad180a7d20d980af6f2429a34a750d583ec8a44b508c65692" exitCode=0
Jul 02 23:10:38.141509 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.141447    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal" event={"ID":"02e998e40fba42fc181152b7daac8401","Type":"ContainerDied","Data":"35b67970e1d0a9dad180a7d20d980af6f2429a34a750d583ec8a44b508c65692"}
Jul 02 23:10:38.147160 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.147137    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd" event={"ID":"536d7d82-a22e-44e5-be71-fb5d9d271e55","Type":"ContainerStarted","Data":"a33f7cc85d9ce859ac2f3062edef181540fdfedafd4c59c768a95b72ac213cc2"}
Jul 02 23:10:38.159034 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.159009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wng7s" event={"ID":"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2","Type":"ContainerStarted","Data":"9717be4c9a48d9efe17523afec6d6dd270240cd4f1a1a3a4d3c59247f18f9ba0"}
Jul 02 23:10:38.171902 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.171875    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hm7qm" event={"ID":"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484","Type":"ContainerStarted","Data":"66814d7bcfe1fd1b8f9d9f5587a5271c76a938c1d256ec4a189d65c5f4b91fde"}
Jul 02 23:10:38.178729 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.178704    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zpmlt" event={"ID":"143a77db-bc3b-4f80-8fd8-8532250c8df1","Type":"ContainerStarted","Data":"d1e92d6f515991dc09ea9b22056180851a153552c73894e28b78fd68adc19665"}
Jul 02 23:10:38.180572 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:38.180542    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:28389dd118629aa9d7c2525202f3ad6359afb98b6a3bf7672cb1ecfae2418e23\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-network-operator/iptables-alerter-zpmlt" podUID="143a77db-bc3b-4f80-8fd8-8532250c8df1"
Jul 02 23:10:38.188007 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:38.187980    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal" event={"ID":"473300bc9019cc21b12b801a14fc1b1d","Type":"ContainerStarted","Data":"75adf1ba237e73d8f86f68a1f5ebf41e5aa906bb5387eccb9fbb49922361b166"}
Jul 02 23:10:39.205770 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:39.205734    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal" event={"ID":"02e998e40fba42fc181152b7daac8401","Type":"ContainerStarted","Data":"5efe16946c8edcbdcd9ada505563672c091d970fadd7e1e4f4e60287313c985d"}
Jul 02 23:10:39.220366 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:39.220310    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-25.ec2.internal" podStartSLOduration=4.22029024 podStartE2EDuration="4.22029024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:38.208040809 +0000 UTC m=+4.664297027" watchObservedRunningTime="2026-07-02 23:10:39.22029024 +0000 UTC m=+5.676546445"
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:39.743899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:39.743951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmm6\" (UniqueName: \"kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6\") pod \"network-check-target-6x2mn\" (UID: \"d5a92ab5-3480-4de0-99e0-189894ce5f0e\") " pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:39.743993    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:39.744073    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:39.744112    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:39.744150    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs podName:f9b03d41-3bec-45a0-9655-41c67a514ff4 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:43.744129087 +0000 UTC m=+10.200385270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs") pod "network-metrics-daemon-95xd7" (UID: "f9b03d41-3bec-45a0-9655-41c67a514ff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:39.744170    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret podName:13d09a11-ac14-43c3-915a-34f5c085d0d4 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:43.744160492 +0000 UTC m=+10.200416677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret") pod "global-pull-secret-syncer-62bxx" (UID: "13d09a11-ac14-43c3-915a-34f5c085d0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:39.744219    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:39.744235    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:39.744246    2568 projected.go:196] Error preparing data for projected volume kube-api-access-slmm6 for pod openshift-network-diagnostics/network-check-target-6x2mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:39.744320 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:39.744284    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6 podName:d5a92ab5-3480-4de0-99e0-189894ce5f0e nodeName:}" failed. No retries permitted until 2026-07-02 23:10:43.744269148 +0000 UTC m=+10.200525329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-slmm6" (UniqueName: "kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6") pod "network-check-target-6x2mn" (UID: "d5a92ab5-3480-4de0-99e0-189894ce5f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:40.073480 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:40.073391    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:40.073480 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:40.073521    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:40.073921 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:40.073901    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:40.074054 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:40.073995    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:40.074118 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:40.074071    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:40.074191 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:40.074171    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:42.073591 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:42.073556    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:42.074049 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:42.073704    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:42.074049 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:42.074008    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:42.074180 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:42.074107    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:42.074180 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:42.074151    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:42.074274 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:42.074224    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:43.781270    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:43.781323    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmm6\" (UniqueName: \"kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6\") pod \"network-check-target-6x2mn\" (UID: \"d5a92ab5-3480-4de0-99e0-189894ce5f0e\") " pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:43.781363    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:43.781507    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:43.781564    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret podName:13d09a11-ac14-43c3-915a-34f5c085d0d4 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:51.781546772 +0000 UTC m=+18.237802953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret") pod "global-pull-secret-syncer-62bxx" (UID: "13d09a11-ac14-43c3-915a-34f5c085d0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:43.781623    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:43.781655    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs podName:f9b03d41-3bec-45a0-9655-41c67a514ff4 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:51.781643261 +0000 UTC m=+18.237899442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs") pod "network-metrics-daemon-95xd7" (UID: "f9b03d41-3bec-45a0-9655-41c67a514ff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:43.781753    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:43.781767    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:43.781779    2568 projected.go:196] Error preparing data for projected volume kube-api-access-slmm6 for pod openshift-network-diagnostics/network-check-target-6x2mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:43.781842 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:43.781818    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6 podName:d5a92ab5-3480-4de0-99e0-189894ce5f0e nodeName:}" failed. No retries permitted until 2026-07-02 23:10:51.781805474 +0000 UTC m=+18.238061654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-slmm6" (UniqueName: "kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6") pod "network-check-target-6x2mn" (UID: "d5a92ab5-3480-4de0-99e0-189894ce5f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:44.076655 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:44.076592    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:44.076825 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:44.076712    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:44.077751 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:44.077112    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:44.077751 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:44.077205    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:44.077751 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:44.077263    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:44.077751 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:44.077340    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:46.073522 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:46.073481    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:46.073522 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:46.073514    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:46.074061 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:46.073482    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:46.074061 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:46.073611    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:46.074061 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:46.073714    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:46.074061 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:46.073780    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:48.072855 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:48.072763    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:48.072855 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:48.072763    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:48.073319 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:48.072894    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:48.073319 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:48.073295    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:48.073432 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:48.073395    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:48.073512 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:48.073487    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:50.073062 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:50.073027    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:50.073062 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:50.073043    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:50.073062 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:50.073033    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:50.073601 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:50.073156    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:50.073601 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:50.073216    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:50.073601 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:50.073304    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:51.839725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:51.839632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:51.839725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:51.839684    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmm6\" (UniqueName: \"kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6\") pod \"network-check-target-6x2mn\" (UID: \"d5a92ab5-3480-4de0-99e0-189894ce5f0e\") " pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:51.839725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:51.839724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:51.840273 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:51.839791    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:51.840273 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:51.839813    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:51.840273 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:51.839860    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret podName:13d09a11-ac14-43c3-915a-34f5c085d0d4 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:07.839841255 +0000 UTC m=+34.296097434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret") pod "global-pull-secret-syncer-62bxx" (UID: "13d09a11-ac14-43c3-915a-34f5c085d0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:51.840273 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:51.839858    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:51.840273 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:51.839876    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs podName:f9b03d41-3bec-45a0-9655-41c67a514ff4 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:07.839866728 +0000 UTC m=+34.296122906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs") pod "network-metrics-daemon-95xd7" (UID: "f9b03d41-3bec-45a0-9655-41c67a514ff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:51.840273 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:51.839884    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:51.840273 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:51.839900    2568 projected.go:196] Error preparing data for projected volume kube-api-access-slmm6 for pod openshift-network-diagnostics/network-check-target-6x2mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:51.840273 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:51.839956    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6 podName:d5a92ab5-3480-4de0-99e0-189894ce5f0e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:07.839940933 +0000 UTC m=+34.296197125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-slmm6" (UniqueName: "kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6") pod "network-check-target-6x2mn" (UID: "d5a92ab5-3480-4de0-99e0-189894ce5f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:52.073554 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:52.073517    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:52.073554 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:52.073527    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:52.073815 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:52.073624    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:52.073815 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:52.073747    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:52.073897 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:52.073853    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:52.073994 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:52.073973    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:52.087239 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:52.087196    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-25.ec2.internal" podStartSLOduration=17.087184329 podStartE2EDuration="17.087184329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:39.221823214 +0000 UTC m=+5.678079416" watchObservedRunningTime="2026-07-02 23:10:52.087184329 +0000 UTC m=+18.543440530"
Jul 02 23:10:54.073713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:54.073666    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:54.074131 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:54.073791    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:54.074131 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:54.073797    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:54.074131 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:54.073810    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:54.074131 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:54.073898    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:54.074131 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:54.073976    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:56.073597 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.073219    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:56.074315 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.073219    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:56.074315 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:56.073744    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:56.074315 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:56.073819    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:56.074315 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.073331    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:56.074315 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:56.073914    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:56.240450 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.240421    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq" event={"ID":"026c3575-2cc8-4c9a-a2e2-344a301e0559","Type":"ContainerStarted","Data":"d23f47b9bf8184bcce288910b87a3177ffc2163f32b6aeb8cd4722d7f1fb2f28"}
Jul 02 23:10:56.241850 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.241828    2568 generic.go:356] "Generic (PLEG): container finished" podID="f22aa5c9-7486-43c8-9f4a-f8079561f43d" containerID="3c6bb66b07c54638bd54051a09d9c40c6576dc03480ecd44b48e2349598d4488" exitCode=0
Jul 02 23:10:56.241943 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.241895    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgmhn" event={"ID":"f22aa5c9-7486-43c8-9f4a-f8079561f43d","Type":"ContainerDied","Data":"3c6bb66b07c54638bd54051a09d9c40c6576dc03480ecd44b48e2349598d4488"}
Jul 02 23:10:56.243260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.243241    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fvxjh" event={"ID":"f98f8c84-58ec-4aa4-b876-0b85ee7c203f","Type":"ContainerStarted","Data":"215a3644efd16cf5687dbf9775852f820dd04d8ae8a7fff54155629d452c9efc"}
Jul 02 23:10:56.244883 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.244826    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n6drb" event={"ID":"80be22ab-b20c-450f-9be4-915d96bb2566","Type":"ContainerStarted","Data":"bfcd14008056d1a6fd9884b5dbb363243199bceeae5962f8714f05ede7da7611"}
Jul 02 23:10:56.249565 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.249538    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jddwq" event={"ID":"18d6352c-e630-4530-ab2b-246bd97aae1d","Type":"ContainerStarted","Data":"c37f4dd5947f2c6765e00a196773b77d1f46ac46383af739d8c76aae2272c442"}
Jul 02 23:10:56.252167 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.252139    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd" event={"ID":"536d7d82-a22e-44e5-be71-fb5d9d271e55","Type":"ContainerStarted","Data":"ec6d60c639a43f81a16046c93ca02d2529f208e4cfc62812a224dcb53cf54ddd"}
Jul 02 23:10:56.252245 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.252208    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd" event={"ID":"536d7d82-a22e-44e5-be71-fb5d9d271e55","Type":"ContainerStarted","Data":"95e029a4c33a83430514c58e4efc2f5184acd31e121de98648cb0a7fa1316142"}
Jul 02 23:10:56.252288 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.252247    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd" event={"ID":"536d7d82-a22e-44e5-be71-fb5d9d271e55","Type":"ContainerStarted","Data":"1a4c677c5ff89db4abad5b69465f10f7abecf86f5cccefbf234fb60d93710818"}
Jul 02 23:10:56.253508 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.253482    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wng7s" event={"ID":"990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2","Type":"ContainerStarted","Data":"e5c8413ae168ee65ab89834d7d4df345454e845587f5d01d1c1288f8a195090a"}
Jul 02 23:10:56.254922 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.254906    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hm7qm" event={"ID":"5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484","Type":"ContainerStarted","Data":"500f20e44687ea7b0cf46540c6615a2eeb1f489c4261ef8bd596ce584a44dd6d"}
Jul 02 23:10:56.287277 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.287241    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hm7qm" podStartSLOduration=3.680132065 podStartE2EDuration="22.287229305s" totalImagesPullingTime="18.60709724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:56.287088792 +0000 UTC m=+22.743345017" watchObservedRunningTime="2026-07-02 23:10:56.287229305 +0000 UTC m=+22.743485529"
Jul 02 23:10:56.339782 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.339743    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n6drb" podStartSLOduration=3.78220781 podStartE2EDuration="22.339728643s" totalImagesPullingTime="18.557520833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:56.31140973 +0000 UTC m=+22.767665955" watchObservedRunningTime="2026-07-02 23:10:56.339728643 +0000 UTC m=+22.795984843"
Jul 02 23:10:56.368230 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.368192    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fvxjh" podStartSLOduration=3.789200312 podStartE2EDuration="22.368176929s" totalImagesPullingTime="18.578976617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:56.339551854 +0000 UTC m=+22.795808057" watchObservedRunningTime="2026-07-02 23:10:56.368176929 +0000 UTC m=+22.824433190"
Jul 02 23:10:56.398945 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.398908    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wng7s" podStartSLOduration=3.822802804 podStartE2EDuration="22.398889715s" totalImagesPullingTime="18.576086911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:56.373891377 +0000 UTC m=+22.830147579" watchObservedRunningTime="2026-07-02 23:10:56.398889715 +0000 UTC m=+22.855145917"
Jul 02 23:10:56.399261 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.399235    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jddwq" podStartSLOduration=3.823769982 podStartE2EDuration="22.399227274s" totalImagesPullingTime="18.575457292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:56.39878845 +0000 UTC m=+22.855044670" watchObservedRunningTime="2026-07-02 23:10:56.399227274 +0000 UTC m=+22.855483475"
Jul 02 23:10:56.646886 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.646853    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:56.647358 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:56.647341    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:57.117834 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:57.117811    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 23:10:57.258598 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:57.258565    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zpmlt" event={"ID":"143a77db-bc3b-4f80-8fd8-8532250c8df1","Type":"ContainerStarted","Data":"c8c8c3537491b222529522d56c7303c63dfdf9fdb0d5d2750a883f3316fa7b42"}
Jul 02 23:10:57.260198 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:57.260173    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq" event={"ID":"026c3575-2cc8-4c9a-a2e2-344a301e0559","Type":"ContainerStarted","Data":"5034702ecb60b7ed4d6945f56691e3e4e2c6d4b9ef0eab9f0b8c45d436f3867e"}
Jul 02 23:10:57.263101 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:57.263076    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd" event={"ID":"536d7d82-a22e-44e5-be71-fb5d9d271e55","Type":"ContainerStarted","Data":"1b067a722924fe6acfa91a9764f0e1bd2159c153f6569bd351e522464d563dda"}
Jul 02 23:10:57.263200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:57.263152    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd" event={"ID":"536d7d82-a22e-44e5-be71-fb5d9d271e55","Type":"ContainerStarted","Data":"73f1d33076f72fcd012231aaa1f71a4b76bc4506bc4236880b38238a1e200ac0"}
Jul 02 23:10:57.263260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:57.263206    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd" event={"ID":"536d7d82-a22e-44e5-be71-fb5d9d271e55","Type":"ContainerStarted","Data":"b3a24fa7f215bbaf611f1b5561769a64225fbd9df53ed247624b92d77e318768"}
Jul 02 23:10:57.263734 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:57.263621    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:57.263734 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:57.263713    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jddwq"
Jul 02 23:10:57.272952 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:57.272911    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zpmlt" podStartSLOduration=4.660886963 podStartE2EDuration="23.272900328s" totalImagesPullingTime="18.612013365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 23:10:57.272555867 +0000 UTC m=+23.728812067" watchObservedRunningTime="2026-07-02 23:10:57.272900328 +0000 UTC m=+23.729156528"
Jul 02 23:10:58.021762 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:58.021606    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T23:10:57.11783042Z","UUID":"b2020011-756e-4b9f-8c3c-92ac16769360","Handler":null,"Name":"","Endpoint":""}
Jul 02 23:10:58.023297 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:58.023260    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 23:10:58.023297 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:58.023306    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 23:10:58.073036 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:58.073007    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:10:58.073170 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:58.073013    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:10:58.073170 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:58.073100    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:10:58.073170 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:58.073164    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:10:58.073276 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:58.073204    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:10:58.073276 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:10:58.073251    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:10:58.267933 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:58.267901    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq" event={"ID":"026c3575-2cc8-4c9a-a2e2-344a301e0559","Type":"ContainerStarted","Data":"815c83b282b9b219b36d6393d5701dd3d1825913bd84ea774a5730ead533347e"}
Jul 02 23:10:59.274017 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:59.273986    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd" event={"ID":"536d7d82-a22e-44e5-be71-fb5d9d271e55","Type":"ContainerStarted","Data":"83b5136510bfe83c51520c9660002b971a08a39d32d15f26f2dfe4ad1cf950e7"}
Jul 02 23:10:59.293367 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:10:59.293323    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbnpq" podStartSLOduration=4.718670528 podStartE2EDuration="25.293307593s" totalImagesPullingTime="20.574637065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:59.292647635 +0000 UTC m=+25.748903838" watchObservedRunningTime="2026-07-02 23:10:59.293307593 +0000 UTC m=+25.749563794"
Jul 02 23:11:00.073610 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:00.073432    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:00.073790 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:00.073432    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:11:00.073790 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:00.073719    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:11:00.073790 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:00.073436    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:11:00.073952 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:00.073781    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:11:00.073952 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:00.073907    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:11:01.279918 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:01.279890    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgmhn" event={"ID":"f22aa5c9-7486-43c8-9f4a-f8079561f43d","Type":"ContainerStarted","Data":"905d7df17187ac773a1c0f1e62cd9251f065a468d4eed97cdcfcceb7e5b117c9"}
Jul 02 23:11:01.284068 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:01.284037    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd" event={"ID":"536d7d82-a22e-44e5-be71-fb5d9d271e55","Type":"ContainerStarted","Data":"e75f15911a4aff250999438f11778b6ebcd7729f4556bcd2780a80a010336fe3"}
Jul 02 23:11:01.284326 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:01.284305    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:11:01.299740 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:01.299652    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:11:01.403783 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:01.403731    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd" podStartSLOduration=8.760160987999999 podStartE2EDuration="27.403716502s" totalImagesPullingTime="18.643555514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:01.403312879 +0000 UTC m=+27.859569098" watchObservedRunningTime="2026-07-02 23:11:01.403716502 +0000 UTC m=+27.859972703"
Jul 02 23:11:01.569396 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:01.569349    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:01.665758 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:01.665723    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:01.757502 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:01.757471    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:01.825251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:01.825044    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:02.073740 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:02.073710    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:02.073926 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:02.073718    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:11:02.073926 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:02.073814    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:11:02.073926 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:02.073840    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:11:02.073926 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:02.073913    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:11:02.074120 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:02.073992    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:11:02.288949 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:02.288920    2568 generic.go:356] "Generic (PLEG): container finished" podID="f22aa5c9-7486-43c8-9f4a-f8079561f43d" containerID="905d7df17187ac773a1c0f1e62cd9251f065a468d4eed97cdcfcceb7e5b117c9" exitCode=0
Jul 02 23:11:02.289437 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:02.289014    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgmhn" event={"ID":"f22aa5c9-7486-43c8-9f4a-f8079561f43d","Type":"ContainerDied","Data":"905d7df17187ac773a1c0f1e62cd9251f065a468d4eed97cdcfcceb7e5b117c9"}
Jul 02 23:11:02.289528 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:02.289440    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:11:02.289528 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:02.289522    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:11:02.309915 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:02.309893    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:11:03.087121 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:03.087089    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-62bxx"]
Jul 02 23:11:03.087449 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:03.087205    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:11:03.087449 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:03.087318    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:11:03.093902 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:03.093854    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6x2mn"]
Jul 02 23:11:03.094073 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:03.093958    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:03.094073 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:03.094052    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:11:03.094482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:03.094463    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-95xd7"]
Jul 02 23:11:03.094557 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:03.094545    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:11:03.094650 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:03.094633    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:11:04.294998 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:04.294969    2568 generic.go:356] "Generic (PLEG): container finished" podID="f22aa5c9-7486-43c8-9f4a-f8079561f43d" containerID="84fd33829cc58567423f7f54914778aad0ca1409a455a8ae74d6123e0d0a59ca" exitCode=0
Jul 02 23:11:04.295360 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:04.295062    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgmhn" event={"ID":"f22aa5c9-7486-43c8-9f4a-f8079561f43d","Type":"ContainerDied","Data":"84fd33829cc58567423f7f54914778aad0ca1409a455a8ae74d6123e0d0a59ca"}
Jul 02 23:11:04.820112 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:04.820084    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:04.921240 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:04.921207    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:05.073303 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:05.073205    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:11:05.073303 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:05.073229    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:11:05.073303 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:05.073234    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:05.073567 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:05.073339    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:11:05.073567 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:05.073418    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:11:05.073567 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:05.073485    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:11:06.047080 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:06.046886    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:06.102096 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:06.102072    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:06.304335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:06.304260    2568 generic.go:356] "Generic (PLEG): container finished" podID="f22aa5c9-7486-43c8-9f4a-f8079561f43d" containerID="fa768b45c7c494f8f1d8de2972a79f810b0870a5b7b62be036a7c93fd5fc94ec" exitCode=0
Jul 02 23:11:06.304335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:06.304313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgmhn" event={"ID":"f22aa5c9-7486-43c8-9f4a-f8079561f43d","Type":"ContainerDied","Data":"fa768b45c7c494f8f1d8de2972a79f810b0870a5b7b62be036a7c93fd5fc94ec"}
Jul 02 23:11:06.448114 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:06.448086    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:06.504151 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:06.504122    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:07.073770 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:07.073740    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:11:07.074207 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:07.073740    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:11:07.074207 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.073874    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-95xd7" podUID="f9b03d41-3bec-45a0-9655-41c67a514ff4"
Jul 02 23:11:07.074207 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:07.073740    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:07.074207 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.073947    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62bxx" podUID="13d09a11-ac14-43c3-915a-34f5c085d0d4"
Jul 02 23:11:07.074207 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.074002    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6x2mn" podUID="d5a92ab5-3480-4de0-99e0-189894ce5f0e"
Jul 02 23:11:07.865592 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:07.865558    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:11:07.865798 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:07.865622    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:11:07.865798 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:07.865648    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmm6\" (UniqueName: \"kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6\") pod \"network-check-target-6x2mn\" (UID: \"d5a92ab5-3480-4de0-99e0-189894ce5f0e\") " pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:07.865798 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.865727    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:11:07.865798 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.865780    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:11:07.865798 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.865796    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:11:07.866032 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.865802    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret podName:13d09a11-ac14-43c3-915a-34f5c085d0d4 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:39.865778942 +0000 UTC m=+66.322035122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret") pod "global-pull-secret-syncer-62bxx" (UID: "13d09a11-ac14-43c3-915a-34f5c085d0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:11:07.866032 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.865808    2568 projected.go:196] Error preparing data for projected volume kube-api-access-slmm6 for pod openshift-network-diagnostics/network-check-target-6x2mn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:11:07.866032 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.865854    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6 podName:d5a92ab5-3480-4de0-99e0-189894ce5f0e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:39.865838988 +0000 UTC m=+66.322095187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-slmm6" (UniqueName: "kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6") pod "network-check-target-6x2mn" (UID: "d5a92ab5-3480-4de0-99e0-189894ce5f0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:11:07.866032 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.865779    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:11:07.866032 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:07.865904    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs podName:f9b03d41-3bec-45a0-9655-41c67a514ff4 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:39.865891301 +0000 UTC m=+66.322147480 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs") pod "network-metrics-daemon-95xd7" (UID: "f9b03d41-3bec-45a0-9655-41c67a514ff4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:11:08.844991 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.844957    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-25.ec2.internal" event="NodeReady"
Jul 02 23:11:08.845514 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.845107    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 23:11:08.879639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.879097    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54f4958867-lzf64"]
Jul 02 23:11:08.881278 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.881259    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:08.883665 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.883640    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 23:11:08.883791 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.883758    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 23:11:08.884249 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.884232    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 23:11:08.885787 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.885764    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jqj9h\""
Jul 02 23:11:08.890903 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.890881    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 23:11:08.894451 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.894431    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pnp8l"]
Jul 02 23:11:08.896531 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.896515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:08.898828 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.898804    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qz5kk"]
Jul 02 23:11:08.899448 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.899429    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 23:11:08.899448 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.899429    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jlfnl\""
Jul 02 23:11:08.899587 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.899462    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 23:11:08.900346 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.900330    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qz5kk"
Jul 02 23:11:08.903865 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.903844    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54f4958867-lzf64"]
Jul 02 23:11:08.905463 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.905442    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 23:11:08.905555 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.905510    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s62t9\""
Jul 02 23:11:08.905555 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.905548    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 23:11:08.906039 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.905786    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 23:11:08.912876 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.912856    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pnp8l"]
Jul 02 23:11:08.927047 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.927024    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qz5kk"]
Jul 02 23:11:08.973502 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973471    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp8fz\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-kube-api-access-vp8fz\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:08.973714 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973540    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pdbp\" (UniqueName: \"kubernetes.io/projected/8ec99751-e29e-4b29-85d0-207ce6456584-kube-api-access-7pdbp\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:08.973714 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973603    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr8vp\" (UniqueName: \"kubernetes.io/projected/5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c-kube-api-access-hr8vp\") pod \"ingress-canary-qz5kk\" (UID: \"5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c\") " pod="openshift-ingress-canary/ingress-canary-qz5kk"
Jul 02 23:11:08.973714 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973656    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c-cert\") pod \"ingress-canary-qz5kk\" (UID: \"5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c\") " pod="openshift-ingress-canary/ingress-canary-qz5kk"
Jul 02 23:11:08.973714 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:08.973940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973725    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:08.973940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ec99751-e29e-4b29-85d0-207ce6456584-tmp-dir\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:08.973940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973808    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-bound-sa-token\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:08.973940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973840    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8ec99751-e29e-4b29-85d0-207ce6456584-config-volume\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:08.973940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/049f803a-d822-42ee-b236-dcba961dbf4b-ca-trust-extracted\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:08.973940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973926    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-installation-pull-secrets\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:08.974206 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973966    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-image-registry-private-configuration\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:08.974206 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.973984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-trusted-ca\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:08.974206 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:08.974001    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-registry-certificates\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.039482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.039445    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:09.073212 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.073183    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:11:09.073347 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.073298    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:09.073347 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.073333    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:11:09.074658 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.074634    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp8fz\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-kube-api-access-vp8fz\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.074801 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.074719    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pdbp\" (UniqueName: \"kubernetes.io/projected/8ec99751-e29e-4b29-85d0-207ce6456584-kube-api-access-7pdbp\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:09.074801 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.074750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr8vp\" (UniqueName: \"kubernetes.io/projected/5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c-kube-api-access-hr8vp\") pod \"ingress-canary-qz5kk\" (UID: \"5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c\") " pod="openshift-ingress-canary/ingress-canary-qz5kk"
Jul 02 23:11:09.074801 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.074783    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c-cert\") pod \"ingress-canary-qz5kk\" (UID: \"5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c\") " pod="openshift-ingress-canary/ingress-canary-qz5kk"
Jul 02 23:11:09.074968 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.074899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:09.074968 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.074940    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.075066 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.074972    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ec99751-e29e-4b29-85d0-207ce6456584-tmp-dir\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:09.075066 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.074997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-bound-sa-token\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.075066 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:09.075005    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:09.075066 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.075028    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8ec99751-e29e-4b29-85d0-207ce6456584-config-volume\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:09.075066 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:09.075056    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:09.075066 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:09.075063    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls podName:8ec99751-e29e-4b29-85d0-207ce6456584 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:09.575042044 +0000 UTC m=+36.031298239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls") pod "dns-default-pnp8l" (UID: "8ec99751-e29e-4b29-85d0-207ce6456584") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:09.075066 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:09.075070    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54f4958867-lzf64: secret "image-registry-tls" not found
Jul 02 23:11:09.075386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.075084    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/049f803a-d822-42ee-b236-dcba961dbf4b-ca-trust-extracted\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.075386 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:09.075112    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls podName:049f803a-d822-42ee-b236-dcba961dbf4b nodeName:}" failed. No retries permitted until 2026-07-02 23:11:09.575099489 +0000 UTC m=+36.031355679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls") pod "image-registry-54f4958867-lzf64" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b") : secret "image-registry-tls" not found
Jul 02 23:11:09.075386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.075145    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-installation-pull-secrets\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.075386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.075186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-image-registry-private-configuration\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.075386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.075213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-trusted-ca\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.075386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.075243    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-registry-certificates\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.075386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.075379    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ec99751-e29e-4b29-85d0-207ce6456584-tmp-dir\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:09.075766 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.075429    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/049f803a-d822-42ee-b236-dcba961dbf4b-ca-trust-extracted\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.075851 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.075831    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-registry-certificates\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.075911 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.075838    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8ec99751-e29e-4b29-85d0-207ce6456584-config-volume\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:09.076330 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.076309    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:11:09.076546 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.076520    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 23:11:09.076697 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.076249    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-trusted-ca\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.076763 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.076721    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 23:11:09.076818 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.076788    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-prtl8\""
Jul 02 23:11:09.076962 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.076944    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:11:09.077034 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.076989    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gmk5n\""
Jul 02 23:11:09.079831 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.079813    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c-cert\") pod \"ingress-canary-qz5kk\" (UID: \"5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c\") " pod="openshift-ingress-canary/ingress-canary-qz5kk"
Jul 02 23:11:09.079831 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.079829    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-image-registry-private-configuration\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.079940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.079903    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-installation-pull-secrets\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.083357 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.083307    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pdbp\" (UniqueName: \"kubernetes.io/projected/8ec99751-e29e-4b29-85d0-207ce6456584-kube-api-access-7pdbp\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:09.084189 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.084168    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp8fz\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-kube-api-access-vp8fz\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.084309 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.084286    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-bound-sa-token\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.084748 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.084729    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr8vp\" (UniqueName: \"kubernetes.io/projected/5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c-kube-api-access-hr8vp\") pod \"ingress-canary-qz5kk\" (UID: \"5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c\") " pod="openshift-ingress-canary/ingress-canary-qz5kk"
Jul 02 23:11:09.139984 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.139938    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:09.215007 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.213556    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qz5kk"
Jul 02 23:11:09.579641 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.579602    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:09.579641 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:09.579645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:09.579893 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:09.579746    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:09.579893 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:09.579780    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:09.579893 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:09.579796    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54f4958867-lzf64: secret "image-registry-tls" not found
Jul 02 23:11:09.579893 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:09.579854    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls podName:8ec99751-e29e-4b29-85d0-207ce6456584 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:10.579832383 +0000 UTC m=+37.036088563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls") pod "dns-default-pnp8l" (UID: "8ec99751-e29e-4b29-85d0-207ce6456584") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:09.579893 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:09.579873    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls podName:049f803a-d822-42ee-b236-dcba961dbf4b nodeName:}" failed. No retries permitted until 2026-07-02 23:11:10.579866338 +0000 UTC m=+37.036122517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls") pod "image-registry-54f4958867-lzf64" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b") : secret "image-registry-tls" not found
Jul 02 23:11:10.381363 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:10.381224    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qz5kk"]
Jul 02 23:11:10.384282 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:10.384190    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb2c7e8_ad52_42e0_9a0c_7df33d9d983c.slice/crio-edc1feca931040510997b0594e44fc07db0b91092210335f16d416f1b413d871 WatchSource:0}: Error finding container edc1feca931040510997b0594e44fc07db0b91092210335f16d416f1b413d871: Status 404 returned error can't find the container with id edc1feca931040510997b0594e44fc07db0b91092210335f16d416f1b413d871
Jul 02 23:11:10.590313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:10.590288    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:10.590432 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:10.590320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:10.590432 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:10.590426    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:10.590509 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:10.590443    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54f4958867-lzf64: secret "image-registry-tls" not found
Jul 02 23:11:10.590509 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:10.590487    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls podName:049f803a-d822-42ee-b236-dcba961dbf4b nodeName:}" failed. No retries permitted until 2026-07-02 23:11:12.590473517 +0000 UTC m=+39.046729695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls") pod "image-registry-54f4958867-lzf64" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b") : secret "image-registry-tls" not found
Jul 02 23:11:10.590588 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:10.590427    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:10.590588 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:10.590562    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls podName:8ec99751-e29e-4b29-85d0-207ce6456584 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:12.590547081 +0000 UTC m=+39.046803264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls") pod "dns-default-pnp8l" (UID: "8ec99751-e29e-4b29-85d0-207ce6456584") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:10.880232 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:10.880126    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:10.931660 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:10.931626    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.188659 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.188579    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.281451 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.281418    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.291417 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.291391    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5t5sd"]
Jul 02 23:11:11.293341 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.293319    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.295412 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.295391    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 23:11:11.295565 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.295449    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 23:11:11.295565 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.295392    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 23:11:11.296190 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.296143    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t7j8n\""
Jul 02 23:11:11.296291 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.296209    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 23:11:11.302789 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.302767    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5t5sd"]
Jul 02 23:11:11.321731 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.321702    2568 generic.go:356] "Generic (PLEG): container finished" podID="f22aa5c9-7486-43c8-9f4a-f8079561f43d" containerID="e5257785ed61af6664c5209d40c44af31e06b20e12ad1fb2531397fb3f19374f" exitCode=0
Jul 02 23:11:11.321852 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.321775    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgmhn" event={"ID":"f22aa5c9-7486-43c8-9f4a-f8079561f43d","Type":"ContainerDied","Data":"e5257785ed61af6664c5209d40c44af31e06b20e12ad1fb2531397fb3f19374f"}
Jul 02 23:11:11.323103 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.323066    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qz5kk" event={"ID":"5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c","Type":"ContainerStarted","Data":"edc1feca931040510997b0594e44fc07db0b91092210335f16d416f1b413d871"}
Jul 02 23:11:11.349084 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.349052    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.395420 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.395387    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.395812 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.395445    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.395812 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.395546    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-crio-socket\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.395812 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.395632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-data-volume\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.395812 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.395708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xfs5\" (UniqueName: \"kubernetes.io/projected/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-api-access-9xfs5\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.430959 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.430916    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.486394 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.486361    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.496238 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.496215    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.496367 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.496252    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.496367 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.496282    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-crio-socket\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.496481 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:11.496371    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:11.496481 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:11.496445    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm podName:c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:11.996426077 +0000 UTC m=+38.452682269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5t5sd" (UID: "c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:11.496481 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.496468    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-crio-socket\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.496634 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.496466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-data-volume\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.496634 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:11.496513    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:11.496634 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.496535    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xfs5\" (UniqueName: \"kubernetes.io/projected/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-api-access-9xfs5\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.496634 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:11.496567    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls podName:c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:11.996550837 +0000 UTC m=+38.452807018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5t5sd" (UID: "c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:11.496830 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.496805    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-data-volume\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.507532 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.507501    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xfs5\" (UniqueName: \"kubernetes.io/projected/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-api-access-9xfs5\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.777897 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.777854    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.812353 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.812313    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j"]
Jul 02 23:11:11.815503 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.815481    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j"
Jul 02 23:11:11.817947 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.817808    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 23:11:11.817947 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.817816    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hgl5d\""
Jul 02 23:11:11.817947 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.817903    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 23:11:11.825759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.825695    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j"]
Jul 02 23:11:11.851975 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.851925    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.898695 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.898645    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frkqh\" (UniqueName: \"kubernetes.io/projected/9064dc2f-7a73-480f-93d5-43194ad17c77-kube-api-access-frkqh\") pod \"migrator-d57d58cc9-fqx5j\" (UID: \"9064dc2f-7a73-480f-93d5-43194ad17c77\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j"
Jul 02 23:11:11.914993 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.914958    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.999254 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.999224    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frkqh\" (UniqueName: \"kubernetes.io/projected/9064dc2f-7a73-480f-93d5-43194ad17c77-kube-api-access-frkqh\") pod \"migrator-d57d58cc9-fqx5j\" (UID: \"9064dc2f-7a73-480f-93d5-43194ad17c77\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j"
Jul 02 23:11:11.999412 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.999330    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.999412 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:11.999355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:11.999553 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:11.999519    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:11.999956 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:11.999927    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm podName:c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:12.999907415 +0000 UTC m=+39.456163600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5t5sd" (UID: "c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:12.000076 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:11.999969    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:12.000076 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:12.000040    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls podName:c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:13.000021907 +0000 UTC m=+39.456278108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5t5sd" (UID: "c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:12.008518 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:12.008498    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frkqh\" (UniqueName: \"kubernetes.io/projected/9064dc2f-7a73-480f-93d5-43194ad17c77-kube-api-access-frkqh\") pod \"migrator-d57d58cc9-fqx5j\" (UID: \"9064dc2f-7a73-480f-93d5-43194ad17c77\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j"
Jul 02 23:11:12.127303 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:12.127219    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j"
Jul 02 23:11:12.330071 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:12.330034    2568 generic.go:356] "Generic (PLEG): container finished" podID="f22aa5c9-7486-43c8-9f4a-f8079561f43d" containerID="474f7f732b24483d12cb027425b9972981ba6c7274a0986386d0d7ed2581b979" exitCode=0
Jul 02 23:11:12.330225 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:12.330112    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgmhn" event={"ID":"f22aa5c9-7486-43c8-9f4a-f8079561f43d","Type":"ContainerDied","Data":"474f7f732b24483d12cb027425b9972981ba6c7274a0986386d0d7ed2581b979"}
Jul 02 23:11:12.605658 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:12.605508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:12.605658 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:12.605654    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:12.606177 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:12.605697    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:12.606177 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:12.605731    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls podName:8ec99751-e29e-4b29-85d0-207ce6456584 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:16.605714442 +0000 UTC m=+43.061970622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls") pod "dns-default-pnp8l" (UID: "8ec99751-e29e-4b29-85d0-207ce6456584") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:12.606177 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:12.605783    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:12.606177 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:12.605796    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54f4958867-lzf64: secret "image-registry-tls" not found
Jul 02 23:11:12.606177 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:12.605878    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls podName:049f803a-d822-42ee-b236-dcba961dbf4b nodeName:}" failed. No retries permitted until 2026-07-02 23:11:16.605860681 +0000 UTC m=+43.062116878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls") pod "image-registry-54f4958867-lzf64" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b") : secret "image-registry-tls" not found
Jul 02 23:11:12.623538 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:12.623518    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j"]
Jul 02 23:11:12.626174 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:12.626151    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9064dc2f_7a73_480f_93d5_43194ad17c77.slice/crio-7a803f3929de697a613cc64d4266dcac8faa5ee08b50cf9c8b4584e62cce7a08 WatchSource:0}: Error finding container 7a803f3929de697a613cc64d4266dcac8faa5ee08b50cf9c8b4584e62cce7a08: Status 404 returned error can't find the container with id 7a803f3929de697a613cc64d4266dcac8faa5ee08b50cf9c8b4584e62cce7a08
Jul 02 23:11:12.873860 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:12.873835    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wng7s_990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2/dns-node-resolver/0.log"
Jul 02 23:11:13.007934 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.007903    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:13.007934 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.007936    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:13.008115 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:13.008015    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:13.008115 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:13.008043    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:13.008115 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:13.008064    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm podName:c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:15.008049484 +0000 UTC m=+41.464305663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5t5sd" (UID: "c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:13.008115 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:13.008091    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls podName:c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:15.008078067 +0000 UTC m=+41.464334246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5t5sd" (UID: "c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:13.335669 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.335634    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rgmhn" event={"ID":"f22aa5c9-7486-43c8-9f4a-f8079561f43d","Type":"ContainerStarted","Data":"5881a080847d188f3e3495f3b88b9d9ee701534aa10ab1819775f085fceeaf65"}
Jul 02 23:11:13.337053 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.337023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qz5kk" event={"ID":"5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c","Type":"ContainerStarted","Data":"b4c093b77ec7c9a3b5ffebe0c85f255c6d8e650adf8bfb590529a77a0c91edb9"}
Jul 02 23:11:13.338044 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.338022    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j" event={"ID":"9064dc2f-7a73-480f-93d5-43194ad17c77","Type":"ContainerStarted","Data":"7a803f3929de697a613cc64d4266dcac8faa5ee08b50cf9c8b4584e62cce7a08"}
Jul 02 23:11:13.360857 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.360804    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rgmhn" podStartSLOduration=10.001195176 podStartE2EDuration="39.360785229s" totalImagesPullingTime="29.359590053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:13.359889684 +0000 UTC m=+39.816145915" watchObservedRunningTime="2026-07-02 23:11:13.360785229 +0000 UTC m=+39.817041430"
Jul 02 23:11:13.380023 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.379954    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qz5kk" podStartSLOduration=3.214822993 podStartE2EDuration="5.379936918s" totalImagesPullingTime="2.165113925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:13.379262686 +0000 UTC m=+39.835518905" watchObservedRunningTime="2026-07-02 23:11:13.379936918 +0000 UTC m=+39.836193119"
Jul 02 23:11:13.511020 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.510988    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-gts7b"]
Jul 02 23:11:13.517414 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.517385    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.530135 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.530108    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-gts7b"]
Jul 02 23:11:13.530264 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.530209    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.535645 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.535620    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 02 23:11:13.535895 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.535881    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6rrw5\""
Jul 02 23:11:13.536699 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.536651    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 02 23:11:13.536787 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.536744    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 02 23:11:13.536991 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.536975    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 02 23:11:13.599226 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.599153    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.613410 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.613385    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8da759f-3cd2-4e85-a2c3-a2b61fa71c12-signing-cabundle\") pod \"service-ca-758f599c5-gts7b\" (UID: \"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12\") " pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.614085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.613435    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dhzq\" (UniqueName: \"kubernetes.io/projected/d8da759f-3cd2-4e85-a2c3-a2b61fa71c12-kube-api-access-5dhzq\") pod \"service-ca-758f599c5-gts7b\" (UID: \"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12\") " pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.614085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.613534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8da759f-3cd2-4e85-a2c3-a2b61fa71c12-signing-key\") pod \"service-ca-758f599c5-gts7b\" (UID: \"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12\") " pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.674504 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.674481    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fvxjh_f98f8c84-58ec-4aa4-b876-0b85ee7c203f/node-ca/0.log"
Jul 02 23:11:13.700757 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.700635    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.714774 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.714737    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8da759f-3cd2-4e85-a2c3-a2b61fa71c12-signing-cabundle\") pod \"service-ca-758f599c5-gts7b\" (UID: \"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12\") " pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.714906 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.714794    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dhzq\" (UniqueName: \"kubernetes.io/projected/d8da759f-3cd2-4e85-a2c3-a2b61fa71c12-kube-api-access-5dhzq\") pod \"service-ca-758f599c5-gts7b\" (UID: \"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12\") " pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.714906 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.714849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8da759f-3cd2-4e85-a2c3-a2b61fa71c12-signing-key\") pod \"service-ca-758f599c5-gts7b\" (UID: \"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12\") " pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.715627 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.715600    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8da759f-3cd2-4e85-a2c3-a2b61fa71c12-signing-cabundle\") pod \"service-ca-758f599c5-gts7b\" (UID: \"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12\") " pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.718704 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.718663    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8da759f-3cd2-4e85-a2c3-a2b61fa71c12-signing-key\") pod \"service-ca-758f599c5-gts7b\" (UID: \"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12\") " pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.725002 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.724980    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dhzq\" (UniqueName: \"kubernetes.io/projected/d8da759f-3cd2-4e85-a2c3-a2b61fa71c12-kube-api-access-5dhzq\") pod \"service-ca-758f599c5-gts7b\" (UID: \"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12\") " pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.820987 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.820957    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.841962 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.841941    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-gts7b"
Jul 02 23:11:13.881170 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:13.881123    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:14.108611 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:14.108545    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-gts7b"]
Jul 02 23:11:14.111276 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:14.111251    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8da759f_3cd2_4e85_a2c3_a2b61fa71c12.slice/crio-d6abf7d4b9c24c688e8e381246aa5031e515f92b48f5fb086563fc818a05a355 WatchSource:0}: Error finding container d6abf7d4b9c24c688e8e381246aa5031e515f92b48f5fb086563fc818a05a355: Status 404 returned error can't find the container with id d6abf7d4b9c24c688e8e381246aa5031e515f92b48f5fb086563fc818a05a355
Jul 02 23:11:14.341787 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:14.341757    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j" event={"ID":"9064dc2f-7a73-480f-93d5-43194ad17c77","Type":"ContainerStarted","Data":"d6cc0c043828e030a7816c00af4274a475cea3663f0a6f4b0042c0506c6d663d"}
Jul 02 23:11:14.341926 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:14.341809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j" event={"ID":"9064dc2f-7a73-480f-93d5-43194ad17c77","Type":"ContainerStarted","Data":"95b93b9d6b810635a00d0b9ba7fe900728b8475ec722bba494c3251f03c130d4"}
Jul 02 23:11:14.342983 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:14.342949    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-gts7b" event={"ID":"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12","Type":"ContainerStarted","Data":"d6abf7d4b9c24c688e8e381246aa5031e515f92b48f5fb086563fc818a05a355"}
Jul 02 23:11:14.420218 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:14.420147    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:14.673465 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:14.673374    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qz5kk_5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c/serve-healthcheck-canary/0.log"
Jul 02 23:11:15.024806 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:15.024766    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:15.024991 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:15.024819    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:15.024991 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:15.024903    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:15.024991 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:15.024926    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:15.024991 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:15.024966    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm podName:c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:19.024950975 +0000 UTC m=+45.481207154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5t5sd" (UID: "c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:15.024991 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:15.024989    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls podName:c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:19.024971287 +0000 UTC m=+45.481227468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5t5sd" (UID: "c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:16.640602 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:16.640565    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:16.640602 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:16.640603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:16.641022 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:16.640725    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:16.641022 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:16.640786    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls podName:8ec99751-e29e-4b29-85d0-207ce6456584 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:24.640771281 +0000 UTC m=+51.097027465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls") pod "dns-default-pnp8l" (UID: "8ec99751-e29e-4b29-85d0-207ce6456584") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:16.641022 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:16.640802    2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:16.641022 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:16.640823    2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54f4958867-lzf64: secret "image-registry-tls" not found
Jul 02 23:11:16.641022 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:16.640872    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls podName:049f803a-d822-42ee-b236-dcba961dbf4b nodeName:}" failed. No retries permitted until 2026-07-02 23:11:24.640854709 +0000 UTC m=+51.097110909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls") pod "image-registry-54f4958867-lzf64" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b") : secret "image-registry-tls" not found
Jul 02 23:11:17.351495 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:17.351460    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-gts7b" event={"ID":"d8da759f-3cd2-4e85-a2c3-a2b61fa71c12","Type":"ContainerStarted","Data":"0d59d6a0394e7b3435e7e772fd0ae5bd5ade959d92b5d2e7c3cfb4eb44897d96"}
Jul 02 23:11:17.367224 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:17.367178    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fqx5j" podStartSLOduration=5.012695423 podStartE2EDuration="6.367164636s" totalImagesPullingTime="1.354469213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:14.36199281 +0000 UTC m=+40.818249012" watchObservedRunningTime="2026-07-02 23:11:17.367164636 +0000 UTC m=+43.823420836"
Jul 02 23:11:17.367360 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:17.367252    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-gts7b" podStartSLOduration=2.058890507 podStartE2EDuration="4.367246282s" totalImagesPullingTime="2.308355775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:17.366450537 +0000 UTC m=+43.822706767" watchObservedRunningTime="2026-07-02 23:11:17.367246282 +0000 UTC m=+43.823502511"
Jul 02 23:11:19.061561 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:19.061526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:19.061561 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:19.061564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:19.062037 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:19.061703    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:19.062037 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:19.061771    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls podName:c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:27.061753123 +0000 UTC m=+53.518009311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5t5sd" (UID: "c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:19.062200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:19.062182    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:24.710733 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:24.710694    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:24.710733 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:24.710733    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:24.713062 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:24.713040    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls\") pod \"image-registry-54f4958867-lzf64\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") " pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:24.713137 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:24.713061    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ec99751-e29e-4b29-85d0-207ce6456584-metrics-tls\") pod \"dns-default-pnp8l\" (UID: \"8ec99751-e29e-4b29-85d0-207ce6456584\") " pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:24.793372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:24.793338    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:24.808295 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:24.808268    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:24.951215 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:24.951191    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54f4958867-lzf64"]
Jul 02 23:11:24.953338 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:24.953312    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049f803a_d822_42ee_b236_dcba961dbf4b.slice/crio-76e1f5263b868f220890598721447386c11b94d8af2895526ed642438521069a WatchSource:0}: Error finding container 76e1f5263b868f220890598721447386c11b94d8af2895526ed642438521069a: Status 404 returned error can't find the container with id 76e1f5263b868f220890598721447386c11b94d8af2895526ed642438521069a
Jul 02 23:11:24.961017 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:24.960969    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pnp8l"]
Jul 02 23:11:24.963581 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:24.963563    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec99751_e29e_4b29_85d0_207ce6456584.slice/crio-bd82928f63660a063da07708a746d799b954d1e158b67beb06b5dc5d59e710e1 WatchSource:0}: Error finding container bd82928f63660a063da07708a746d799b954d1e158b67beb06b5dc5d59e710e1: Status 404 returned error can't find the container with id bd82928f63660a063da07708a746d799b954d1e158b67beb06b5dc5d59e710e1
Jul 02 23:11:25.372753 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:25.372713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f4958867-lzf64" event={"ID":"049f803a-d822-42ee-b236-dcba961dbf4b","Type":"ContainerStarted","Data":"33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481"}
Jul 02 23:11:25.372942 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:25.372778    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f4958867-lzf64" event={"ID":"049f803a-d822-42ee-b236-dcba961dbf4b","Type":"ContainerStarted","Data":"76e1f5263b868f220890598721447386c11b94d8af2895526ed642438521069a"}
Jul 02 23:11:25.372942 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:25.372805    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:25.373922 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:25.373895    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pnp8l" event={"ID":"8ec99751-e29e-4b29-85d0-207ce6456584","Type":"ContainerStarted","Data":"bd82928f63660a063da07708a746d799b954d1e158b67beb06b5dc5d59e710e1"}
Jul 02 23:11:25.391319 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:25.391273    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54f4958867-lzf64" podStartSLOduration=24.391256636 podStartE2EDuration="24.391256636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:25.390804411 +0000 UTC m=+51.847060624" watchObservedRunningTime="2026-07-02 23:11:25.391256636 +0000 UTC m=+51.847512839"
Jul 02 23:11:27.131145 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:27.131115    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:27.133167 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:27.133147    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t5sd\" (UID: \"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c\") " pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:27.204781 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:27.204609    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5t5sd"
Jul 02 23:11:27.347811 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:27.347780    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5t5sd"]
Jul 02 23:11:27.351135 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:27.351114    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b41dcd_24a1_4724_9d4a_5e27d8ecec2c.slice/crio-16dddff4763690f36fcc6531df57cb13cce006ac7901eff99dc90e8ae993fbfe WatchSource:0}: Error finding container 16dddff4763690f36fcc6531df57cb13cce006ac7901eff99dc90e8ae993fbfe: Status 404 returned error can't find the container with id 16dddff4763690f36fcc6531df57cb13cce006ac7901eff99dc90e8ae993fbfe
Jul 02 23:11:27.381775 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:27.381742    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pnp8l" event={"ID":"8ec99751-e29e-4b29-85d0-207ce6456584","Type":"ContainerStarted","Data":"c705dc7441bf5b0197bc71b5b9ef676b3b1c05ac6ffd6f30b9df746b419a5323"}
Jul 02 23:11:27.381904 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:27.381806    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pnp8l" event={"ID":"8ec99751-e29e-4b29-85d0-207ce6456584","Type":"ContainerStarted","Data":"65865a54c5a2b68e8d2005046a91e7aa12e2663977856996156ee8f5f5dd7879"}
Jul 02 23:11:27.381904 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:27.381835    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:27.382800 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:27.382781    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5t5sd" event={"ID":"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c","Type":"ContainerStarted","Data":"16dddff4763690f36fcc6531df57cb13cce006ac7901eff99dc90e8ae993fbfe"}
Jul 02 23:11:27.399876 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:27.399829    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pnp8l" podStartSLOduration=17.34730887 podStartE2EDuration="19.399816774s" totalImagesPullingTime="2.052507904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:27.398542549 +0000 UTC m=+53.854798750" watchObservedRunningTime="2026-07-02 23:11:27.399816774 +0000 UTC m=+53.856072975"
Jul 02 23:11:31.398991 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:31.398914    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5t5sd" event={"ID":"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c","Type":"ContainerStarted","Data":"fe58adf58e4bc7a81b5318453ae344cf660057763d2d2e3e2659c29e05ac4adc"}
Jul 02 23:11:32.404739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:32.404703    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5t5sd" event={"ID":"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c","Type":"ContainerStarted","Data":"e00b420d096541a1bde5f1c89324833b11765831c4a33f4eacd01cd9db2a1abb"}
Jul 02 23:11:33.677129 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.676995    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"]
Jul 02 23:11:33.683130 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.683104    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"
Jul 02 23:11:33.686591 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.686563    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 23:11:33.687925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.686979    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"]
Jul 02 23:11:33.687925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.687157    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vh7gf\""
Jul 02 23:11:33.687925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.687365    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 02 23:11:33.687925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.687499    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 23:11:33.690129 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.689700    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.692377 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.690958    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 23:11:33.692377 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.691602    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"]
Jul 02 23:11:33.692377 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.692006    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 02 23:11:33.692377 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.692160    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 02 23:11:33.692870 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.692415    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 02 23:11:33.692870 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.692551    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 02 23:11:33.701000 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.700967    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54f4958867-lzf64"]
Jul 02 23:11:33.710241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.710218    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"]
Jul 02 23:11:33.781346 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.781315    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtjlq\" (UniqueName: \"kubernetes.io/projected/a3a7ff2a-51da-42f4-b91e-6aa9063f996c-kube-api-access-wtjlq\") pod \"managed-serviceaccount-addon-agent-75559c85cb-dvsg9\" (UID: \"a3a7ff2a-51da-42f4-b91e-6aa9063f996c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"
Jul 02 23:11:33.781525 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.781354    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-hub\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.781525 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.781380    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6adf463-6458-4d5a-965b-dba84b7c06f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.781525 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.781417    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4fzl\" (UniqueName: \"kubernetes.io/projected/b6adf463-6458-4d5a-965b-dba84b7c06f0-kube-api-access-j4fzl\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.781525 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.781509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.781787 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.781558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3a7ff2a-51da-42f4-b91e-6aa9063f996c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75559c85cb-dvsg9\" (UID: \"a3a7ff2a-51da-42f4-b91e-6aa9063f996c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"
Jul 02 23:11:33.781787 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.781644    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-ca\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.781787 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.781700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.882239 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.882202    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3a7ff2a-51da-42f4-b91e-6aa9063f996c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75559c85cb-dvsg9\" (UID: \"a3a7ff2a-51da-42f4-b91e-6aa9063f996c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"
Jul 02 23:11:33.882409 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.882254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-ca\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.882409 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.882287    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.882409 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.882321    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtjlq\" (UniqueName: \"kubernetes.io/projected/a3a7ff2a-51da-42f4-b91e-6aa9063f996c-kube-api-access-wtjlq\") pod \"managed-serviceaccount-addon-agent-75559c85cb-dvsg9\" (UID: \"a3a7ff2a-51da-42f4-b91e-6aa9063f996c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"
Jul 02 23:11:33.882409 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.882346    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-hub\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.882619 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.882454    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6adf463-6458-4d5a-965b-dba84b7c06f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.882619 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.882512    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4fzl\" (UniqueName: \"kubernetes.io/projected/b6adf463-6458-4d5a-965b-dba84b7c06f0-kube-api-access-j4fzl\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.882619 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.882576    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.883415 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.883352    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6adf463-6458-4d5a-965b-dba84b7c06f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.885101 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.885071    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-ca\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.885334 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.885314    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.885399 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.885372    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-hub\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.885454 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.885396    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6adf463-6458-4d5a-965b-dba84b7c06f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.886057 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.886039    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3a7ff2a-51da-42f4-b91e-6aa9063f996c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75559c85cb-dvsg9\" (UID: \"a3a7ff2a-51da-42f4-b91e-6aa9063f996c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"
Jul 02 23:11:33.905114 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.905089    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 23:11:33.909637 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.909619    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtjlq\" (UniqueName: \"kubernetes.io/projected/a3a7ff2a-51da-42f4-b91e-6aa9063f996c-kube-api-access-wtjlq\") pod \"managed-serviceaccount-addon-agent-75559c85cb-dvsg9\" (UID: \"a3a7ff2a-51da-42f4-b91e-6aa9063f996c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"
Jul 02 23:11:33.915739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.915717    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4fzl\" (UniqueName: \"kubernetes.io/projected/b6adf463-6458-4d5a-965b-dba84b7c06f0-kube-api-access-j4fzl\") pod \"cluster-proxy-proxy-agent-557449546b-wlqdc\" (UID: \"b6adf463-6458-4d5a-965b-dba84b7c06f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:33.919277 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.919254    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54d8c795dc-k5xz4"]
Jul 02 23:11:33.924835 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.924819    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:33.948181 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.948160    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54d8c795dc-k5xz4"]
Jul 02 23:11:33.983544 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.983521    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab9568e8-2e39-464c-8314-79941a9decd5-registry-tls\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:33.983686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.983555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab9568e8-2e39-464c-8314-79941a9decd5-trusted-ca\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:33.983686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.983578    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab9568e8-2e39-464c-8314-79941a9decd5-bound-sa-token\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:33.983686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.983643    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4htg\" (UniqueName: \"kubernetes.io/projected/ab9568e8-2e39-464c-8314-79941a9decd5-kube-api-access-j4htg\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:33.983830 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.983691    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab9568e8-2e39-464c-8314-79941a9decd5-image-registry-private-configuration\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:33.983830 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.983733    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab9568e8-2e39-464c-8314-79941a9decd5-registry-certificates\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:33.983830 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.983780    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab9568e8-2e39-464c-8314-79941a9decd5-ca-trust-extracted\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:33.983830 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:33.983798    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab9568e8-2e39-464c-8314-79941a9decd5-installation-pull-secrets\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.004438 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.004405    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 23:11:34.009562 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.009540    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"
Jul 02 23:11:34.014709 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.014684    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vh7gf\""
Jul 02 23:11:34.022806 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.022785    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"
Jul 02 23:11:34.084929 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.084904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4htg\" (UniqueName: \"kubernetes.io/projected/ab9568e8-2e39-464c-8314-79941a9decd5-kube-api-access-j4htg\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.084929 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.084934    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab9568e8-2e39-464c-8314-79941a9decd5-image-registry-private-configuration\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.085137 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.084969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab9568e8-2e39-464c-8314-79941a9decd5-registry-certificates\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.085137 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.085002    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab9568e8-2e39-464c-8314-79941a9decd5-ca-trust-extracted\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.085137 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.085019    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab9568e8-2e39-464c-8314-79941a9decd5-installation-pull-secrets\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.085137 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.085054    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab9568e8-2e39-464c-8314-79941a9decd5-registry-tls\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.085137 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.085107    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab9568e8-2e39-464c-8314-79941a9decd5-trusted-ca\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.085846 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.085194    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab9568e8-2e39-464c-8314-79941a9decd5-bound-sa-token\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.085846 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.085577    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab9568e8-2e39-464c-8314-79941a9decd5-ca-trust-extracted\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.086219 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.086195    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab9568e8-2e39-464c-8314-79941a9decd5-trusted-ca\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.086318 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.086278    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab9568e8-2e39-464c-8314-79941a9decd5-registry-certificates\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.087694 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.087653    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab9568e8-2e39-464c-8314-79941a9decd5-installation-pull-secrets\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.087795 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.087738    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab9568e8-2e39-464c-8314-79941a9decd5-image-registry-private-configuration\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.087856 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.087819    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab9568e8-2e39-464c-8314-79941a9decd5-registry-tls\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.099059 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.099036    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab9568e8-2e39-464c-8314-79941a9decd5-bound-sa-token\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.102180 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.102158    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4htg\" (UniqueName: \"kubernetes.io/projected/ab9568e8-2e39-464c-8314-79941a9decd5-kube-api-access-j4htg\") pod \"image-registry-54d8c795dc-k5xz4\" (UID: \"ab9568e8-2e39-464c-8314-79941a9decd5\") " pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.239140 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.239097    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:34.283166 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.283145    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9"]
Jul 02 23:11:34.286320 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:34.286265    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3a7ff2a_51da_42f4_b91e_6aa9063f996c.slice/crio-7e3cbb2912c31cb1d413b96ffe179e948f2f1a58efc81d6376a161d800aa2b90 WatchSource:0}: Error finding container 7e3cbb2912c31cb1d413b96ffe179e948f2f1a58efc81d6376a161d800aa2b90: Status 404 returned error can't find the container with id 7e3cbb2912c31cb1d413b96ffe179e948f2f1a58efc81d6376a161d800aa2b90
Jul 02 23:11:34.288362 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.288268    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc"]
Jul 02 23:11:34.290762 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:34.290728    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6adf463_6458_4d5a_965b_dba84b7c06f0.slice/crio-90214e358a55feb860f951983579cb50c77357b3e216367d4c47679aad6e2a9a WatchSource:0}: Error finding container 90214e358a55feb860f951983579cb50c77357b3e216367d4c47679aad6e2a9a: Status 404 returned error can't find the container with id 90214e358a55feb860f951983579cb50c77357b3e216367d4c47679aad6e2a9a
Jul 02 23:11:34.316626 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.316572    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dssnd"
Jul 02 23:11:34.385626 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.385570    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54d8c795dc-k5xz4"]
Jul 02 23:11:34.388106 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:34.388071    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9568e8_2e39_464c_8314_79941a9decd5.slice/crio-eb5ce7914958418350037b08c3c1987fd3be49cbe431405882d99b683a0bd857 WatchSource:0}: Error finding container eb5ce7914958418350037b08c3c1987fd3be49cbe431405882d99b683a0bd857: Status 404 returned error can't find the container with id eb5ce7914958418350037b08c3c1987fd3be49cbe431405882d99b683a0bd857
Jul 02 23:11:34.414074 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.414043    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5t5sd" event={"ID":"c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c","Type":"ContainerStarted","Data":"8c89c0e2f61fa010bb339320e04371aa957dea32c448030f6b262bb5eccb0491"}
Jul 02 23:11:34.415352 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.415330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9" event={"ID":"a3a7ff2a-51da-42f4-b91e-6aa9063f996c","Type":"ContainerStarted","Data":"7e3cbb2912c31cb1d413b96ffe179e948f2f1a58efc81d6376a161d800aa2b90"}
Jul 02 23:11:34.416484 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.416464    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4" event={"ID":"ab9568e8-2e39-464c-8314-79941a9decd5","Type":"ContainerStarted","Data":"eb5ce7914958418350037b08c3c1987fd3be49cbe431405882d99b683a0bd857"}
Jul 02 23:11:34.417573 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.417556    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc" event={"ID":"b6adf463-6458-4d5a-965b-dba84b7c06f0","Type":"ContainerStarted","Data":"90214e358a55feb860f951983579cb50c77357b3e216367d4c47679aad6e2a9a"}
Jul 02 23:11:34.441934 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:34.441898    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5t5sd" podStartSLOduration=16.646529912 podStartE2EDuration="23.441884361s" totalImagesPullingTime="6.795354449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:34.440858171 +0000 UTC m=+60.897114392" watchObservedRunningTime="2026-07-02 23:11:34.441884361 +0000 UTC m=+60.898140564"
Jul 02 23:11:35.425484 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:35.425447    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4" event={"ID":"ab9568e8-2e39-464c-8314-79941a9decd5","Type":"ContainerStarted","Data":"2c06d12b7925f191ac7e188053b112920ff1b5cc1bcf3a59453389551a9a6bfe"}
Jul 02 23:11:35.425981 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:35.425512    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:35.448786 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:35.448555    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4" podStartSLOduration=2.448537574 podStartE2EDuration="2.448537574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:35.447958489 +0000 UTC m=+61.904214705" watchObservedRunningTime="2026-07-02 23:11:35.448537574 +0000 UTC m=+61.904793757"
Jul 02 23:11:37.391228 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:37.391196    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pnp8l"
Jul 02 23:11:39.441520 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.441482    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9" event={"ID":"a3a7ff2a-51da-42f4-b91e-6aa9063f996c","Type":"ContainerStarted","Data":"225f4b5dd85b366bad846297a81334354be90d33cc886696c7ec863f7f60ef51"}
Jul 02 23:11:39.443464 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.443439    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc" event={"ID":"b6adf463-6458-4d5a-965b-dba84b7c06f0","Type":"ContainerStarted","Data":"388db149dce1c1354ef59f2076913fea267ca9f53af4123d8030dfc53a4a8fc3"}
Jul 02 23:11:39.443593 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.443477    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc" event={"ID":"b6adf463-6458-4d5a-965b-dba84b7c06f0","Type":"ContainerStarted","Data":"31325fff79b2aaf02d8024a9e3252a40608fff3373ec9d3a2a3ec56af345cae1"}
Jul 02 23:11:39.443593 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.443494    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc" event={"ID":"b6adf463-6458-4d5a-965b-dba84b7c06f0","Type":"ContainerStarted","Data":"629f620988ac68de0961c291ad31f4880c3ea09d2b787e95f3215537c5698c99"}
Jul 02 23:11:39.458721 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.458665    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75559c85cb-dvsg9" podStartSLOduration=2.155387431 podStartE2EDuration="6.458650885s" totalImagesPullingTime="4.303263454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:39.457948939 +0000 UTC m=+65.914205161" watchObservedRunningTime="2026-07-02 23:11:39.458650885 +0000 UTC m=+65.914907086"
Jul 02 23:11:39.478805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.478739    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-557449546b-wlqdc" podStartSLOduration=2.16637315 podStartE2EDuration="6.478724848s" totalImagesPullingTime="4.312351698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:39.477912589 +0000 UTC m=+65.934168820" watchObservedRunningTime="2026-07-02 23:11:39.478724848 +0000 UTC m=+65.934981051"
Jul 02 23:11:39.936504 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.936472    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:11:39.936711 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.936524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:11:39.936711 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.936552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmm6\" (UniqueName: \"kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6\") pod \"network-check-target-6x2mn\" (UID: \"d5a92ab5-3480-4de0-99e0-189894ce5f0e\") " pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:39.938998 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.938980    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:11:39.939629 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.939616    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:11:39.939667 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.939631    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 23:11:39.949539 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.949513    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 23:11:39.949865 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.949557    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/13d09a11-ac14-43c3-915a-34f5c085d0d4-original-pull-secret\") pod \"global-pull-secret-syncer-62bxx\" (UID: \"13d09a11-ac14-43c3-915a-34f5c085d0d4\") " pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:11:39.949865 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.949646    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9b03d41-3bec-45a0-9655-41c67a514ff4-metrics-certs\") pod \"network-metrics-daemon-95xd7\" (UID: \"f9b03d41-3bec-45a0-9655-41c67a514ff4\") " pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:11:39.960394 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:39.960367    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slmm6\" (UniqueName: \"kubernetes.io/projected/d5a92ab5-3480-4de0-99e0-189894ce5f0e-kube-api-access-slmm6\") pod \"network-check-target-6x2mn\" (UID: \"d5a92ab5-3480-4de0-99e0-189894ce5f0e\") " pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:40.000326 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.000297    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62bxx"
Jul 02 23:11:40.008936 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.008911    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gmk5n\""
Jul 02 23:11:40.015833 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.015814    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-prtl8\""
Jul 02 23:11:40.017352 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.017336    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:40.024250 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.024228    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-95xd7"
Jul 02 23:11:40.161191 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.161164    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-62bxx"]
Jul 02 23:11:40.163519 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:40.163486    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d09a11_ac14_43c3_915a_34f5c085d0d4.slice/crio-5fb16f4e78cf9adfcc99342eb3577a32904d52111feb942786410245b10958f2 WatchSource:0}: Error finding container 5fb16f4e78cf9adfcc99342eb3577a32904d52111feb942786410245b10958f2: Status 404 returned error can't find the container with id 5fb16f4e78cf9adfcc99342eb3577a32904d52111feb942786410245b10958f2
Jul 02 23:11:40.190687 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.190609    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6x2mn"]
Jul 02 23:11:40.193302 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:40.193281    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a92ab5_3480_4de0_99e0_189894ce5f0e.slice/crio-53218e9de6a9be7fe293bb32dd4454376e99a23d1506829bb0294e27195fb4a3 WatchSource:0}: Error finding container 53218e9de6a9be7fe293bb32dd4454376e99a23d1506829bb0294e27195fb4a3: Status 404 returned error can't find the container with id 53218e9de6a9be7fe293bb32dd4454376e99a23d1506829bb0294e27195fb4a3
Jul 02 23:11:40.201725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.201707    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-95xd7"]
Jul 02 23:11:40.203816 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:40.203794    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b03d41_3bec_45a0_9655_41c67a514ff4.slice/crio-9938115a47c1aada18e9f9d6f379a9fa2b7327723f7893c698d8050a48ac1a2d WatchSource:0}: Error finding container 9938115a47c1aada18e9f9d6f379a9fa2b7327723f7893c698d8050a48ac1a2d: Status 404 returned error can't find the container with id 9938115a47c1aada18e9f9d6f379a9fa2b7327723f7893c698d8050a48ac1a2d
Jul 02 23:11:40.447924 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.447836    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-95xd7" event={"ID":"f9b03d41-3bec-45a0-9655-41c67a514ff4","Type":"ContainerStarted","Data":"9938115a47c1aada18e9f9d6f379a9fa2b7327723f7893c698d8050a48ac1a2d"}
Jul 02 23:11:40.448857 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.448835    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6x2mn" event={"ID":"d5a92ab5-3480-4de0-99e0-189894ce5f0e","Type":"ContainerStarted","Data":"53218e9de6a9be7fe293bb32dd4454376e99a23d1506829bb0294e27195fb4a3"}
Jul 02 23:11:40.449956 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:40.449935    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-62bxx" event={"ID":"13d09a11-ac14-43c3-915a-34f5c085d0d4","Type":"ContainerStarted","Data":"5fb16f4e78cf9adfcc99342eb3577a32904d52111feb942786410245b10958f2"}
Jul 02 23:11:41.457031 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:41.456937    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-95xd7" event={"ID":"f9b03d41-3bec-45a0-9655-41c67a514ff4","Type":"ContainerStarted","Data":"495b087e111afe6e2da7534e415305deba4c6511ea77e87eab3f39357779fbc2"}
Jul 02 23:11:41.457031 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:41.456999    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-95xd7" event={"ID":"f9b03d41-3bec-45a0-9655-41c67a514ff4","Type":"ContainerStarted","Data":"ccf08f568da00a20f40ee166bd9178b2089052b4432c978ab1ef72b49c64d85c"}
Jul 02 23:11:41.477504 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:41.476706    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-95xd7" podStartSLOduration=66.546200518 podStartE2EDuration="1m7.476686488s" totalImagesPullingTime="930.48597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:41.475585687 +0000 UTC m=+67.931841900" watchObservedRunningTime="2026-07-02 23:11:41.476686488 +0000 UTC m=+67.932942685"
Jul 02 23:11:43.708112 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:43.708078    2568 patch_prober.go:28] interesting pod/image-registry-54f4958867-lzf64 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 23:11:43.708602 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:43.708133    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54f4958867-lzf64" podUID="049f803a-d822-42ee-b236-dcba961dbf4b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:11:45.471696 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:45.471636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6x2mn" event={"ID":"d5a92ab5-3480-4de0-99e0-189894ce5f0e","Type":"ContainerStarted","Data":"246e7fb04e8ec0627c6f1660a377e882c80910b86bdde4d498cc5411ec1c6368"}
Jul 02 23:11:45.472148 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:45.471754    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:11:45.473142 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:45.473119    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-62bxx" event={"ID":"13d09a11-ac14-43c3-915a-34f5c085d0d4","Type":"ContainerStarted","Data":"fe42eaf157f7d913a0a846c03e5ae63feaa5601600c327ac12da85bee6a3268b"}
Jul 02 23:11:45.492210 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:45.492170    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6x2mn" podStartSLOduration=66.737994307 podStartE2EDuration="1m11.492157788s" totalImagesPullingTime="4.754163481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:45.491060816 +0000 UTC m=+71.947317017" watchObservedRunningTime="2026-07-02 23:11:45.492157788 +0000 UTC m=+71.948413989"
Jul 02 23:11:45.512749 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:45.512713    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-62bxx" podStartSLOduration=66.725121479 podStartE2EDuration="1m11.512700496s" totalImagesPullingTime="4.787579017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:45.511331081 +0000 UTC m=+71.967587282" watchObservedRunningTime="2026-07-02 23:11:45.512700496 +0000 UTC m=+71.968956708"
Jul 02 23:11:52.317907 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.317877    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vc8sr"]
Jul 02 23:11:52.320638 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.320623    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.329448 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.329429    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 23:11:52.329573 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.329429    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 23:11:52.329801 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.329749    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-82t8x\""
Jul 02 23:11:52.329932 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.329829    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 23:11:52.329932 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.329863    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 23:11:52.329932 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.329920    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 23:11:52.330177 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.330161    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 23:11:52.430061 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.430031    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/783b74d8-7309-455b-ba60-577443250f35-root\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.430061 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.430063    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/783b74d8-7309-455b-ba60-577443250f35-node-exporter-wtmp\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.430300 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.430079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx2cp\" (UniqueName: \"kubernetes.io/projected/783b74d8-7309-455b-ba60-577443250f35-kube-api-access-vx2cp\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.430300 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.430108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/783b74d8-7309-455b-ba60-577443250f35-node-exporter-tls\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.430300 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.430126    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/783b74d8-7309-455b-ba60-577443250f35-sys\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.430300 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.430197    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/783b74d8-7309-455b-ba60-577443250f35-node-exporter-accelerators-collector-config\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.430300 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.430240    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/783b74d8-7309-455b-ba60-577443250f35-node-exporter-textfile\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.430300 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.430294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/783b74d8-7309-455b-ba60-577443250f35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.430531 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.430325    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/783b74d8-7309-455b-ba60-577443250f35-metrics-client-ca\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531237 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/783b74d8-7309-455b-ba60-577443250f35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531237 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/783b74d8-7309-455b-ba60-577443250f35-metrics-client-ca\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/783b74d8-7309-455b-ba60-577443250f35-root\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531284    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/783b74d8-7309-455b-ba60-577443250f35-node-exporter-wtmp\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531308    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx2cp\" (UniqueName: \"kubernetes.io/projected/783b74d8-7309-455b-ba60-577443250f35-kube-api-access-vx2cp\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531343    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/783b74d8-7309-455b-ba60-577443250f35-root\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531351    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/783b74d8-7309-455b-ba60-577443250f35-node-exporter-tls\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531375    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/783b74d8-7309-455b-ba60-577443250f35-sys\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/783b74d8-7309-455b-ba60-577443250f35-node-exporter-accelerators-collector-config\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531432    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/783b74d8-7309-455b-ba60-577443250f35-node-exporter-wtmp\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531437    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/783b74d8-7309-455b-ba60-577443250f35-node-exporter-textfile\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531837 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531490    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/783b74d8-7309-455b-ba60-577443250f35-sys\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531837 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531780    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/783b74d8-7309-455b-ba60-577443250f35-node-exporter-textfile\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.531984 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.531961    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/783b74d8-7309-455b-ba60-577443250f35-node-exporter-accelerators-collector-config\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.532096 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.532076    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/783b74d8-7309-455b-ba60-577443250f35-metrics-client-ca\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.533582 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.533555    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/783b74d8-7309-455b-ba60-577443250f35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.533707 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.533651    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/783b74d8-7309-455b-ba60-577443250f35-node-exporter-tls\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.540122 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.540098    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx2cp\" (UniqueName: \"kubernetes.io/projected/783b74d8-7309-455b-ba60-577443250f35-kube-api-access-vx2cp\") pod \"node-exporter-vc8sr\" (UID: \"783b74d8-7309-455b-ba60-577443250f35\") " pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.628789 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:52.628712    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vc8sr"
Jul 02 23:11:52.638498 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:11:52.638475    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783b74d8_7309_455b_ba60_577443250f35.slice/crio-4d416efdb36b7415e693d1f2be34c85ebba4b4293fa43a068f0c574818e90a64 WatchSource:0}: Error finding container 4d416efdb36b7415e693d1f2be34c85ebba4b4293fa43a068f0c574818e90a64: Status 404 returned error can't find the container with id 4d416efdb36b7415e693d1f2be34c85ebba4b4293fa43a068f0c574818e90a64
Jul 02 23:11:53.503813 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:53.503780    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vc8sr" event={"ID":"783b74d8-7309-455b-ba60-577443250f35","Type":"ContainerStarted","Data":"879d6b0785c8ba1f0251d3dda784e1e8998e3f33d5e367f46ceb3d56cde3e380"}
Jul 02 23:11:53.504240 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:53.503836    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vc8sr" event={"ID":"783b74d8-7309-455b-ba60-577443250f35","Type":"ContainerStarted","Data":"4d416efdb36b7415e693d1f2be34c85ebba4b4293fa43a068f0c574818e90a64"}
Jul 02 23:11:53.705515 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:53.705449    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:54.507811 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:54.507776    2568 generic.go:356] "Generic (PLEG): container finished" podID="783b74d8-7309-455b-ba60-577443250f35" containerID="879d6b0785c8ba1f0251d3dda784e1e8998e3f33d5e367f46ceb3d56cde3e380" exitCode=0
Jul 02 23:11:54.508280 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:54.507829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vc8sr" event={"ID":"783b74d8-7309-455b-ba60-577443250f35","Type":"ContainerDied","Data":"879d6b0785c8ba1f0251d3dda784e1e8998e3f33d5e367f46ceb3d56cde3e380"}
Jul 02 23:11:55.513482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:55.513447    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vc8sr" event={"ID":"783b74d8-7309-455b-ba60-577443250f35","Type":"ContainerStarted","Data":"f9b41d9835d4065abb661cf86446577f03a8f8a75dd4ded032d5277ef92df461"}
Jul 02 23:11:55.513855 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:55.513511    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vc8sr" event={"ID":"783b74d8-7309-455b-ba60-577443250f35","Type":"ContainerStarted","Data":"ddde16f870add35971b9a251fe1161f5b2c24e591ea1d02a3f454eddc37b45ab"}
Jul 02 23:11:55.539909 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:55.539865    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vc8sr" podStartSLOduration=2.721878092 podStartE2EDuration="3.539848258s" totalImagesPullingTime="754.525058ms" totalInitContainerRuntime="63.445108ms" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:55.538483489 +0000 UTC m=+81.994739701" watchObservedRunningTime="2026-07-02 23:11:55.539848258 +0000 UTC m=+81.996104484"
Jul 02 23:11:56.433325 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:56.433293    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54d8c795dc-k5xz4"
Jul 02 23:11:58.731639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:58.731602    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54f4958867-lzf64" podUID="049f803a-d822-42ee-b236-dcba961dbf4b" containerName="registry" containerID="cri-o://33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481" gracePeriod=30
Jul 02 23:11:58.963103 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:58.963079    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:59.082780 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.082751    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-registry-certificates\") pod \"049f803a-d822-42ee-b236-dcba961dbf4b\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") "
Jul 02 23:11:59.082962 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.082790    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-bound-sa-token\") pod \"049f803a-d822-42ee-b236-dcba961dbf4b\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") "
Jul 02 23:11:59.082962 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.082805    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls\") pod \"049f803a-d822-42ee-b236-dcba961dbf4b\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") "
Jul 02 23:11:59.082962 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.082830    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-installation-pull-secrets\") pod \"049f803a-d822-42ee-b236-dcba961dbf4b\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") "
Jul 02 23:11:59.082962 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.082851    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp8fz\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-kube-api-access-vp8fz\") pod \"049f803a-d822-42ee-b236-dcba961dbf4b\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") "
Jul 02 23:11:59.082962 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.082873    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/049f803a-d822-42ee-b236-dcba961dbf4b-ca-trust-extracted\") pod \"049f803a-d822-42ee-b236-dcba961dbf4b\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") "
Jul 02 23:11:59.082962 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.082895    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-trusted-ca\") pod \"049f803a-d822-42ee-b236-dcba961dbf4b\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") "
Jul 02 23:11:59.082962 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.082920    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-image-registry-private-configuration\") pod \"049f803a-d822-42ee-b236-dcba961dbf4b\" (UID: \"049f803a-d822-42ee-b236-dcba961dbf4b\") "
Jul 02 23:11:59.083334 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.083298    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "049f803a-d822-42ee-b236-dcba961dbf4b" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:11:59.083484 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.083459    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "049f803a-d822-42ee-b236-dcba961dbf4b" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:11:59.085639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.085611    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "049f803a-d822-42ee-b236-dcba961dbf4b" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:11:59.085755 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.085690    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "049f803a-d822-42ee-b236-dcba961dbf4b" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:11:59.085755 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.085711    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "049f803a-d822-42ee-b236-dcba961dbf4b" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:11:59.085890 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.085775    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-kube-api-access-vp8fz" (OuterVolumeSpecName: "kube-api-access-vp8fz") pod "049f803a-d822-42ee-b236-dcba961dbf4b" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b"). InnerVolumeSpecName "kube-api-access-vp8fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:11:59.085947 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.085899    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "049f803a-d822-42ee-b236-dcba961dbf4b" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:11:59.091161 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.091142    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/049f803a-d822-42ee-b236-dcba961dbf4b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "049f803a-d822-42ee-b236-dcba961dbf4b" (UID: "049f803a-d822-42ee-b236-dcba961dbf4b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:11:59.183499 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.183470    2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-bound-sa-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:11:59.183499 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.183493    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-registry-tls\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:11:59.183499 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.183502    2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-installation-pull-secrets\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:11:59.183758 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.183511    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp8fz\" (UniqueName: \"kubernetes.io/projected/049f803a-d822-42ee-b236-dcba961dbf4b-kube-api-access-vp8fz\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:11:59.183758 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.183520    2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/049f803a-d822-42ee-b236-dcba961dbf4b-ca-trust-extracted\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:11:59.183758 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.183528    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-trusted-ca\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:11:59.183758 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.183536    2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/049f803a-d822-42ee-b236-dcba961dbf4b-image-registry-private-configuration\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:11:59.183758 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.183545    2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/049f803a-d822-42ee-b236-dcba961dbf4b-registry-certificates\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:11:59.527976 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.527939    2568 generic.go:356] "Generic (PLEG): container finished" podID="049f803a-d822-42ee-b236-dcba961dbf4b" containerID="33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481" exitCode=0
Jul 02 23:11:59.528149 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.528001    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54f4958867-lzf64"
Jul 02 23:11:59.528149 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.528002    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f4958867-lzf64" event={"ID":"049f803a-d822-42ee-b236-dcba961dbf4b","Type":"ContainerDied","Data":"33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481"}
Jul 02 23:11:59.528149 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.528137    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54f4958867-lzf64" event={"ID":"049f803a-d822-42ee-b236-dcba961dbf4b","Type":"ContainerDied","Data":"76e1f5263b868f220890598721447386c11b94d8af2895526ed642438521069a"}
Jul 02 23:11:59.528319 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.528158    2568 scope.go:117] "RemoveContainer" containerID="33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481"
Jul 02 23:11:59.537110 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.537089    2568 scope.go:117] "RemoveContainer" containerID="33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481"
Jul 02 23:11:59.537374 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:11:59.537354    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481\": container with ID starting with 33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481 not found: ID does not exist" containerID="33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481"
Jul 02 23:11:59.537440 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.537380    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481"} err="failed to get container status \"33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481\": rpc error: code = NotFound desc = could not find container \"33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481\": container with ID starting with 33385e3749b5bb9510afbe14afe1bce792c2a8240928eb58a11a0c16b4570481 not found: ID does not exist"
Jul 02 23:11:59.548215 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.548191    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54f4958867-lzf64"]
Jul 02 23:11:59.554177 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:11:59.554156    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54f4958867-lzf64"]
Jul 02 23:12:00.077732 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:12:00.077702    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="049f803a-d822-42ee-b236-dcba961dbf4b" path="/var/lib/kubelet/pods/049f803a-d822-42ee-b236-dcba961dbf4b/volumes"
Jul 02 23:12:16.478553 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:12:16.478520    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6x2mn"
Jul 02 23:12:36.476362 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:12:36.476319    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qz5kk_5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c/serve-healthcheck-canary/0.log"
Jul 02 23:15:33.939607 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:33.939572    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 23:15:34.830847 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.830814    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"]
Jul 02 23:15:34.832107 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.831056    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="049f803a-d822-42ee-b236-dcba961dbf4b" containerName="registry"
Jul 02 23:15:34.832107 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.831068    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="049f803a-d822-42ee-b236-dcba961dbf4b" containerName="registry"
Jul 02 23:15:34.832107 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.831123    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="049f803a-d822-42ee-b236-dcba961dbf4b" containerName="registry"
Jul 02 23:15:34.832737 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.832722    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:34.836609 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.836587    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 23:15:34.836758 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.836732    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p65gt\""
Jul 02 23:15:34.836877 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.836860    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 23:15:34.836950 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.836936    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 23:15:34.837058 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.837047    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 23:15:34.853449 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.853426    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"]
Jul 02 23:15:34.953407 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.953375    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27b545fe-74a0-4c4a-9d50-5edf5484d340-tmp\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:34.953825 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.953413    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27b545fe-74a0-4c4a-9d50-5edf5484d340-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:34.953825 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.953482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jhk4\" (UniqueName: \"kubernetes.io/projected/27b545fe-74a0-4c4a-9d50-5edf5484d340-kube-api-access-5jhk4\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:34.953825 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.953517    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27b545fe-74a0-4c4a-9d50-5edf5484d340-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:34.953825 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:34.953566    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27b545fe-74a0-4c4a-9d50-5edf5484d340-manifests\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.054823 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.054787    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27b545fe-74a0-4c4a-9d50-5edf5484d340-tmp\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.054823 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.054827    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27b545fe-74a0-4c4a-9d50-5edf5484d340-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.055028 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.054863    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jhk4\" (UniqueName: \"kubernetes.io/projected/27b545fe-74a0-4c4a-9d50-5edf5484d340-kube-api-access-5jhk4\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.055028 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.054982    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27b545fe-74a0-4c4a-9d50-5edf5484d340-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.055112 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.055068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27b545fe-74a0-4c4a-9d50-5edf5484d340-manifests\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.055396 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.055377    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27b545fe-74a0-4c4a-9d50-5edf5484d340-manifests\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.057111 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.057087    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27b545fe-74a0-4c4a-9d50-5edf5484d340-tmp\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.057220 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.057202    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27b545fe-74a0-4c4a-9d50-5edf5484d340-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.057374 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.057353    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27b545fe-74a0-4c4a-9d50-5edf5484d340-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.080887 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.080817    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jhk4\" (UniqueName: \"kubernetes.io/projected/27b545fe-74a0-4c4a-9d50-5edf5484d340-kube-api-access-5jhk4\") pod \"opendatahub-operator-controller-manager-7fc9978976-nrclr\" (UID: \"27b545fe-74a0-4c4a-9d50-5edf5484d340\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.142859 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.142820    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:35.301006 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:15:35.300976    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b545fe_74a0_4c4a_9d50_5edf5484d340.slice/crio-f028fc4e3b10a395cd4bbf990ead5e0aa78a53051785470acdeab77f23bfadc9 WatchSource:0}: Error finding container f028fc4e3b10a395cd4bbf990ead5e0aa78a53051785470acdeab77f23bfadc9: Status 404 returned error can't find the container with id f028fc4e3b10a395cd4bbf990ead5e0aa78a53051785470acdeab77f23bfadc9
Jul 02 23:15:35.302739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.302723    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:15:35.308114 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:35.308093    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"]
Jul 02 23:15:36.218629 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:36.218595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr" event={"ID":"27b545fe-74a0-4c4a-9d50-5edf5484d340","Type":"ContainerStarted","Data":"f028fc4e3b10a395cd4bbf990ead5e0aa78a53051785470acdeab77f23bfadc9"}
Jul 02 23:15:38.226548 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:38.226517    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr" event={"ID":"27b545fe-74a0-4c4a-9d50-5edf5484d340","Type":"ContainerStarted","Data":"1aee828a0ed0a90b5c5ea0363e27723a47c97a145789d81727cd0a75d45be2db"}
Jul 02 23:15:40.234765 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:40.234730    2568 generic.go:356] "Generic (PLEG): container finished" podID="27b545fe-74a0-4c4a-9d50-5edf5484d340" containerID="1aee828a0ed0a90b5c5ea0363e27723a47c97a145789d81727cd0a75d45be2db" exitCode=0
Jul 02 23:15:40.235145 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:40.234805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr" event={"ID":"27b545fe-74a0-4c4a-9d50-5edf5484d340","Type":"ContainerDied","Data":"1aee828a0ed0a90b5c5ea0363e27723a47c97a145789d81727cd0a75d45be2db"}
Jul 02 23:15:41.239796 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:41.239765    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr" event={"ID":"27b545fe-74a0-4c4a-9d50-5edf5484d340","Type":"ContainerStarted","Data":"33ecc5ae45334a194a620c2898fc8008e534c5c615fcc8ec63ee3ef10234782a"}
Jul 02 23:15:41.240164 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:41.239969    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:41.269894 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:41.269851    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr" podStartSLOduration=3.011004609 podStartE2EDuration="7.269837272s" totalImagesPullingTime="3.162294478s" totalInitContainerRuntime="1.096538185s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:41.268459548 +0000 UTC m=+307.724715763" watchObservedRunningTime="2026-07-02 23:15:41.269837272 +0000 UTC m=+307.726093534"
Jul 02 23:15:52.245828 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:52.245790    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fc9978976-nrclr"
Jul 02 23:15:55.063571 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.063531    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6wft9"]
Jul 02 23:15:55.073020 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.072990    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:15:55.075531 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.075509    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pmzf9\""
Jul 02 23:15:55.075654 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.075588    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 02 23:15:55.117139 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.117105    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6wft9"]
Jul 02 23:15:55.202131 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.202094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ccf47d2-e249-41fe-982c-751e16bd35b7-cert\") pod \"odh-model-controller-7998c67dc4-6wft9\" (UID: \"9ccf47d2-e249-41fe-982c-751e16bd35b7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:15:55.202338 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.202175    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dxz2\" (UniqueName: \"kubernetes.io/projected/9ccf47d2-e249-41fe-982c-751e16bd35b7-kube-api-access-6dxz2\") pod \"odh-model-controller-7998c67dc4-6wft9\" (UID: \"9ccf47d2-e249-41fe-982c-751e16bd35b7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:15:55.302589 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.302556    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dxz2\" (UniqueName: \"kubernetes.io/projected/9ccf47d2-e249-41fe-982c-751e16bd35b7-kube-api-access-6dxz2\") pod \"odh-model-controller-7998c67dc4-6wft9\" (UID: \"9ccf47d2-e249-41fe-982c-751e16bd35b7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:15:55.302787 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.302611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ccf47d2-e249-41fe-982c-751e16bd35b7-cert\") pod \"odh-model-controller-7998c67dc4-6wft9\" (UID: \"9ccf47d2-e249-41fe-982c-751e16bd35b7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:15:55.302787 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:15:55.302743    2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 02 23:15:55.302860 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:15:55.302834    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccf47d2-e249-41fe-982c-751e16bd35b7-cert podName:9ccf47d2-e249-41fe-982c-751e16bd35b7 nodeName:}" failed. No retries permitted until 2026-07-02 23:15:55.802815291 +0000 UTC m=+322.259071474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ccf47d2-e249-41fe-982c-751e16bd35b7-cert") pod "odh-model-controller-7998c67dc4-6wft9" (UID: "9ccf47d2-e249-41fe-982c-751e16bd35b7") : secret "odh-model-controller-webhook-cert" not found
Jul 02 23:15:55.334971 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.334894    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dxz2\" (UniqueName: \"kubernetes.io/projected/9ccf47d2-e249-41fe-982c-751e16bd35b7-kube-api-access-6dxz2\") pod \"odh-model-controller-7998c67dc4-6wft9\" (UID: \"9ccf47d2-e249-41fe-982c-751e16bd35b7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:15:55.805911 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.805876    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ccf47d2-e249-41fe-982c-751e16bd35b7-cert\") pod \"odh-model-controller-7998c67dc4-6wft9\" (UID: \"9ccf47d2-e249-41fe-982c-751e16bd35b7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:15:55.808171 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.808151    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ccf47d2-e249-41fe-982c-751e16bd35b7-cert\") pod \"odh-model-controller-7998c67dc4-6wft9\" (UID: \"9ccf47d2-e249-41fe-982c-751e16bd35b7\") " pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:15:55.982822 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:55.982793    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:15:56.139555 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:56.139530    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6wft9"]
Jul 02 23:15:56.141646 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:15:56.141623    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ccf47d2_e249_41fe_982c_751e16bd35b7.slice/crio-49da68b166d8afdfc601b7c8396b872469d0c985f9c202209b28fe035e9cfec7 WatchSource:0}: Error finding container 49da68b166d8afdfc601b7c8396b872469d0c985f9c202209b28fe035e9cfec7: Status 404 returned error can't find the container with id 49da68b166d8afdfc601b7c8396b872469d0c985f9c202209b28fe035e9cfec7
Jul 02 23:15:56.290512 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:56.290475    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6wft9" event={"ID":"9ccf47d2-e249-41fe-982c-751e16bd35b7","Type":"ContainerStarted","Data":"49da68b166d8afdfc601b7c8396b872469d0c985f9c202209b28fe035e9cfec7"}
Jul 02 23:15:56.925067 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:56.924770    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"]
Jul 02 23:15:56.927342 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:56.927321    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:56.931326 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:56.931302    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 23:15:56.931448 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:56.931340    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 23:15:56.932115 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:56.932091    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 23:15:56.932312 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:56.932288    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r6cph\""
Jul 02 23:15:56.932535 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:56.932517    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 23:15:56.947620 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:56.947595    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"]
Jul 02 23:15:57.016557 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.016516    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b01f44-34eb-4c7f-ac42-21230baf43df-tls-certs\") pod \"kube-auth-proxy-69478b7d6-nqzmg\" (UID: \"45b01f44-34eb-4c7f-ac42-21230baf43df\") " pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:57.016771 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.016583    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45b01f44-34eb-4c7f-ac42-21230baf43df-tmp\") pod \"kube-auth-proxy-69478b7d6-nqzmg\" (UID: \"45b01f44-34eb-4c7f-ac42-21230baf43df\") " pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:57.016771 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.016648    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8df8n\" (UniqueName: \"kubernetes.io/projected/45b01f44-34eb-4c7f-ac42-21230baf43df-kube-api-access-8df8n\") pod \"kube-auth-proxy-69478b7d6-nqzmg\" (UID: \"45b01f44-34eb-4c7f-ac42-21230baf43df\") " pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:57.117839 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.117792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45b01f44-34eb-4c7f-ac42-21230baf43df-tmp\") pod \"kube-auth-proxy-69478b7d6-nqzmg\" (UID: \"45b01f44-34eb-4c7f-ac42-21230baf43df\") " pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:57.118013 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.117871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8df8n\" (UniqueName: \"kubernetes.io/projected/45b01f44-34eb-4c7f-ac42-21230baf43df-kube-api-access-8df8n\") pod \"kube-auth-proxy-69478b7d6-nqzmg\" (UID: \"45b01f44-34eb-4c7f-ac42-21230baf43df\") " pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:57.118013 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.117922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b01f44-34eb-4c7f-ac42-21230baf43df-tls-certs\") pod \"kube-auth-proxy-69478b7d6-nqzmg\" (UID: \"45b01f44-34eb-4c7f-ac42-21230baf43df\") " pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:57.118145 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:15:57.118023    2568 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 02 23:15:57.118145 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:15:57.118084    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b01f44-34eb-4c7f-ac42-21230baf43df-tls-certs podName:45b01f44-34eb-4c7f-ac42-21230baf43df nodeName:}" failed. No retries permitted until 2026-07-02 23:15:57.618064461 +0000 UTC m=+324.074320660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/45b01f44-34eb-4c7f-ac42-21230baf43df-tls-certs") pod "kube-auth-proxy-69478b7d6-nqzmg" (UID: "45b01f44-34eb-4c7f-ac42-21230baf43df") : secret "kube-auth-proxy-tls" not found
Jul 02 23:15:57.120773 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.120720    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45b01f44-34eb-4c7f-ac42-21230baf43df-tmp\") pod \"kube-auth-proxy-69478b7d6-nqzmg\" (UID: \"45b01f44-34eb-4c7f-ac42-21230baf43df\") " pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:57.134008 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.133950    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8df8n\" (UniqueName: \"kubernetes.io/projected/45b01f44-34eb-4c7f-ac42-21230baf43df-kube-api-access-8df8n\") pod \"kube-auth-proxy-69478b7d6-nqzmg\" (UID: \"45b01f44-34eb-4c7f-ac42-21230baf43df\") " pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:57.621868 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.621750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b01f44-34eb-4c7f-ac42-21230baf43df-tls-certs\") pod \"kube-auth-proxy-69478b7d6-nqzmg\" (UID: \"45b01f44-34eb-4c7f-ac42-21230baf43df\") " pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:57.624961 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.624912    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45b01f44-34eb-4c7f-ac42-21230baf43df-tls-certs\") pod \"kube-auth-proxy-69478b7d6-nqzmg\" (UID: \"45b01f44-34eb-4c7f-ac42-21230baf43df\") " pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:57.839979 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:57.839946    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"
Jul 02 23:15:58.722801 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.722770    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg"]
Jul 02 23:15:58.724964 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:15:58.724934    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b01f44_34eb_4c7f_ac42_21230baf43df.slice/crio-1a78df1ea1b4c277b3f92131d55d11af092a372e5410c439246bb18740ec0ff8 WatchSource:0}: Error finding container 1a78df1ea1b4c277b3f92131d55d11af092a372e5410c439246bb18740ec0ff8: Status 404 returned error can't find the container with id 1a78df1ea1b4c277b3f92131d55d11af092a372e5410c439246bb18740ec0ff8
Jul 02 23:15:58.780623 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.780580    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"]
Jul 02 23:15:58.782781 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.782757    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:58.785654 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.785617    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 23:15:58.785654 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.785642    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 23:15:58.785833 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.785654    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rrf95\""
Jul 02 23:15:58.785915 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.785903    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 23:15:58.786114 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.786100    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 23:15:58.806617 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.806584    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"]
Jul 02 23:15:58.934794 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.934704    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:58.934794 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.934744    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-cacerts\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:58.934794 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.934761    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:58.935025 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.934870    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-local-certs\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:58.935025 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.934895    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-token\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:58.935025 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.934917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:58.935025 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:58.934946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nfvh\" (UniqueName: \"kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-kube-api-access-6nfvh\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.035998 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.035960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-local-certs\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.035998 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.035997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-token\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.036260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.036018    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.036260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.036049    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nfvh\" (UniqueName: \"kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-kube-api-access-6nfvh\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.036260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.036075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.036260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.036203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-cacerts\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.036260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.036245    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.036873 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.036845    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.038459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.038436    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-local-certs\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.038593 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.038535    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-cacerts\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.038803 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.038786    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.038901 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.038885    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.046493 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.046464    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-token\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.046635 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.046522    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nfvh\" (UniqueName: \"kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-kube-api-access-6nfvh\") pod \"istiod-openshift-gateway-7574459656-w4szf\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.092747 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.092709    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:15:59.249799 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.249769    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"]
Jul 02 23:15:59.252817 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:15:59.252789    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b29fb8_6536_41fd_a8ba_9a05a7bc0643.slice/crio-8292f1be48a8f130e2083e35901369bde2db96b8b83df9652cdc98acb4dd5575 WatchSource:0}: Error finding container 8292f1be48a8f130e2083e35901369bde2db96b8b83df9652cdc98acb4dd5575: Status 404 returned error can't find the container with id 8292f1be48a8f130e2083e35901369bde2db96b8b83df9652cdc98acb4dd5575
Jul 02 23:15:59.304000 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.303964    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6wft9" event={"ID":"9ccf47d2-e249-41fe-982c-751e16bd35b7","Type":"ContainerStarted","Data":"fee59083b0955640b814bc269371e752650b3be44896b36c5e08359313cd700e"}
Jul 02 23:15:59.304189 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.304104    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:15:59.305235 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.305206    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg" event={"ID":"45b01f44-34eb-4c7f-ac42-21230baf43df","Type":"ContainerStarted","Data":"1a78df1ea1b4c277b3f92131d55d11af092a372e5410c439246bb18740ec0ff8"}
Jul 02 23:15:59.306622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.306597    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf" event={"ID":"54b29fb8-6536-41fd-a8ba-9a05a7bc0643","Type":"ContainerStarted","Data":"8292f1be48a8f130e2083e35901369bde2db96b8b83df9652cdc98acb4dd5575"}
Jul 02 23:15:59.322188 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:15:59.322121    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6wft9" podStartSLOduration=1.853217056 podStartE2EDuration="4.322107622s" totalImagesPullingTime="2.468890566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:59.320055503 +0000 UTC m=+325.776311729" watchObservedRunningTime="2026-07-02 23:15:59.322107622 +0000 UTC m=+325.778363822"
Jul 02 23:16:01.670475 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:01.670438    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:16:01.670802 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:01.670509    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:16:02.320518 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:02.320478    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf" event={"ID":"54b29fb8-6536-41fd-a8ba-9a05a7bc0643","Type":"ContainerStarted","Data":"dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f"}
Jul 02 23:16:02.320744 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:02.320544    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:16:02.322155 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:02.322119    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg" event={"ID":"45b01f44-34eb-4c7f-ac42-21230baf43df","Type":"ContainerStarted","Data":"59a036148dcad86a2cb01bbabcb02f9b7ff42154bc0d6bf9594b7ee125881094"}
Jul 02 23:16:02.322685 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:02.322650    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-w4szf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 23:16:02.322769 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:02.322715    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf" podUID="54b29fb8-6536-41fd-a8ba-9a05a7bc0643" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:16:02.375452 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:02.375392    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf" podStartSLOduration=1.9603208140000001 podStartE2EDuration="4.375373418s" totalImagesPullingTime="2.415052604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:02.374133544 +0000 UTC m=+328.830389763" watchObservedRunningTime="2026-07-02 23:16:02.375373418 +0000 UTC m=+328.831629618"
Jul 02 23:16:02.414005 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:02.413947    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69478b7d6-nqzmg" podStartSLOduration=3.472439134 podStartE2EDuration="6.41392845s" totalImagesPullingTime="2.941489316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:02.412083975 +0000 UTC m=+328.868340196" watchObservedRunningTime="2026-07-02 23:16:02.41392845 +0000 UTC m=+328.870184651"
Jul 02 23:16:03.326386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:03.326353    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-w4szf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 23:16:03.326797 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:03.326405    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf" podUID="54b29fb8-6536-41fd-a8ba-9a05a7bc0643" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:16:04.555133 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.555074    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"]
Jul 02 23:16:04.557855 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.557828    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.562067 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.562043    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wfpzg\""
Jul 02 23:16:04.623846 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.623812    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"]
Jul 02 23:16:04.690635 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.690601    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.690635 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.690640    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.690941 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.690666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.690941 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.690747    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.690941 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.690803    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c262ba43-0ad4-41b0-913a-63134a7555bf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.690941 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.690852    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.690941 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.690902    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.690941 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.690936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.691168 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.690970    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jpzf\" (UniqueName: \"kubernetes.io/projected/c262ba43-0ad4-41b0-913a-63134a7555bf-kube-api-access-5jpzf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.791820 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.791786    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.791820 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.791825    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.791843    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.791858    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.791892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c262ba43-0ad4-41b0-913a-63134a7555bf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.791929    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.791966    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.791995    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.792030    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jpzf\" (UniqueName: \"kubernetes.io/projected/c262ba43-0ad4-41b0-913a-63134a7555bf-kube-api-access-5jpzf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792419 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.792330    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792419 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.792348    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792520 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.792493    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.792597 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.792570    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.793075 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.793044    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c262ba43-0ad4-41b0-913a-63134a7555bf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.794422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.794400    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.794623 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.794607    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.810489 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.810417    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c262ba43-0ad4-41b0-913a-63134a7555bf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.812913 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.812893    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jpzf\" (UniqueName: \"kubernetes.io/projected/c262ba43-0ad4-41b0-913a-63134a7555bf-kube-api-access-5jpzf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4zs8jq\" (UID: \"c262ba43-0ad4-41b0-913a-63134a7555bf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:04.868143 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:04.868110    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:05.039096 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:05.038970    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"]
Jul 02 23:16:05.041607 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:16:05.041583    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc262ba43_0ad4_41b0_913a_63134a7555bf.slice/crio-b3826373e552b9c106f63f651a48cf6a1835abe8cbbaef316df47ac0575e6cfe WatchSource:0}: Error finding container b3826373e552b9c106f63f651a48cf6a1835abe8cbbaef316df47ac0575e6cfe: Status 404 returned error can't find the container with id b3826373e552b9c106f63f651a48cf6a1835abe8cbbaef316df47ac0575e6cfe
Jul 02 23:16:05.335062 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:05.335024    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq" event={"ID":"c262ba43-0ad4-41b0-913a-63134a7555bf","Type":"ContainerStarted","Data":"b3826373e552b9c106f63f651a48cf6a1835abe8cbbaef316df47ac0575e6cfe"}
Jul 02 23:16:06.327518 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.327483    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:16:06.353965 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.353917    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"]
Jul 02 23:16:06.357505 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.357477    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:06.361039 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.360795    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-tpq62\""
Jul 02 23:16:06.362938 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.362419    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 02 23:16:06.364392 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.363453    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"]
Jul 02 23:16:06.367893 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.367859    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"
Jul 02 23:16:06.371524 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.371498    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 02 23:16:06.371806 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.371506    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5lfqv\""
Jul 02 23:16:06.405577 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.404542    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"]
Jul 02 23:16:06.447118 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.447084    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"]
Jul 02 23:16:06.506640 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.506594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9bqw\" (UniqueName: \"kubernetes.io/projected/d065eb0b-fab0-4f57-a343-cda94b3fc4d4-kube-api-access-s9bqw\") pod \"kserve-controller-manager-d6f4b65b8-2mm7b\" (UID: \"d065eb0b-fab0-4f57-a343-cda94b3fc4d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"
Jul 02 23:16:06.506640 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.506644    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh2zh\" (UniqueName: \"kubernetes.io/projected/bcad56d5-27c5-4202-aae3-4fb1befcc556-kube-api-access-wh2zh\") pod \"llmisvc-controller-manager-777c6bd7d5-zf4dk\" (UID: \"bcad56d5-27c5-4202-aae3-4fb1befcc556\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:06.506901 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.506702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d065eb0b-fab0-4f57-a343-cda94b3fc4d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-2mm7b\" (UID: \"d065eb0b-fab0-4f57-a343-cda94b3fc4d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"
Jul 02 23:16:06.506901 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.506752    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcad56d5-27c5-4202-aae3-4fb1befcc556-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zf4dk\" (UID: \"bcad56d5-27c5-4202-aae3-4fb1befcc556\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:06.607970 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.607888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9bqw\" (UniqueName: \"kubernetes.io/projected/d065eb0b-fab0-4f57-a343-cda94b3fc4d4-kube-api-access-s9bqw\") pod \"kserve-controller-manager-d6f4b65b8-2mm7b\" (UID: \"d065eb0b-fab0-4f57-a343-cda94b3fc4d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"
Jul 02 23:16:06.607970 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.607938    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2zh\" (UniqueName: \"kubernetes.io/projected/bcad56d5-27c5-4202-aae3-4fb1befcc556-kube-api-access-wh2zh\") pod \"llmisvc-controller-manager-777c6bd7d5-zf4dk\" (UID: \"bcad56d5-27c5-4202-aae3-4fb1befcc556\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:06.608196 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.607971    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d065eb0b-fab0-4f57-a343-cda94b3fc4d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-2mm7b\" (UID: \"d065eb0b-fab0-4f57-a343-cda94b3fc4d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"
Jul 02 23:16:06.608196 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.608020    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcad56d5-27c5-4202-aae3-4fb1befcc556-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zf4dk\" (UID: \"bcad56d5-27c5-4202-aae3-4fb1befcc556\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:06.608196 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:16:06.608129    2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 02 23:16:06.608196 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:16:06.608189    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcad56d5-27c5-4202-aae3-4fb1befcc556-cert podName:bcad56d5-27c5-4202-aae3-4fb1befcc556 nodeName:}" failed. No retries permitted until 2026-07-02 23:16:07.108169014 +0000 UTC m=+333.564425193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcad56d5-27c5-4202-aae3-4fb1befcc556-cert") pod "llmisvc-controller-manager-777c6bd7d5-zf4dk" (UID: "bcad56d5-27c5-4202-aae3-4fb1befcc556") : secret "llmisvc-webhook-server-cert" not found
Jul 02 23:16:06.611176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.611142    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d065eb0b-fab0-4f57-a343-cda94b3fc4d4-cert\") pod \"kserve-controller-manager-d6f4b65b8-2mm7b\" (UID: \"d065eb0b-fab0-4f57-a343-cda94b3fc4d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"
Jul 02 23:16:06.629217 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.629179    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9bqw\" (UniqueName: \"kubernetes.io/projected/d065eb0b-fab0-4f57-a343-cda94b3fc4d4-kube-api-access-s9bqw\") pod \"kserve-controller-manager-d6f4b65b8-2mm7b\" (UID: \"d065eb0b-fab0-4f57-a343-cda94b3fc4d4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"
Jul 02 23:16:06.633643 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.633611    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh2zh\" (UniqueName: \"kubernetes.io/projected/bcad56d5-27c5-4202-aae3-4fb1befcc556-kube-api-access-wh2zh\") pod \"llmisvc-controller-manager-777c6bd7d5-zf4dk\" (UID: \"bcad56d5-27c5-4202-aae3-4fb1befcc556\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:06.685609 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:06.685569    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"
Jul 02 23:16:07.113626 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:07.113583    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcad56d5-27c5-4202-aae3-4fb1befcc556-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zf4dk\" (UID: \"bcad56d5-27c5-4202-aae3-4fb1befcc556\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:07.116455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:07.116428    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcad56d5-27c5-4202-aae3-4fb1befcc556-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zf4dk\" (UID: \"bcad56d5-27c5-4202-aae3-4fb1befcc556\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:07.275908 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:07.275867    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:07.570769 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:07.570725    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:16:07.571137 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:07.570825    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:16:07.571137 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:07.570880    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:16:07.766694 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:07.766640    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"]
Jul 02 23:16:07.768667 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:07.768380    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"]
Jul 02 23:16:07.772002 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:16:07.771968    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd065eb0b_fab0_4f57_a343_cda94b3fc4d4.slice/crio-75185c575d6c476ea385e381156dfc76a775aba4ab002b969bb474151c84ed0d WatchSource:0}: Error finding container 75185c575d6c476ea385e381156dfc76a775aba4ab002b969bb474151c84ed0d: Status 404 returned error can't find the container with id 75185c575d6c476ea385e381156dfc76a775aba4ab002b969bb474151c84ed0d
Jul 02 23:16:07.779877 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:16:07.779842    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbcad56d5_27c5_4202_aae3_4fb1befcc556.slice/crio-e747fd6ac968797b3a54a1372166c29e47a3e73ef33d234e140302818c3dbf5b WatchSource:0}: Error finding container e747fd6ac968797b3a54a1372166c29e47a3e73ef33d234e140302818c3dbf5b: Status 404 returned error can't find the container with id e747fd6ac968797b3a54a1372166c29e47a3e73ef33d234e140302818c3dbf5b
Jul 02 23:16:08.352058 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:08.352020    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq" event={"ID":"c262ba43-0ad4-41b0-913a-63134a7555bf","Type":"ContainerStarted","Data":"0cb5cc1c582f8f33ade6bc9fefcdf7545b3dded84dfbefff920804b1518c569a"}
Jul 02 23:16:08.353348 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:08.353310    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk" event={"ID":"bcad56d5-27c5-4202-aae3-4fb1befcc556","Type":"ContainerStarted","Data":"e747fd6ac968797b3a54a1372166c29e47a3e73ef33d234e140302818c3dbf5b"}
Jul 02 23:16:08.354742 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:08.354711    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b" event={"ID":"d065eb0b-fab0-4f57-a343-cda94b3fc4d4","Type":"ContainerStarted","Data":"75185c575d6c476ea385e381156dfc76a775aba4ab002b969bb474151c84ed0d"}
Jul 02 23:16:08.868517 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:08.868477    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:09.005877 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:09.005774    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:09.085297 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:09.085099    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq" podStartSLOduration=2.558233316 podStartE2EDuration="5.085072894s" totalImagesPullingTime="2.526839578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:08.409213753 +0000 UTC m=+334.865469965" watchObservedRunningTime="2026-07-02 23:16:09.085072894 +0000 UTC m=+335.541329096"
Jul 02 23:16:09.360090 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:09.360057    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:09.362001 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:09.361969    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4zs8jq"
Jul 02 23:16:10.314458 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:10.314429    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6wft9"
Jul 02 23:16:11.371067 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:11.371026    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk" event={"ID":"bcad56d5-27c5-4202-aae3-4fb1befcc556","Type":"ContainerStarted","Data":"0f1ce85879db4803bf14d23020430b7973d525a91f3668597382e63d18acfb99"}
Jul 02 23:16:11.371520 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:11.371131    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:11.372684 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:11.372646    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b" event={"ID":"d065eb0b-fab0-4f57-a343-cda94b3fc4d4","Type":"ContainerStarted","Data":"3b340b9192897109d5426012e6c2f7b62135d0c7f36f398ac58ec9c8dd5e4f00"}
Jul 02 23:16:11.372897 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:11.372875    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"
Jul 02 23:16:11.419649 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:11.419587    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk" podStartSLOduration=2.609407478 podStartE2EDuration="5.419568588s" totalImagesPullingTime="2.81016111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:11.41894881 +0000 UTC m=+337.875205012" watchObservedRunningTime="2026-07-02 23:16:11.419568588 +0000 UTC m=+337.875824788"
Jul 02 23:16:11.474651 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:11.474589    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b" podStartSLOduration=2.660157658 podStartE2EDuration="5.474570997s" totalImagesPullingTime="2.814413339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:11.47329476 +0000 UTC m=+337.929550962" watchObservedRunningTime="2026-07-02 23:16:11.474570997 +0000 UTC m=+337.930827197"
Jul 02 23:16:12.806462 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:12.806421    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"]
Jul 02 23:16:12.806992 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:12.806667    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf" podUID="54b29fb8-6536-41fd-a8ba-9a05a7bc0643" containerName="discovery" containerID="cri-o://dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f" gracePeriod=30
Jul 02 23:16:13.052251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.052216    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:16:13.167982 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.167883    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-kubeconfig\") pod \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") "
Jul 02 23:16:13.167982 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.167935    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-local-certs\") pod \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") "
Jul 02 23:16:13.167982 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.167959    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-token\") pod \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") "
Jul 02 23:16:13.168231 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.167998    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-ca-configmap\") pod \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") "
Jul 02 23:16:13.168231 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.168021    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-dns-cert\") pod \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") "
Jul 02 23:16:13.168231 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.168119    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-cacerts\") pod \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") "
Jul 02 23:16:13.168231 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.168144    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nfvh\" (UniqueName: \"kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-kube-api-access-6nfvh\") pod \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\" (UID: \"54b29fb8-6536-41fd-a8ba-9a05a7bc0643\") "
Jul 02 23:16:13.168480 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.168439    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "54b29fb8-6536-41fd-a8ba-9a05a7bc0643" (UID: "54b29fb8-6536-41fd-a8ba-9a05a7bc0643"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:16:13.170695 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.170649    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "54b29fb8-6536-41fd-a8ba-9a05a7bc0643" (UID: "54b29fb8-6536-41fd-a8ba-9a05a7bc0643"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:16:13.170695 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.170669    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-cacerts" (OuterVolumeSpecName: "cacerts") pod "54b29fb8-6536-41fd-a8ba-9a05a7bc0643" (UID: "54b29fb8-6536-41fd-a8ba-9a05a7bc0643"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:16:13.170695 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.170645    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-local-certs" (OuterVolumeSpecName: "local-certs") pod "54b29fb8-6536-41fd-a8ba-9a05a7bc0643" (UID: "54b29fb8-6536-41fd-a8ba-9a05a7bc0643"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:16:13.170917 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.170702    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-token" (OuterVolumeSpecName: "istio-token") pod "54b29fb8-6536-41fd-a8ba-9a05a7bc0643" (UID: "54b29fb8-6536-41fd-a8ba-9a05a7bc0643"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:16:13.170917 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.170771    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "54b29fb8-6536-41fd-a8ba-9a05a7bc0643" (UID: "54b29fb8-6536-41fd-a8ba-9a05a7bc0643"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:16:13.170917 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.170787    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-kube-api-access-6nfvh" (OuterVolumeSpecName: "kube-api-access-6nfvh") pod "54b29fb8-6536-41fd-a8ba-9a05a7bc0643" (UID: "54b29fb8-6536-41fd-a8ba-9a05a7bc0643"). InnerVolumeSpecName "kube-api-access-6nfvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:16:13.269532 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.269491    2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-cacerts\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:16:13.269532 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.269528    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nfvh\" (UniqueName: \"kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-kube-api-access-6nfvh\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:16:13.269532 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.269538    2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-kubeconfig\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:16:13.269867 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.269548    2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-local-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:16:13.269867 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.269557    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:16:13.269867 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.269565    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-ca-configmap\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:16:13.269867 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.269573    2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/54b29fb8-6536-41fd-a8ba-9a05a7bc0643-istio-csr-dns-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:16:13.382573 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.382536    2568 generic.go:356] "Generic (PLEG): container finished" podID="54b29fb8-6536-41fd-a8ba-9a05a7bc0643" containerID="dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f" exitCode=0
Jul 02 23:16:13.382573 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.382577    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"
Jul 02 23:16:13.382813 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.382622    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf" event={"ID":"54b29fb8-6536-41fd-a8ba-9a05a7bc0643","Type":"ContainerDied","Data":"dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f"}
Jul 02 23:16:13.382813 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.382691    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w4szf" event={"ID":"54b29fb8-6536-41fd-a8ba-9a05a7bc0643","Type":"ContainerDied","Data":"8292f1be48a8f130e2083e35901369bde2db96b8b83df9652cdc98acb4dd5575"}
Jul 02 23:16:13.382813 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.382713    2568 scope.go:117] "RemoveContainer" containerID="dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f"
Jul 02 23:16:13.392053 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.392034    2568 scope.go:117] "RemoveContainer" containerID="dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f"
Jul 02 23:16:13.392343 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:16:13.392325    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f\": container with ID starting with dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f not found: ID does not exist" containerID="dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f"
Jul 02 23:16:13.392391 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.392352    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f"} err="failed to get container status \"dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f\": rpc error: code = NotFound desc = could not find container \"dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f\": container with ID starting with dbcd8be1ee28f2bc6594c26fec04c79008b9d707cffa37b7133e94bc04b4e03f not found: ID does not exist"
Jul 02 23:16:13.405759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.405723    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"]
Jul 02 23:16:13.412286 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:13.412253    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w4szf"]
Jul 02 23:16:14.078632 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:14.078590    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54b29fb8-6536-41fd-a8ba-9a05a7bc0643" path="/var/lib/kubelet/pods/54b29fb8-6536-41fd-a8ba-9a05a7bc0643/volumes"
Jul 02 23:16:42.379823 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:42.379789    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zf4dk"
Jul 02 23:16:42.382783 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:42.382759    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2mm7b"
Jul 02 23:16:55.556247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.556205    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-65zhq"]
Jul 02 23:16:55.556783 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.556618    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b29fb8-6536-41fd-a8ba-9a05a7bc0643" containerName="discovery"
Jul 02 23:16:55.556783 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.556635    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b29fb8-6536-41fd-a8ba-9a05a7bc0643" containerName="discovery"
Jul 02 23:16:55.556783 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.556737    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="54b29fb8-6536-41fd-a8ba-9a05a7bc0643" containerName="discovery"
Jul 02 23:16:55.569407 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.569378    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-65zhq"
Jul 02 23:16:55.572940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.572905    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 23:16:55.573631 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.573603    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 23:16:55.574115 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.573604    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-x8bvs\""
Jul 02 23:16:55.576038 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.575966    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-65zhq"]
Jul 02 23:16:55.695220 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.695180    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4df5l\" (UniqueName: \"kubernetes.io/projected/8dd4f449-4373-41fb-be5e-ed6bcefc07bf-kube-api-access-4df5l\") pod \"kuadrant-operator-catalog-65zhq\" (UID: \"8dd4f449-4373-41fb-be5e-ed6bcefc07bf\") " pod="kuadrant-system/kuadrant-operator-catalog-65zhq"
Jul 02 23:16:55.796197 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.796155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4df5l\" (UniqueName: \"kubernetes.io/projected/8dd4f449-4373-41fb-be5e-ed6bcefc07bf-kube-api-access-4df5l\") pod \"kuadrant-operator-catalog-65zhq\" (UID: \"8dd4f449-4373-41fb-be5e-ed6bcefc07bf\") " pod="kuadrant-system/kuadrant-operator-catalog-65zhq"
Jul 02 23:16:55.804797 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.804772    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4df5l\" (UniqueName: \"kubernetes.io/projected/8dd4f449-4373-41fb-be5e-ed6bcefc07bf-kube-api-access-4df5l\") pod \"kuadrant-operator-catalog-65zhq\" (UID: \"8dd4f449-4373-41fb-be5e-ed6bcefc07bf\") " pod="kuadrant-system/kuadrant-operator-catalog-65zhq"
Jul 02 23:16:55.880923 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.880832    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-65zhq"
Jul 02 23:16:55.909015 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:55.908970    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-65zhq"]
Jul 02 23:16:56.024619 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:56.024592    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-65zhq"]
Jul 02 23:16:56.027010 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:16:56.026983    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd4f449_4373_41fb_be5e_ed6bcefc07bf.slice/crio-5b56a39d0a091f1a0814341ac7bd2188cd17e80baf94a73a1e859241cdfaf097 WatchSource:0}: Error finding container 5b56a39d0a091f1a0814341ac7bd2188cd17e80baf94a73a1e859241cdfaf097: Status 404 returned error can't find the container with id 5b56a39d0a091f1a0814341ac7bd2188cd17e80baf94a73a1e859241cdfaf097
Jul 02 23:16:56.119329 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:56.119289    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7dbpk"]
Jul 02 23:16:56.121552 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:56.121534    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7dbpk"
Jul 02 23:16:56.130478 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:56.130439    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7dbpk"]
Jul 02 23:16:56.199800 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:56.199666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxpmt\" (UniqueName: \"kubernetes.io/projected/1f7c9207-60ef-46d6-9146-80e9482c9e9d-kube-api-access-vxpmt\") pod \"kuadrant-operator-catalog-7dbpk\" (UID: \"1f7c9207-60ef-46d6-9146-80e9482c9e9d\") " pod="kuadrant-system/kuadrant-operator-catalog-7dbpk"
Jul 02 23:16:56.300795 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:56.300751    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxpmt\" (UniqueName: \"kubernetes.io/projected/1f7c9207-60ef-46d6-9146-80e9482c9e9d-kube-api-access-vxpmt\") pod \"kuadrant-operator-catalog-7dbpk\" (UID: \"1f7c9207-60ef-46d6-9146-80e9482c9e9d\") " pod="kuadrant-system/kuadrant-operator-catalog-7dbpk"
Jul 02 23:16:56.310094 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:56.310068    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxpmt\" (UniqueName: \"kubernetes.io/projected/1f7c9207-60ef-46d6-9146-80e9482c9e9d-kube-api-access-vxpmt\") pod \"kuadrant-operator-catalog-7dbpk\" (UID: \"1f7c9207-60ef-46d6-9146-80e9482c9e9d\") " pod="kuadrant-system/kuadrant-operator-catalog-7dbpk"
Jul 02 23:16:56.432078 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:56.432047    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7dbpk"
Jul 02 23:16:56.549393 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:56.549340    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-65zhq" event={"ID":"8dd4f449-4373-41fb-be5e-ed6bcefc07bf","Type":"ContainerStarted","Data":"5b56a39d0a091f1a0814341ac7bd2188cd17e80baf94a73a1e859241cdfaf097"}
Jul 02 23:16:56.668167 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:56.668142    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7dbpk"]
Jul 02 23:16:56.789665 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:16:56.789567    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7c9207_60ef_46d6_9146_80e9482c9e9d.slice/crio-02224e1373798e35b01813390603f243f1a301c3f9489d296ea14cca2a7a52c2 WatchSource:0}: Error finding container 02224e1373798e35b01813390603f243f1a301c3f9489d296ea14cca2a7a52c2: Status 404 returned error can't find the container with id 02224e1373798e35b01813390603f243f1a301c3f9489d296ea14cca2a7a52c2
Jul 02 23:16:57.556056 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:57.556014    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7dbpk" event={"ID":"1f7c9207-60ef-46d6-9146-80e9482c9e9d","Type":"ContainerStarted","Data":"02224e1373798e35b01813390603f243f1a301c3f9489d296ea14cca2a7a52c2"}
Jul 02 23:16:58.562129 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:58.562088    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7dbpk" event={"ID":"1f7c9207-60ef-46d6-9146-80e9482c9e9d","Type":"ContainerStarted","Data":"033eb0e804f438d1c58ef2e9ee863f1bc5260aab29a429888f43624cd4873dd7"}
Jul 02 23:16:58.563606 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:58.563574    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-65zhq" event={"ID":"8dd4f449-4373-41fb-be5e-ed6bcefc07bf","Type":"ContainerStarted","Data":"ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358"}
Jul 02 23:16:58.563774 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:58.563646    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-65zhq" podUID="8dd4f449-4373-41fb-be5e-ed6bcefc07bf" containerName="registry-server" containerID="cri-o://ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358" gracePeriod=2
Jul 02 23:16:58.592622 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:58.592569    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7dbpk" podStartSLOduration=1.6027481799999999 podStartE2EDuration="2.592552768s" totalImagesPullingTime="989.804588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:58.591554382 +0000 UTC m=+385.047810584" watchObservedRunningTime="2026-07-02 23:16:58.592552768 +0000 UTC m=+385.048808968"
Jul 02 23:16:58.607580 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:58.607525    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-65zhq" podStartSLOduration=1.8511729369999999 podStartE2EDuration="3.607506397s" totalImagesPullingTime="1.75633346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:58.607064633 +0000 UTC m=+385.063320863" watchObservedRunningTime="2026-07-02 23:16:58.607506397 +0000 UTC m=+385.063762598"
Jul 02 23:16:58.810031 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:58.810002    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-65zhq"
Jul 02 23:16:58.921626 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:58.921523    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4df5l\" (UniqueName: \"kubernetes.io/projected/8dd4f449-4373-41fb-be5e-ed6bcefc07bf-kube-api-access-4df5l\") pod \"8dd4f449-4373-41fb-be5e-ed6bcefc07bf\" (UID: \"8dd4f449-4373-41fb-be5e-ed6bcefc07bf\") "
Jul 02 23:16:58.923828 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:58.923797    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dd4f449-4373-41fb-be5e-ed6bcefc07bf-kube-api-access-4df5l" (OuterVolumeSpecName: "kube-api-access-4df5l") pod "8dd4f449-4373-41fb-be5e-ed6bcefc07bf" (UID: "8dd4f449-4373-41fb-be5e-ed6bcefc07bf"). InnerVolumeSpecName "kube-api-access-4df5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:16:59.023140 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:59.023098    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4df5l\" (UniqueName: \"kubernetes.io/projected/8dd4f449-4373-41fb-be5e-ed6bcefc07bf-kube-api-access-4df5l\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:16:59.569242 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:59.569204    2568 generic.go:356] "Generic (PLEG): container finished" podID="8dd4f449-4373-41fb-be5e-ed6bcefc07bf" containerID="ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358" exitCode=0
Jul 02 23:16:59.569723 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:59.569248    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-65zhq"
Jul 02 23:16:59.569723 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:59.569286    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-65zhq" event={"ID":"8dd4f449-4373-41fb-be5e-ed6bcefc07bf","Type":"ContainerDied","Data":"ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358"}
Jul 02 23:16:59.569723 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:59.569335    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-65zhq" event={"ID":"8dd4f449-4373-41fb-be5e-ed6bcefc07bf","Type":"ContainerDied","Data":"5b56a39d0a091f1a0814341ac7bd2188cd17e80baf94a73a1e859241cdfaf097"}
Jul 02 23:16:59.569723 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:59.569364    2568 scope.go:117] "RemoveContainer" containerID="ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358"
Jul 02 23:16:59.579101 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:59.579075    2568 scope.go:117] "RemoveContainer" containerID="ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358"
Jul 02 23:16:59.579392 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:16:59.579368    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358\": container with ID starting with ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358 not found: ID does not exist" containerID="ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358"
Jul 02 23:16:59.579436 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:59.579403    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358"} err="failed to get container status \"ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358\": rpc error: code = NotFound desc = could not find container \"ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358\": container with ID starting with ff38c145fe27d1c81ab3b0f0f0b77ed086fb09720ebede1847ab12084dc5f358 not found: ID does not exist"
Jul 02 23:16:59.591519 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:59.591486    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-65zhq"]
Jul 02 23:16:59.599521 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:16:59.599490    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-65zhq"]
Jul 02 23:17:00.078697 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:00.078649    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dd4f449-4373-41fb-be5e-ed6bcefc07bf" path="/var/lib/kubelet/pods/8dd4f449-4373-41fb-be5e-ed6bcefc07bf/volumes"
Jul 02 23:17:06.432596 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:06.432564    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7dbpk"
Jul 02 23:17:06.433171 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:06.432717    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7dbpk"
Jul 02 23:17:06.455958 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:06.455930    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7dbpk"
Jul 02 23:17:06.621764 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:06.621735    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7dbpk"
Jul 02 23:17:23.806644 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:23.806606    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"]
Jul 02 23:17:23.807159 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:23.806921    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dd4f449-4373-41fb-be5e-ed6bcefc07bf" containerName="registry-server"
Jul 02 23:17:23.807159 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:23.806933    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dd4f449-4373-41fb-be5e-ed6bcefc07bf" containerName="registry-server"
Jul 02 23:17:23.807159 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:23.806980    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dd4f449-4373-41fb-be5e-ed6bcefc07bf" containerName="registry-server"
Jul 02 23:17:23.809829 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:23.809806    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:23.814298 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:23.814270    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dss75\""
Jul 02 23:17:23.825551 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:23.825515    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"]
Jul 02 23:17:23.927189 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:23.927152    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xphf\" (UniqueName: \"kubernetes.io/projected/767e37fa-50d7-48a3-9fca-f2bc1badf3dd-kube-api-access-8xphf\") pod \"limitador-operator-controller-manager-859d7b78bd-xm4h8\" (UID: \"767e37fa-50d7-48a3-9fca-f2bc1badf3dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:24.028582 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:24.028543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xphf\" (UniqueName: \"kubernetes.io/projected/767e37fa-50d7-48a3-9fca-f2bc1badf3dd-kube-api-access-8xphf\") pod \"limitador-operator-controller-manager-859d7b78bd-xm4h8\" (UID: \"767e37fa-50d7-48a3-9fca-f2bc1badf3dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:24.067324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:24.067240    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xphf\" (UniqueName: \"kubernetes.io/projected/767e37fa-50d7-48a3-9fca-f2bc1badf3dd-kube-api-access-8xphf\") pod \"limitador-operator-controller-manager-859d7b78bd-xm4h8\" (UID: \"767e37fa-50d7-48a3-9fca-f2bc1badf3dd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:24.119740 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:24.119702    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:24.275245 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:24.275208    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"]
Jul 02 23:17:24.279585 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:17:24.279546    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767e37fa_50d7_48a3_9fca_f2bc1badf3dd.slice/crio-af02a3fa8ae2fad55533a89316eeb4e07083048be3dfbbc0f088b10b9530046f WatchSource:0}: Error finding container af02a3fa8ae2fad55533a89316eeb4e07083048be3dfbbc0f088b10b9530046f: Status 404 returned error can't find the container with id af02a3fa8ae2fad55533a89316eeb4e07083048be3dfbbc0f088b10b9530046f
Jul 02 23:17:24.673448 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:24.673404    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8" event={"ID":"767e37fa-50d7-48a3-9fca-f2bc1badf3dd","Type":"ContainerStarted","Data":"af02a3fa8ae2fad55533a89316eeb4e07083048be3dfbbc0f088b10b9530046f"}
Jul 02 23:17:26.683601 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:26.683557    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8" event={"ID":"767e37fa-50d7-48a3-9fca-f2bc1badf3dd","Type":"ContainerStarted","Data":"8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7"}
Jul 02 23:17:26.684024 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:26.683631    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:26.706233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:26.706175    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8" podStartSLOduration=2.34715823 podStartE2EDuration="3.706157298s" totalImagesPullingTime="1.358999068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:26.70456973 +0000 UTC m=+413.160825931" watchObservedRunningTime="2026-07-02 23:17:26.706157298 +0000 UTC m=+413.162413499"
Jul 02 23:17:29.567094 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.567054    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"]
Jul 02 23:17:29.569349 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.569329    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:29.573857 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.573822    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zzc7z\""
Jul 02 23:17:29.586817 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.586775    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"]
Jul 02 23:17:29.675474 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.675435    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnv5n\" (UniqueName: \"kubernetes.io/projected/a764b661-cfb8-49ba-bed0-74ffd0747844-kube-api-access-mnv5n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" (UID: \"a764b661-cfb8-49ba-bed0-74ffd0747844\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:29.675704 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.675516    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a764b661-cfb8-49ba-bed0-74ffd0747844-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" (UID: \"a764b661-cfb8-49ba-bed0-74ffd0747844\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:29.776824 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.776778    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnv5n\" (UniqueName: \"kubernetes.io/projected/a764b661-cfb8-49ba-bed0-74ffd0747844-kube-api-access-mnv5n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" (UID: \"a764b661-cfb8-49ba-bed0-74ffd0747844\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:29.777029 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.776886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a764b661-cfb8-49ba-bed0-74ffd0747844-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" (UID: \"a764b661-cfb8-49ba-bed0-74ffd0747844\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:29.777290 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.777265    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a764b661-cfb8-49ba-bed0-74ffd0747844-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" (UID: \"a764b661-cfb8-49ba-bed0-74ffd0747844\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:29.793910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.793882    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnv5n\" (UniqueName: \"kubernetes.io/projected/a764b661-cfb8-49ba-bed0-74ffd0747844-kube-api-access-mnv5n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" (UID: \"a764b661-cfb8-49ba-bed0-74ffd0747844\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:29.879940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:29.879843    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:30.049591 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:30.049556    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"]
Jul 02 23:17:30.052729 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:17:30.052698    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda764b661_cfb8_49ba_bed0_74ffd0747844.slice/crio-21fcf58056d7bcbb74efed85eced2ca5e11dc7fd492cb3554dc288bf81a1068c WatchSource:0}: Error finding container 21fcf58056d7bcbb74efed85eced2ca5e11dc7fd492cb3554dc288bf81a1068c: Status 404 returned error can't find the container with id 21fcf58056d7bcbb74efed85eced2ca5e11dc7fd492cb3554dc288bf81a1068c
Jul 02 23:17:30.701055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:30.701018    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd" event={"ID":"a764b661-cfb8-49ba-bed0-74ffd0747844","Type":"ContainerStarted","Data":"21fcf58056d7bcbb74efed85eced2ca5e11dc7fd492cb3554dc288bf81a1068c"}
Jul 02 23:17:32.331495 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:32.331454    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lbc92"]
Jul 02 23:17:32.335363 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:32.335324    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lbc92"
Jul 02 23:17:32.338314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:32.338285    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kzgbp\""
Jul 02 23:17:32.355852 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:32.355816    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lbc92"]
Jul 02 23:17:32.501583 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:32.501543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv5hv\" (UniqueName: \"kubernetes.io/projected/aeb3c012-5516-4d46-a6a4-c38ee5d61617-kube-api-access-qv5hv\") pod \"authorino-operator-75cc8d5cb7-lbc92\" (UID: \"aeb3c012-5516-4d46-a6a4-c38ee5d61617\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lbc92"
Jul 02 23:17:32.602191 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:32.602092    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv5hv\" (UniqueName: \"kubernetes.io/projected/aeb3c012-5516-4d46-a6a4-c38ee5d61617-kube-api-access-qv5hv\") pod \"authorino-operator-75cc8d5cb7-lbc92\" (UID: \"aeb3c012-5516-4d46-a6a4-c38ee5d61617\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lbc92"
Jul 02 23:17:32.615306 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:32.615273    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv5hv\" (UniqueName: \"kubernetes.io/projected/aeb3c012-5516-4d46-a6a4-c38ee5d61617-kube-api-access-qv5hv\") pod \"authorino-operator-75cc8d5cb7-lbc92\" (UID: \"aeb3c012-5516-4d46-a6a4-c38ee5d61617\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lbc92"
Jul 02 23:17:32.648809 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:32.648662    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lbc92"
Jul 02 23:17:33.543989 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:33.543961    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lbc92"]
Jul 02 23:17:33.547019 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:17:33.546990    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb3c012_5516_4d46_a6a4_c38ee5d61617.slice/crio-afa12cdbdff3fe425bd8fad523545762d0de3712b058fa86056372a465a9fc1b WatchSource:0}: Error finding container afa12cdbdff3fe425bd8fad523545762d0de3712b058fa86056372a465a9fc1b: Status 404 returned error can't find the container with id afa12cdbdff3fe425bd8fad523545762d0de3712b058fa86056372a465a9fc1b
Jul 02 23:17:33.717029 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:33.716925    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lbc92" event={"ID":"aeb3c012-5516-4d46-a6a4-c38ee5d61617","Type":"ContainerStarted","Data":"afa12cdbdff3fe425bd8fad523545762d0de3712b058fa86056372a465a9fc1b"}
Jul 02 23:17:33.718630 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:33.718598    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd" event={"ID":"a764b661-cfb8-49ba-bed0-74ffd0747844","Type":"ContainerStarted","Data":"623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108"}
Jul 02 23:17:33.718822 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:33.718709    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:33.758084 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:33.758021    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd" podStartSLOduration=1.395278147 podStartE2EDuration="4.75800332s" totalImagesPullingTime="3.362725173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:33.756953285 +0000 UTC m=+420.213209504" watchObservedRunningTime="2026-07-02 23:17:33.75800332 +0000 UTC m=+420.214259521"
Jul 02 23:17:35.690709 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:35.690650    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw"]
Jul 02 23:17:35.694450 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:35.694424    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw"
Jul 02 23:17:35.697133 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:35.697103    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 02 23:17:35.697133 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:35.697116    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5qxhd\""
Jul 02 23:17:35.715365 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:35.715325    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw"]
Jul 02 23:17:35.727666 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:35.727631    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp79b\" (UniqueName: \"kubernetes.io/projected/fe694108-ce41-416b-b20d-5f5139b867a5-kube-api-access-qp79b\") pod \"dns-operator-controller-manager-864dd78c4c-df2vw\" (UID: \"fe694108-ce41-416b-b20d-5f5139b867a5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw"
Jul 02 23:17:35.828732 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:35.828689    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp79b\" (UniqueName: \"kubernetes.io/projected/fe694108-ce41-416b-b20d-5f5139b867a5-kube-api-access-qp79b\") pod \"dns-operator-controller-manager-864dd78c4c-df2vw\" (UID: \"fe694108-ce41-416b-b20d-5f5139b867a5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw"
Jul 02 23:17:35.856033 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:35.856000    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp79b\" (UniqueName: \"kubernetes.io/projected/fe694108-ce41-416b-b20d-5f5139b867a5-kube-api-access-qp79b\") pod \"dns-operator-controller-manager-864dd78c4c-df2vw\" (UID: \"fe694108-ce41-416b-b20d-5f5139b867a5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw"
Jul 02 23:17:36.008646 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.008551    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw"
Jul 02 23:17:36.184713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.184665    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw"]
Jul 02 23:17:36.186566 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:17:36.186538    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe694108_ce41_416b_b20d_5f5139b867a5.slice/crio-5d0e1f48c213b42daf0cc91f6ddb594465e60638121832cc3026e53a619a2582 WatchSource:0}: Error finding container 5d0e1f48c213b42daf0cc91f6ddb594465e60638121832cc3026e53a619a2582: Status 404 returned error can't find the container with id 5d0e1f48c213b42daf0cc91f6ddb594465e60638121832cc3026e53a619a2582
Jul 02 23:17:36.738823 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.738713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lbc92" event={"ID":"aeb3c012-5516-4d46-a6a4-c38ee5d61617","Type":"ContainerStarted","Data":"586e9385670113f8fd0eab366cafa56237cbfb6d304552a4500d2f5c939495c8"}
Jul 02 23:17:36.738823 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.738788    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lbc92"
Jul 02 23:17:36.740459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.740398    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw" event={"ID":"fe694108-ce41-416b-b20d-5f5139b867a5","Type":"ContainerStarted","Data":"5d0e1f48c213b42daf0cc91f6ddb594465e60638121832cc3026e53a619a2582"}
Jul 02 23:17:36.793284 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.793218    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lbc92" podStartSLOduration=2.494609737 podStartE2EDuration="4.793197069s" totalImagesPullingTime="2.298587332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:36.792136517 +0000 UTC m=+423.248392709" watchObservedRunningTime="2026-07-02 23:17:36.793197069 +0000 UTC m=+423.249453272"
Jul 02 23:17:36.938578 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.938535    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"]
Jul 02 23:17:36.942208 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.942178    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:36.947890 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.947488    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rrj7j\""
Jul 02 23:17:36.947890 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.947636    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 23:17:36.947890 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.947893    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 23:17:36.957593 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:36.957558    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"]
Jul 02 23:17:37.036796 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.036760    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sf5z8\" (UID: \"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:37.036999 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.036809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sf5z8\" (UID: \"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:37.036999 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.036835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t28jl\" (UniqueName: \"kubernetes.io/projected/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-kube-api-access-t28jl\") pod \"kuadrant-console-plugin-66b5774985-sf5z8\" (UID: \"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:37.137978 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.137942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sf5z8\" (UID: \"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:37.137978 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.137981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sf5z8\" (UID: \"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:37.138253 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.138006    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t28jl\" (UniqueName: \"kubernetes.io/projected/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-kube-api-access-t28jl\") pod \"kuadrant-console-plugin-66b5774985-sf5z8\" (UID: \"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:37.138253 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:37.138096    2568 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 02 23:17:37.138253 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:37.138166    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-plugin-serving-cert podName:874dab85-bc7b-46c5-b3f0-e5fa3b9628ea nodeName:}" failed. No retries permitted until 2026-07-02 23:17:37.638145828 +0000 UTC m=+424.094402009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-sf5z8" (UID: "874dab85-bc7b-46c5-b3f0-e5fa3b9628ea") : secret "plugin-serving-cert" not found
Jul 02 23:17:37.138834 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.138809    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-sf5z8\" (UID: \"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:37.148183 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.148147    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t28jl\" (UniqueName: \"kubernetes.io/projected/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-kube-api-access-t28jl\") pod \"kuadrant-console-plugin-66b5774985-sf5z8\" (UID: \"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:37.642179 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.642149    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sf5z8\" (UID: \"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:37.644443 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.644422    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/874dab85-bc7b-46c5-b3f0-e5fa3b9628ea-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-sf5z8\" (UID: \"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:37.690720 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.690692    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:37.747896 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.747855    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw" event={"ID":"fe694108-ce41-416b-b20d-5f5139b867a5","Type":"ContainerStarted","Data":"ed1f741d28472e35da8135a2885a3bb2d631b5b1777f869f7b746bf5ed4e2d95"}
Jul 02 23:17:37.748320 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.748194    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw"
Jul 02 23:17:37.773614 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.773560    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw" podStartSLOduration=1.2984070189999999 podStartE2EDuration="2.773540861s" totalImagesPullingTime="1.475133842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:37.772311007 +0000 UTC m=+424.228567208" watchObservedRunningTime="2026-07-02 23:17:37.773540861 +0000 UTC m=+424.229797062"
Jul 02 23:17:37.857205 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:37.857149    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"
Jul 02 23:17:38.000585 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:38.000559    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8"]
Jul 02 23:17:38.003217 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:17:38.003180    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod874dab85_bc7b_46c5_b3f0_e5fa3b9628ea.slice/crio-d8c4af8313ff812806f6c91aa938a69efaf1fe750c18205f21ba1b1109b33019 WatchSource:0}: Error finding container d8c4af8313ff812806f6c91aa938a69efaf1fe750c18205f21ba1b1109b33019: Status 404 returned error can't find the container with id d8c4af8313ff812806f6c91aa938a69efaf1fe750c18205f21ba1b1109b33019
Jul 02 23:17:38.756154 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:38.756108    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8" event={"ID":"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea","Type":"ContainerStarted","Data":"d8c4af8313ff812806f6c91aa938a69efaf1fe750c18205f21ba1b1109b33019"}
Jul 02 23:17:44.726442 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:44.726403    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:46.776058 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.776022    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"]
Jul 02 23:17:46.776527 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.776275    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" containerName="manager" containerID="cri-o://623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108" gracePeriod=2
Jul 02 23:17:46.783588 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.783555    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"]
Jul 02 23:17:46.794006 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:46.793958    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:46.870216 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.870173    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"]
Jul 02 23:17:46.870538 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.870462    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" containerName="manager" containerID="cri-o://8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7" gracePeriod=2
Jul 02 23:17:46.879249 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.879192    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"]
Jul 02 23:17:46.902513 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.902397    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"]
Jul 02 23:17:46.902854 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.902835    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" containerName="manager"
Jul 02 23:17:46.902854 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.902854    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" containerName="manager"
Jul 02 23:17:46.903025 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.902882    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" containerName="manager"
Jul 02 23:17:46.903025 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.902889    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" containerName="manager"
Jul 02 23:17:46.903025 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.902945    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" containerName="manager"
Jul 02 23:17:46.903025 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.902960    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" containerName="manager"
Jul 02 23:17:46.907137 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.907104    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:17:46.922551 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:46.922504    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:46.925966 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.925930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e924f19d-4317-42e9-b27b-ce706480a30c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cnppj\" (UID: \"e924f19d-4317-42e9-b27b-ce706480a30c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:17:46.926144 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.925995    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skp7q\" (UniqueName: \"kubernetes.io/projected/e924f19d-4317-42e9-b27b-ce706480a30c-kube-api-access-skp7q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cnppj\" (UID: \"e924f19d-4317-42e9-b27b-ce706480a30c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:17:46.926729 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:46.926665    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:46.929288 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.929260    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4"]
Jul 02 23:17:46.932832 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.932808    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4"
Jul 02 23:17:46.957893 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.957860    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"]
Jul 02 23:17:46.995593 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:46.995550    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xm4h8\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:46.996286 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:46.996209    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4"]
Jul 02 23:17:46.998889 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:46.998841    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xm4h8\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:47.001172 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:47.001131    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:47.026790 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:47.026695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnms8\" (UniqueName: \"kubernetes.io/projected/84d83def-bfb6-4b96-9fb8-31ac2a79bfbd-kube-api-access-wnms8\") pod \"limitador-operator-controller-manager-859d7b78bd-mbfm4\" (UID: \"84d83def-bfb6-4b96-9fb8-31ac2a79bfbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4"
Jul 02 23:17:47.026790 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:47.026761    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e924f19d-4317-42e9-b27b-ce706480a30c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cnppj\" (UID: \"e924f19d-4317-42e9-b27b-ce706480a30c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:17:47.027014 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:47.026839    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skp7q\" (UniqueName: \"kubernetes.io/projected/e924f19d-4317-42e9-b27b-ce706480a30c-kube-api-access-skp7q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cnppj\" (UID: \"e924f19d-4317-42e9-b27b-ce706480a30c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:17:47.027153 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:47.027131    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e924f19d-4317-42e9-b27b-ce706480a30c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cnppj\" (UID: \"e924f19d-4317-42e9-b27b-ce706480a30c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:17:47.048834 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:47.048799    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skp7q\" (UniqueName: \"kubernetes.io/projected/e924f19d-4317-42e9-b27b-ce706480a30c-kube-api-access-skp7q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cnppj\" (UID: \"e924f19d-4317-42e9-b27b-ce706480a30c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:17:47.127847 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:47.127797    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnms8\" (UniqueName: \"kubernetes.io/projected/84d83def-bfb6-4b96-9fb8-31ac2a79bfbd-kube-api-access-wnms8\") pod \"limitador-operator-controller-manager-859d7b78bd-mbfm4\" (UID: \"84d83def-bfb6-4b96-9fb8-31ac2a79bfbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4"
Jul 02 23:17:47.142598 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:47.142567    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnms8\" (UniqueName: \"kubernetes.io/projected/84d83def-bfb6-4b96-9fb8-31ac2a79bfbd-kube-api-access-wnms8\") pod \"limitador-operator-controller-manager-859d7b78bd-mbfm4\" (UID: \"84d83def-bfb6-4b96-9fb8-31ac2a79bfbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4"
Jul 02 23:17:47.258029 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:47.257983    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:17:47.267552 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:47.267479    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4"
Jul 02 23:17:47.751175 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:47.751144    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lbc92"
Jul 02 23:17:47.753575 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:47.753533    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:47.779100 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:47.779062    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xm4h8\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:48.689840 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.689261    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.24:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 23:17:48.710718 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.710681    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"]
Jul 02 23:17:48.754320 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.754286    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"]
Jul 02 23:17:48.754473 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.754436    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:17:48.759137 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.759108    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-df2vw"
Jul 02 23:17:48.846400 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.846360    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdr7t\" (UniqueName: \"kubernetes.io/projected/fd5c5f11-8743-4244-b740-83343b9bc57a-kube-api-access-kdr7t\") pod \"kuadrant-operator-controller-manager-86878c769f-2c8hs\" (UID: \"fd5c5f11-8743-4244-b740-83343b9bc57a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:17:48.846931 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.846555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5f11-8743-4244-b740-83343b9bc57a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2c8hs\" (UID: \"fd5c5f11-8743-4244-b740-83343b9bc57a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:17:48.948234 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.948139    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdr7t\" (UniqueName: \"kubernetes.io/projected/fd5c5f11-8743-4244-b740-83343b9bc57a-kube-api-access-kdr7t\") pod \"kuadrant-operator-controller-manager-86878c769f-2c8hs\" (UID: \"fd5c5f11-8743-4244-b740-83343b9bc57a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:17:48.948234 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.948206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5f11-8743-4244-b740-83343b9bc57a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2c8hs\" (UID: \"fd5c5f11-8743-4244-b740-83343b9bc57a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:17:48.948661 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.948622    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5f11-8743-4244-b740-83343b9bc57a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2c8hs\" (UID: \"fd5c5f11-8743-4244-b740-83343b9bc57a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:17:48.965436 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:48.965398    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdr7t\" (UniqueName: \"kubernetes.io/projected/fd5c5f11-8743-4244-b740-83343b9bc57a-kube-api-access-kdr7t\") pod \"kuadrant-operator-controller-manager-86878c769f-2c8hs\" (UID: \"fd5c5f11-8743-4244-b740-83343b9bc57a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:17:49.067573 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:49.067468    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:17:59.349959 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.349930    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:59.352330 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.352233    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:59.355113 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.354404    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:59.356541 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.356389    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xm4h8\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:59.358187 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.357890    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:59.397429 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.397398    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4"]
Jul 02 23:17:59.399473 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:17:59.399439    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d83def_bfb6_4b96_9fb8_31ac2a79bfbd.slice/crio-b7070b86022510c531772b982c1580009b713a4f94a9f4d9a2f70be9fee798f6 WatchSource:0}: Error finding container b7070b86022510c531772b982c1580009b713a4f94a9f4d9a2f70be9fee798f6: Status 404 returned error can't find the container with id b7070b86022510c531772b982c1580009b713a4f94a9f4d9a2f70be9fee798f6
Jul 02 23:17:59.451976 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.451945    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xphf\" (UniqueName: \"kubernetes.io/projected/767e37fa-50d7-48a3-9fca-f2bc1badf3dd-kube-api-access-8xphf\") pod \"767e37fa-50d7-48a3-9fca-f2bc1badf3dd\" (UID: \"767e37fa-50d7-48a3-9fca-f2bc1badf3dd\") "
Jul 02 23:17:59.452132 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.451986    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnv5n\" (UniqueName: \"kubernetes.io/projected/a764b661-cfb8-49ba-bed0-74ffd0747844-kube-api-access-mnv5n\") pod \"a764b661-cfb8-49ba-bed0-74ffd0747844\" (UID: \"a764b661-cfb8-49ba-bed0-74ffd0747844\") "
Jul 02 23:17:59.452132 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.452015    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a764b661-cfb8-49ba-bed0-74ffd0747844-extensions-socket-volume\") pod \"a764b661-cfb8-49ba-bed0-74ffd0747844\" (UID: \"a764b661-cfb8-49ba-bed0-74ffd0747844\") "
Jul 02 23:17:59.452481 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.452454    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a764b661-cfb8-49ba-bed0-74ffd0747844-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a764b661-cfb8-49ba-bed0-74ffd0747844" (UID: "a764b661-cfb8-49ba-bed0-74ffd0747844"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:17:59.453993 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.453966    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/767e37fa-50d7-48a3-9fca-f2bc1badf3dd-kube-api-access-8xphf" (OuterVolumeSpecName: "kube-api-access-8xphf") pod "767e37fa-50d7-48a3-9fca-f2bc1badf3dd" (UID: "767e37fa-50d7-48a3-9fca-f2bc1badf3dd"). InnerVolumeSpecName "kube-api-access-8xphf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:17:59.454128 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.454106    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a764b661-cfb8-49ba-bed0-74ffd0747844-kube-api-access-mnv5n" (OuterVolumeSpecName: "kube-api-access-mnv5n") pod "a764b661-cfb8-49ba-bed0-74ffd0747844" (UID: "a764b661-cfb8-49ba-bed0-74ffd0747844"). InnerVolumeSpecName "kube-api-access-mnv5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:17:59.552849 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.552813    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xphf\" (UniqueName: \"kubernetes.io/projected/767e37fa-50d7-48a3-9fca-f2bc1badf3dd-kube-api-access-8xphf\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:17:59.552849 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.552846    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnv5n\" (UniqueName: \"kubernetes.io/projected/a764b661-cfb8-49ba-bed0-74ffd0747844-kube-api-access-mnv5n\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:17:59.552849 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.552856    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a764b661-cfb8-49ba-bed0-74ffd0747844-extensions-socket-volume\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:17:59.710747 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.710694    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"]
Jul 02 23:17:59.713689 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:17:59.713627    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode924f19d_4317_42e9_b27b_ce706480a30c.slice/crio-7d512f4d867b2e345a1647633951ecdf6c6dd42a2f81535110accae944dc425e WatchSource:0}: Error finding container 7d512f4d867b2e345a1647633951ecdf6c6dd42a2f81535110accae944dc425e: Status 404 returned error can't find the container with id 7d512f4d867b2e345a1647633951ecdf6c6dd42a2f81535110accae944dc425e
Jul 02 23:17:59.751192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.751169    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"]
Jul 02 23:17:59.755280 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:17:59.755249    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5c5f11_8743_4244_b740_83343b9bc57a.slice/crio-63eea34857158ff0f0bb7f5aa144ad2f76ab7a8ceb35430353dc4e96bb3947b0 WatchSource:0}: Error finding container 63eea34857158ff0f0bb7f5aa144ad2f76ab7a8ceb35430353dc4e96bb3947b0: Status 404 returned error can't find the container with id 63eea34857158ff0f0bb7f5aa144ad2f76ab7a8ceb35430353dc4e96bb3947b0
Jul 02 23:17:59.868247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.868213    2568 generic.go:356] "Generic (PLEG): container finished" podID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" containerID="8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7" exitCode=0
Jul 02 23:17:59.868457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.868269    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:59.868457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.868264    2568 scope.go:117] "RemoveContainer" containerID="8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7"
Jul 02 23:17:59.869603 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.869582    2568 generic.go:356] "Generic (PLEG): container finished" podID="a764b661-cfb8-49ba-bed0-74ffd0747844" containerID="623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108" exitCode=0
Jul 02 23:17:59.869716 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.869634    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:59.870457 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.870426    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:59.871989 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.871958    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xm4h8\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:59.872121 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.872030    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj" event={"ID":"e924f19d-4317-42e9-b27b-ce706480a30c","Type":"ContainerStarted","Data":"14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b"}
Jul 02 23:17:59.872121 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.872075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj" event={"ID":"e924f19d-4317-42e9-b27b-ce706480a30c","Type":"ContainerStarted","Data":"7d512f4d867b2e345a1647633951ecdf6c6dd42a2f81535110accae944dc425e"}
Jul 02 23:17:59.872318 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.872281    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:17:59.873923 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.873759    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:59.874100 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.874069    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs" event={"ID":"fd5c5f11-8743-4244-b740-83343b9bc57a","Type":"ContainerStarted","Data":"4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7"}
Jul 02 23:17:59.874195 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.874126    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs" event={"ID":"fd5c5f11-8743-4244-b740-83343b9bc57a","Type":"ContainerStarted","Data":"63eea34857158ff0f0bb7f5aa144ad2f76ab7a8ceb35430353dc4e96bb3947b0"}
Jul 02 23:17:59.874195 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.874154    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:17:59.876028 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.876001    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4" event={"ID":"84d83def-bfb6-4b96-9fb8-31ac2a79bfbd","Type":"ContainerStarted","Data":"7addcb2104f44f401abc5c7ecdb8f9eb72a7ff1372b4896356114b5375dbb4a7"}
Jul 02 23:17:59.876156 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.876058    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4"
Jul 02 23:17:59.876156 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.876081    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4" event={"ID":"84d83def-bfb6-4b96-9fb8-31ac2a79bfbd","Type":"ContainerStarted","Data":"b7070b86022510c531772b982c1580009b713a4f94a9f4d9a2f70be9fee798f6"}
Jul 02 23:17:59.877839 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.877814    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8" event={"ID":"874dab85-bc7b-46c5-b3f0-e5fa3b9628ea","Type":"ContainerStarted","Data":"a463b5d1c6e4365a9696ebd5d581fbab7484291784b1d10da3baf9d76640c4c5"}
Jul 02 23:17:59.879459 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.879417    2568 scope.go:117] "RemoveContainer" containerID="8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7"
Jul 02 23:17:59.879725 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.879707    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7\": container with ID starting with 8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7 not found: ID does not exist" containerID="8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7"
Jul 02 23:17:59.879810 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.879740    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7"} err="failed to get container status \"8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7\": rpc error: code = NotFound desc = could not find container \"8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7\": container with ID starting with 8da08697e415b9b4d234c6e222595129d52e7abca35a8a412e2c9e6c79cec2a7 not found: ID does not exist"
Jul 02 23:17:59.879810 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.879764    2568 scope.go:117] "RemoveContainer" containerID="623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108"
Jul 02 23:17:59.888093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.888071    2568 scope.go:117] "RemoveContainer" containerID="623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108"
Jul 02 23:17:59.888404 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.888384    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108\": container with ID starting with 623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108 not found: ID does not exist" containerID="623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108"
Jul 02 23:17:59.888476 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.888416    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108"} err="failed to get container status \"623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108\": rpc error: code = NotFound desc = could not find container \"623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108\": container with ID starting with 623af5f27828ca86d37156d11e0009e41b166355b3c2a706638da733eff45108 not found: ID does not exist"
Jul 02 23:17:59.899632 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.899590    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xm4h8\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:59.899829 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.899634    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj" podStartSLOduration=13.899615992 podStartE2EDuration="13.899615992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:59.897486434 +0000 UTC m=+446.353742659" watchObservedRunningTime="2026-07-02 23:17:59.899615992 +0000 UTC m=+446.355872194"
Jul 02 23:17:59.919132 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.919070    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs" podStartSLOduration=11.919048521 podStartE2EDuration="11.919048521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:59.918793037 +0000 UTC m=+446.375049287" watchObservedRunningTime="2026-07-02 23:17:59.919048521 +0000 UTC m=+446.375304707"
Jul 02 23:17:59.920564 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.920530    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xm4h8\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xm4h8"
Jul 02 23:17:59.939759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.939697    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-sf5z8" podStartSLOduration=2.719657813 podStartE2EDuration="23.939650812s" totalImagesPullingTime="21.219992999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:59.937980679 +0000 UTC m=+446.394236881" watchObservedRunningTime="2026-07-02 23:17:59.939650812 +0000 UTC m=+446.395907012"
Jul 02 23:17:59.939971 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:17:59.939931    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pcvrd\" is forbidden: User \"system:node:ip-10-0-137-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-25.ec2.internal' and this object" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pcvrd"
Jul 02 23:17:59.964575 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:17:59.964451    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4" podStartSLOduration=13.964387759 podStartE2EDuration="13.964387759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:59.962741731 +0000 UTC m=+446.418997949" watchObservedRunningTime="2026-07-02 23:17:59.964387759 +0000 UTC m=+446.420643962"
Jul 02 23:18:00.079082 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:00.079041    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="767e37fa-50d7-48a3-9fca-f2bc1badf3dd" path="/var/lib/kubelet/pods/767e37fa-50d7-48a3-9fca-f2bc1badf3dd/volumes"
Jul 02 23:18:00.079468 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:00.079451    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a764b661-cfb8-49ba-bed0-74ffd0747844" path="/var/lib/kubelet/pods/a764b661-cfb8-49ba-bed0-74ffd0747844/volumes"
Jul 02 23:18:10.887987 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:10.887954    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:18:10.888470 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:10.888029    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbfm4"
Jul 02 23:18:10.888470 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:10.888061    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:18:10.964998 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:10.964961    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"]
Jul 02 23:18:10.965234 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:10.965208    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj" podUID="e924f19d-4317-42e9-b27b-ce706480a30c" containerName="manager" containerID="cri-o://14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b" gracePeriod=10
Jul 02 23:18:11.221687 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.221634    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:18:11.359100 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.359056    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e924f19d-4317-42e9-b27b-ce706480a30c-extensions-socket-volume\") pod \"e924f19d-4317-42e9-b27b-ce706480a30c\" (UID: \"e924f19d-4317-42e9-b27b-ce706480a30c\") "
Jul 02 23:18:11.359279 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.359125    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skp7q\" (UniqueName: \"kubernetes.io/projected/e924f19d-4317-42e9-b27b-ce706480a30c-kube-api-access-skp7q\") pod \"e924f19d-4317-42e9-b27b-ce706480a30c\" (UID: \"e924f19d-4317-42e9-b27b-ce706480a30c\") "
Jul 02 23:18:11.359448 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.359420    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e924f19d-4317-42e9-b27b-ce706480a30c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e924f19d-4317-42e9-b27b-ce706480a30c" (UID: "e924f19d-4317-42e9-b27b-ce706480a30c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:18:11.361201 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.361169    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e924f19d-4317-42e9-b27b-ce706480a30c-kube-api-access-skp7q" (OuterVolumeSpecName: "kube-api-access-skp7q") pod "e924f19d-4317-42e9-b27b-ce706480a30c" (UID: "e924f19d-4317-42e9-b27b-ce706480a30c"). InnerVolumeSpecName "kube-api-access-skp7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:18:11.460733 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.460610    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e924f19d-4317-42e9-b27b-ce706480a30c-extensions-socket-volume\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:18:11.460733 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.460643    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skp7q\" (UniqueName: \"kubernetes.io/projected/e924f19d-4317-42e9-b27b-ce706480a30c-kube-api-access-skp7q\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:18:11.937663 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.937619    2568 generic.go:356] "Generic (PLEG): container finished" podID="e924f19d-4317-42e9-b27b-ce706480a30c" containerID="14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b" exitCode=0
Jul 02 23:18:11.938072 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.937692    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"
Jul 02 23:18:11.938072 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.937704    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj" event={"ID":"e924f19d-4317-42e9-b27b-ce706480a30c","Type":"ContainerDied","Data":"14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b"}
Jul 02 23:18:11.938072 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.937760    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj" event={"ID":"e924f19d-4317-42e9-b27b-ce706480a30c","Type":"ContainerDied","Data":"7d512f4d867b2e345a1647633951ecdf6c6dd42a2f81535110accae944dc425e"}
Jul 02 23:18:11.938072 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.937781    2568 scope.go:117] "RemoveContainer" containerID="14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b"
Jul 02 23:18:11.946711 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.946668    2568 scope.go:117] "RemoveContainer" containerID="14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b"
Jul 02 23:18:11.947092 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:18:11.947072    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b\": container with ID starting with 14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b not found: ID does not exist" containerID="14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b"
Jul 02 23:18:11.947151 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.947101    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b"} err="failed to get container status \"14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b\": rpc error: code = NotFound desc = could not find container \"14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b\": container with ID starting with 14ef6282a36d83c7b1bb687cb58cda268188aa3524c4fc649a97e9ba852f892b not found: ID does not exist"
Jul 02 23:18:11.963609 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.963579    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"]
Jul 02 23:18:11.972037 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:11.972008    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cnppj"]
Jul 02 23:18:12.078546 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:12.078499    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e924f19d-4317-42e9-b27b-ce706480a30c" path="/var/lib/kubelet/pods/e924f19d-4317-42e9-b27b-ce706480a30c/volumes"
Jul 02 23:18:27.253185 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.253150    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"]
Jul 02 23:18:27.253715 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.253620    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e924f19d-4317-42e9-b27b-ce706480a30c" containerName="manager"
Jul 02 23:18:27.253715 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.253637    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e924f19d-4317-42e9-b27b-ce706480a30c" containerName="manager"
Jul 02 23:18:27.253846 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.253775    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e924f19d-4317-42e9-b27b-ce706480a30c" containerName="manager"
Jul 02 23:18:27.256157 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.256135    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.258811 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.258787    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gd5xt\""
Jul 02 23:18:27.268132 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.268100    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"]
Jul 02 23:18:27.281380 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.281333    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.281380 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.281375    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.281666 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.281402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.281666 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.281433    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.281666 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.281483    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.281666 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.281525    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.281666 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.281554    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.281666 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.281604    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.281666 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.281629    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wtrb\" (UniqueName: \"kubernetes.io/projected/27e191d8-835b-4e74-888c-a7cc04b7c5c4-kube-api-access-6wtrb\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382167 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382193    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382248    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382313    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wtrb\" (UniqueName: \"kubernetes.io/projected/27e191d8-835b-4e74-888c-a7cc04b7c5c4-kube-api-access-6wtrb\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382644 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382644 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382644 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382644 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382559    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382644 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382606    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.382924 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.382857    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.383335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.383301    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.383335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.383316    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.384761 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.384735    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.385056 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.385038    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.390996 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.390955    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27e191d8-835b-4e74-888c-a7cc04b7c5c4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.391129 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.391047    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wtrb\" (UniqueName: \"kubernetes.io/projected/27e191d8-835b-4e74-888c-a7cc04b7c5c4-kube-api-access-6wtrb\") pod \"maas-default-gateway-openshift-default-56654dcf7-zzrr2\" (UID: \"27e191d8-835b-4e74-888c-a7cc04b7c5c4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.567135 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.567095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:27.713093 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.713059    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"]
Jul 02 23:18:27.714607 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:18:27.714578    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e191d8_835b_4e74_888c_a7cc04b7c5c4.slice/crio-5409605387c8dd3542cd0dab2528fcdd87f3e6b273101fdbfeaf6dcafd49a0a2 WatchSource:0}: Error finding container 5409605387c8dd3542cd0dab2528fcdd87f3e6b273101fdbfeaf6dcafd49a0a2: Status 404 returned error can't find the container with id 5409605387c8dd3542cd0dab2528fcdd87f3e6b273101fdbfeaf6dcafd49a0a2
Jul 02 23:18:27.716787 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.716752    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:18:27.716890 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.716839    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:18:27.716890 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:27.716884    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:18:28.016706 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:28.016591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2" event={"ID":"27e191d8-835b-4e74-888c-a7cc04b7c5c4","Type":"ContainerStarted","Data":"eae532742acff86fcb1ec175c874e194ab1294a4bb888b116714827601ea9a08"}
Jul 02 23:18:28.016706 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:28.016644    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2" event={"ID":"27e191d8-835b-4e74-888c-a7cc04b7c5c4","Type":"ContainerStarted","Data":"5409605387c8dd3542cd0dab2528fcdd87f3e6b273101fdbfeaf6dcafd49a0a2"}
Jul 02 23:18:28.037463 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:28.037412    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2" podStartSLOduration=1.037395647 podStartE2EDuration="1.037395647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:28.035916834 +0000 UTC m=+474.492173036" watchObservedRunningTime="2026-07-02 23:18:28.037395647 +0000 UTC m=+474.493651847"
Jul 02 23:18:28.567634 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:28.567593    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:28.572760 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:28.572733    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:29.021450 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:29.021417    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:29.022375 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:29.022352    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:18:29.932200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:29.932167    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4726"]
Jul 02 23:18:29.987206 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:29.987154    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4726"]
Jul 02 23:18:29.987409 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:29.987278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j4726"
Jul 02 23:18:29.989657 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:29.989618    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2lq5g\""
Jul 02 23:18:30.002049 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:30.002017    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs6vn\" (UniqueName: \"kubernetes.io/projected/f687787c-064d-415b-9dd4-3c524e1e7c8c-kube-api-access-xs6vn\") pod \"authorino-75d556bd77-j4726\" (UID: \"f687787c-064d-415b-9dd4-3c524e1e7c8c\") " pod="kuadrant-system/authorino-75d556bd77-j4726"
Jul 02 23:18:30.102931 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:30.102892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs6vn\" (UniqueName: \"kubernetes.io/projected/f687787c-064d-415b-9dd4-3c524e1e7c8c-kube-api-access-xs6vn\") pod \"authorino-75d556bd77-j4726\" (UID: \"f687787c-064d-415b-9dd4-3c524e1e7c8c\") " pod="kuadrant-system/authorino-75d556bd77-j4726"
Jul 02 23:18:30.110612 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:30.110581    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs6vn\" (UniqueName: \"kubernetes.io/projected/f687787c-064d-415b-9dd4-3c524e1e7c8c-kube-api-access-xs6vn\") pod \"authorino-75d556bd77-j4726\" (UID: \"f687787c-064d-415b-9dd4-3c524e1e7c8c\") " pod="kuadrant-system/authorino-75d556bd77-j4726"
Jul 02 23:18:30.300475 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:30.300437    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j4726"
Jul 02 23:18:30.461542 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:30.461506    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4726"]
Jul 02 23:18:30.463933 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:18:30.463894    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf687787c_064d_415b_9dd4_3c524e1e7c8c.slice/crio-9a59405999a23fd7a688ab165a02f240bb5e9a56c91742614b19e69441628bb1 WatchSource:0}: Error finding container 9a59405999a23fd7a688ab165a02f240bb5e9a56c91742614b19e69441628bb1: Status 404 returned error can't find the container with id 9a59405999a23fd7a688ab165a02f240bb5e9a56c91742614b19e69441628bb1
Jul 02 23:18:31.032727 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:31.032665    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j4726" event={"ID":"f687787c-064d-415b-9dd4-3c524e1e7c8c","Type":"ContainerStarted","Data":"9a59405999a23fd7a688ab165a02f240bb5e9a56c91742614b19e69441628bb1"}
Jul 02 23:18:34.052976 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:34.052938    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j4726" event={"ID":"f687787c-064d-415b-9dd4-3c524e1e7c8c","Type":"ContainerStarted","Data":"9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e"}
Jul 02 23:18:34.069392 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:18:34.069337    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-j4726" podStartSLOduration=2.038641667 podStartE2EDuration="5.06931985s" totalImagesPullingTime="3.030678183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:34.067945624 +0000 UTC m=+480.524201843" watchObservedRunningTime="2026-07-02 23:18:34.06931985 +0000 UTC m=+480.525576051"
Jul 02 23:19:03.124491 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.124446    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zjsd6"]
Jul 02 23:19:03.128593 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.128564    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zjsd6"
Jul 02 23:19:03.134363 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.134330    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zjsd6"]
Jul 02 23:19:03.290975 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.290934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtj5\" (UniqueName: \"kubernetes.io/projected/e2620180-2796-4627-ba62-a86513cee99c-kube-api-access-nbtj5\") pod \"authorino-5d4b67c446-zjsd6\" (UID: \"e2620180-2796-4627-ba62-a86513cee99c\") " pod="kuadrant-system/authorino-5d4b67c446-zjsd6"
Jul 02 23:19:03.352193 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.352151    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zjsd6"]
Jul 02 23:19:03.352436 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:19:03.352416    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nbtj5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-zjsd6" podUID="e2620180-2796-4627-ba62-a86513cee99c"
Jul 02 23:19:03.376660 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.376576    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-559b7b7666-bmgpg"]
Jul 02 23:19:03.378816 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.378797    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559b7b7666-bmgpg"
Jul 02 23:19:03.386881 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.386848    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-559b7b7666-bmgpg"]
Jul 02 23:19:03.392118 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.392085    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtj5\" (UniqueName: \"kubernetes.io/projected/e2620180-2796-4627-ba62-a86513cee99c-kube-api-access-nbtj5\") pod \"authorino-5d4b67c446-zjsd6\" (UID: \"e2620180-2796-4627-ba62-a86513cee99c\") " pod="kuadrant-system/authorino-5d4b67c446-zjsd6"
Jul 02 23:19:03.402859 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.402815    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtj5\" (UniqueName: \"kubernetes.io/projected/e2620180-2796-4627-ba62-a86513cee99c-kube-api-access-nbtj5\") pod \"authorino-5d4b67c446-zjsd6\" (UID: \"e2620180-2796-4627-ba62-a86513cee99c\") " pod="kuadrant-system/authorino-5d4b67c446-zjsd6"
Jul 02 23:19:03.457340 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.457298    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-559b7b7666-bmgpg"]
Jul 02 23:19:03.457574 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:19:03.457555    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-864jm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-559b7b7666-bmgpg" podUID="37a2f866-077c-444c-9955-67cf0d13699b"
Jul 02 23:19:03.487254 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.487213    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-674c5b574-dnmrt"]
Jul 02 23:19:03.489569 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.489535    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674c5b574-dnmrt"
Jul 02 23:19:03.491601 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.491581    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 23:19:03.492971 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.492924    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-864jm\" (UniqueName: \"kubernetes.io/projected/37a2f866-077c-444c-9955-67cf0d13699b-kube-api-access-864jm\") pod \"authorino-559b7b7666-bmgpg\" (UID: \"37a2f866-077c-444c-9955-67cf0d13699b\") " pod="kuadrant-system/authorino-559b7b7666-bmgpg"
Jul 02 23:19:03.496918 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.496857    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674c5b574-dnmrt"]
Jul 02 23:19:03.593737 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.593662    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-tls-cert\") pod \"authorino-674c5b574-dnmrt\" (UID: \"ccd6ad4d-c71d-4084-8620-f99e1925d1f3\") " pod="kuadrant-system/authorino-674c5b574-dnmrt"
Jul 02 23:19:03.593737 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.593739    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pvvf\" (UniqueName: \"kubernetes.io/projected/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-kube-api-access-9pvvf\") pod \"authorino-674c5b574-dnmrt\" (UID: \"ccd6ad4d-c71d-4084-8620-f99e1925d1f3\") " pod="kuadrant-system/authorino-674c5b574-dnmrt"
Jul 02 23:19:03.593961 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.593787    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-864jm\" (UniqueName: \"kubernetes.io/projected/37a2f866-077c-444c-9955-67cf0d13699b-kube-api-access-864jm\") pod \"authorino-559b7b7666-bmgpg\" (UID: \"37a2f866-077c-444c-9955-67cf0d13699b\") " pod="kuadrant-system/authorino-559b7b7666-bmgpg"
Jul 02 23:19:03.601599 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.601560    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-864jm\" (UniqueName: \"kubernetes.io/projected/37a2f866-077c-444c-9955-67cf0d13699b-kube-api-access-864jm\") pod \"authorino-559b7b7666-bmgpg\" (UID: \"37a2f866-077c-444c-9955-67cf0d13699b\") " pod="kuadrant-system/authorino-559b7b7666-bmgpg"
Jul 02 23:19:03.694753 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.694640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-tls-cert\") pod \"authorino-674c5b574-dnmrt\" (UID: \"ccd6ad4d-c71d-4084-8620-f99e1925d1f3\") " pod="kuadrant-system/authorino-674c5b574-dnmrt"
Jul 02 23:19:03.694753 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.694699    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pvvf\" (UniqueName: \"kubernetes.io/projected/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-kube-api-access-9pvvf\") pod \"authorino-674c5b574-dnmrt\" (UID: \"ccd6ad4d-c71d-4084-8620-f99e1925d1f3\") " pod="kuadrant-system/authorino-674c5b574-dnmrt"
Jul 02 23:19:03.697475 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.697443    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-tls-cert\") pod \"authorino-674c5b574-dnmrt\" (UID: \"ccd6ad4d-c71d-4084-8620-f99e1925d1f3\") " pod="kuadrant-system/authorino-674c5b574-dnmrt"
Jul 02 23:19:03.702600 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.702558    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pvvf\" (UniqueName: \"kubernetes.io/projected/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-kube-api-access-9pvvf\") pod \"authorino-674c5b574-dnmrt\" (UID: \"ccd6ad4d-c71d-4084-8620-f99e1925d1f3\") " pod="kuadrant-system/authorino-674c5b574-dnmrt"
Jul 02 23:19:03.799744 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.799669    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674c5b574-dnmrt"
Jul 02 23:19:03.936206 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:03.936178    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674c5b574-dnmrt"]
Jul 02 23:19:03.938331 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:19:03.938303    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccd6ad4d_c71d_4084_8620_f99e1925d1f3.slice/crio-3f1568cde74c6af8c65251648f31581fa1c73943bf17c3a18f5a4d51a40f24aa WatchSource:0}: Error finding container 3f1568cde74c6af8c65251648f31581fa1c73943bf17c3a18f5a4d51a40f24aa: Status 404 returned error can't find the container with id 3f1568cde74c6af8c65251648f31581fa1c73943bf17c3a18f5a4d51a40f24aa
Jul 02 23:19:04.185818 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.185776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674c5b574-dnmrt" event={"ID":"ccd6ad4d-c71d-4084-8620-f99e1925d1f3","Type":"ContainerStarted","Data":"3f1568cde74c6af8c65251648f31581fa1c73943bf17c3a18f5a4d51a40f24aa"}
Jul 02 23:19:04.185818 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.185813    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559b7b7666-bmgpg"
Jul 02 23:19:04.186245 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.185815    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zjsd6"
Jul 02 23:19:04.193369 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.193340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559b7b7666-bmgpg"
Jul 02 23:19:04.195906 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.195881    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zjsd6"
Jul 02 23:19:04.300602 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.300570    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-864jm\" (UniqueName: \"kubernetes.io/projected/37a2f866-077c-444c-9955-67cf0d13699b-kube-api-access-864jm\") pod \"37a2f866-077c-444c-9955-67cf0d13699b\" (UID: \"37a2f866-077c-444c-9955-67cf0d13699b\") "
Jul 02 23:19:04.300800 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.300632    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbtj5\" (UniqueName: \"kubernetes.io/projected/e2620180-2796-4627-ba62-a86513cee99c-kube-api-access-nbtj5\") pod \"e2620180-2796-4627-ba62-a86513cee99c\" (UID: \"e2620180-2796-4627-ba62-a86513cee99c\") "
Jul 02 23:19:04.302931 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.302892    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37a2f866-077c-444c-9955-67cf0d13699b-kube-api-access-864jm" (OuterVolumeSpecName: "kube-api-access-864jm") pod "37a2f866-077c-444c-9955-67cf0d13699b" (UID: "37a2f866-077c-444c-9955-67cf0d13699b"). InnerVolumeSpecName "kube-api-access-864jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:19:04.303092 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.302992    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2620180-2796-4627-ba62-a86513cee99c-kube-api-access-nbtj5" (OuterVolumeSpecName: "kube-api-access-nbtj5") pod "e2620180-2796-4627-ba62-a86513cee99c" (UID: "e2620180-2796-4627-ba62-a86513cee99c"). InnerVolumeSpecName "kube-api-access-nbtj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:19:04.402198 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.402163    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-864jm\" (UniqueName: \"kubernetes.io/projected/37a2f866-077c-444c-9955-67cf0d13699b-kube-api-access-864jm\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:19:04.402198 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:04.402195    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbtj5\" (UniqueName: \"kubernetes.io/projected/e2620180-2796-4627-ba62-a86513cee99c-kube-api-access-nbtj5\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:19:05.193764 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.193735    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zjsd6"
Jul 02 23:19:05.193764 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.193759    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-559b7b7666-bmgpg"
Jul 02 23:19:05.193764 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.193733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674c5b574-dnmrt" event={"ID":"ccd6ad4d-c71d-4084-8620-f99e1925d1f3","Type":"ContainerStarted","Data":"7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8"}
Jul 02 23:19:05.213411 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.213352    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-674c5b574-dnmrt" podStartSLOduration=1.913579721 podStartE2EDuration="2.213334651s" totalImagesPullingTime="299.75493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:19:05.211051723 +0000 UTC m=+511.667307943" watchObservedRunningTime="2026-07-02 23:19:05.213334651 +0000 UTC m=+511.669590852"
Jul 02 23:19:05.239059 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.239026    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zjsd6"]
Jul 02 23:19:05.244709 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.244653    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4726"]
Jul 02 23:19:05.244903 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.244879    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-j4726" podUID="f687787c-064d-415b-9dd4-3c524e1e7c8c" containerName="authorino" containerID="cri-o://9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e" gracePeriod=30
Jul 02 23:19:05.247999 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.247969    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zjsd6"]
Jul 02 23:19:05.272332 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.272292    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-559b7b7666-bmgpg"]
Jul 02 23:19:05.276593 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.276558    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-559b7b7666-bmgpg"]
Jul 02 23:19:05.506136 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.506106    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j4726"
Jul 02 23:19:05.611486 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.611449    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs6vn\" (UniqueName: \"kubernetes.io/projected/f687787c-064d-415b-9dd4-3c524e1e7c8c-kube-api-access-xs6vn\") pod \"f687787c-064d-415b-9dd4-3c524e1e7c8c\" (UID: \"f687787c-064d-415b-9dd4-3c524e1e7c8c\") "
Jul 02 23:19:05.613746 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.613720    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f687787c-064d-415b-9dd4-3c524e1e7c8c-kube-api-access-xs6vn" (OuterVolumeSpecName: "kube-api-access-xs6vn") pod "f687787c-064d-415b-9dd4-3c524e1e7c8c" (UID: "f687787c-064d-415b-9dd4-3c524e1e7c8c"). InnerVolumeSpecName "kube-api-access-xs6vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:19:05.713063 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:05.713021    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs6vn\" (UniqueName: \"kubernetes.io/projected/f687787c-064d-415b-9dd4-3c524e1e7c8c-kube-api-access-xs6vn\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:19:06.079402 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.079360    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37a2f866-077c-444c-9955-67cf0d13699b" path="/var/lib/kubelet/pods/37a2f866-077c-444c-9955-67cf0d13699b/volumes"
Jul 02 23:19:06.079599 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.079586    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2620180-2796-4627-ba62-a86513cee99c" path="/var/lib/kubelet/pods/e2620180-2796-4627-ba62-a86513cee99c/volumes"
Jul 02 23:19:06.199895 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.199850    2568 generic.go:356] "Generic (PLEG): container finished" podID="f687787c-064d-415b-9dd4-3c524e1e7c8c" containerID="9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e" exitCode=0
Jul 02 23:19:06.199895 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.199888    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j4726"
Jul 02 23:19:06.200372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.199937    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j4726" event={"ID":"f687787c-064d-415b-9dd4-3c524e1e7c8c","Type":"ContainerDied","Data":"9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e"}
Jul 02 23:19:06.200372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.199979    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j4726" event={"ID":"f687787c-064d-415b-9dd4-3c524e1e7c8c","Type":"ContainerDied","Data":"9a59405999a23fd7a688ab165a02f240bb5e9a56c91742614b19e69441628bb1"}
Jul 02 23:19:06.200372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.200001    2568 scope.go:117] "RemoveContainer" containerID="9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e"
Jul 02 23:19:06.208407 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.208383    2568 scope.go:117] "RemoveContainer" containerID="9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e"
Jul 02 23:19:06.208715 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:19:06.208698    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e\": container with ID starting with 9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e not found: ID does not exist" containerID="9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e"
Jul 02 23:19:06.208771 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.208724    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e"} err="failed to get container status \"9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e\": rpc error: code = NotFound desc = could not find container \"9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e\": container with ID starting with 9474d2a5e46e8dbdb8419bb8d5777b14c93a6808314e7150469345278f2ad82e not found: ID does not exist"
Jul 02 23:19:06.214426 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.214396    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4726"]
Jul 02 23:19:06.218609 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:06.218577    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4726"]
Jul 02 23:19:08.078693 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:08.078648    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f687787c-064d-415b-9dd4-3c524e1e7c8c" path="/var/lib/kubelet/pods/f687787c-064d-415b-9dd4-3c524e1e7c8c/volumes"
Jul 02 23:19:53.405574 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:53.405541    2568 generic.go:356] "Generic (PLEG): container finished" podID="27e191d8-835b-4e74-888c-a7cc04b7c5c4" containerID="eae532742acff86fcb1ec175c874e194ab1294a4bb888b116714827601ea9a08" exitCode=0
Jul 02 23:19:53.406015 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:53.405579    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2" event={"ID":"27e191d8-835b-4e74-888c-a7cc04b7c5c4","Type":"ContainerDied","Data":"eae532742acff86fcb1ec175c874e194ab1294a4bb888b116714827601ea9a08"}
Jul 02 23:19:53.406015 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:53.405950    2568 scope.go:117] "RemoveContainer" containerID="eae532742acff86fcb1ec175c874e194ab1294a4bb888b116714827601ea9a08"
Jul 02 23:19:53.406911 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:53.406884    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:19:53.406975 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:53.406954    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:19:53.407009 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:53.406988    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:19:54.415550 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:54.415499    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2" event={"ID":"27e191d8-835b-4e74-888c-a7cc04b7c5c4","Type":"ContainerStarted","Data":"5308b4fdbee7bf764b88e4a413c1bf26c34cca36f92707d2e8021afc9e51de90"}
Jul 02 23:19:54.567809 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:54.567767    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:19:54.568973 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:54.568949    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zzrr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 02 23:19:54.569070 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:54.569011    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2" podUID="27e191d8-835b-4e74-888c-a7cc04b7c5c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 02 23:19:55.567474 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:55.567440    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zzrr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 02 23:19:55.567887 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:55.567494    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2" podUID="27e191d8-835b-4e74-888c-a7cc04b7c5c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 02 23:19:56.567799 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:56.567759    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zzrr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 02 23:19:56.568179 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:56.567815    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2" podUID="27e191d8-835b-4e74-888c-a7cc04b7c5c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 02 23:19:57.568095 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:57.568053    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zzrr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 02 23:19:57.568497 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:57.568123    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2" podUID="27e191d8-835b-4e74-888c-a7cc04b7c5c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 02 23:19:58.571485 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:58.571447    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:19:58.571943 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:58.571716    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:19:58.572351 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:19:58.572334    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zzrr2"
Jul 02 23:20:24.163666 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.163631    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"]
Jul 02 23:20:24.164121 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.163971    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f687787c-064d-415b-9dd4-3c524e1e7c8c" containerName="authorino"
Jul 02 23:20:24.164121 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.163983    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f687787c-064d-415b-9dd4-3c524e1e7c8c" containerName="authorino"
Jul 02 23:20:24.164121 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.164052    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f687787c-064d-415b-9dd4-3c524e1e7c8c" containerName="authorino"
Jul 02 23:20:24.167170 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.167148    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.169391 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.169364    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 23:20:24.169492 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.169438    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 23:20:24.169980 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.169959    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8c2j9\""
Jul 02 23:20:24.170110 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.170091    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 02 23:20:24.177922 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.177901    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"]
Jul 02 23:20:24.308233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.308189    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.308233 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.308234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np5px\" (UniqueName: \"kubernetes.io/projected/101eb54e-9488-4e90-b132-dac6ff01fe69-kube-api-access-np5px\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.308492 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.308351    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.308492 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.308390    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101eb54e-9488-4e90-b132-dac6ff01fe69-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.308492 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.308409    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.308492 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.308449    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.409605 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.409566    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.409843 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.409615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.409843 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.409642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np5px\" (UniqueName: \"kubernetes.io/projected/101eb54e-9488-4e90-b132-dac6ff01fe69-kube-api-access-np5px\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.409843 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.409726    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.409843 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.409753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101eb54e-9488-4e90-b132-dac6ff01fe69-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.409843 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.409780    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.410111 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.410020    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.410111 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.410081    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.410111 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.410108    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.412101 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.412075    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/101eb54e-9488-4e90-b132-dac6ff01fe69-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.412298 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.412284    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/101eb54e-9488-4e90-b132-dac6ff01fe69-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.424038 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.423973    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np5px\" (UniqueName: \"kubernetes.io/projected/101eb54e-9488-4e90-b132-dac6ff01fe69-kube-api-access-np5px\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qvpnh\" (UID: \"101eb54e-9488-4e90-b132-dac6ff01fe69\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.477980 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.477943    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:24.612152 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:24.612079    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"]
Jul 02 23:20:24.614964 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:20:24.614936    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101eb54e_9488_4e90_b132_dac6ff01fe69.slice/crio-9ac97c9d168ae1a9412a3df1ff10fb3033f37f267dd1b78d623af1ad916f614b WatchSource:0}: Error finding container 9ac97c9d168ae1a9412a3df1ff10fb3033f37f267dd1b78d623af1ad916f614b: Status 404 returned error can't find the container with id 9ac97c9d168ae1a9412a3df1ff10fb3033f37f267dd1b78d623af1ad916f614b
Jul 02 23:20:25.560654 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:25.560476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh" event={"ID":"101eb54e-9488-4e90-b132-dac6ff01fe69","Type":"ContainerStarted","Data":"9ac97c9d168ae1a9412a3df1ff10fb3033f37f267dd1b78d623af1ad916f614b"}
Jul 02 23:20:26.566323 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:26.566284    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh" event={"ID":"101eb54e-9488-4e90-b132-dac6ff01fe69","Type":"ContainerStarted","Data":"454a8379f19befd97c6a0c14d0e52a8d83862eb12c4566dfbac4e7e2eea3e0a1"}
Jul 02 23:20:26.582919 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:26.582872    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh" podStartSLOduration=1.5466965419999998 podStartE2EDuration="2.582856707s" totalImagesPullingTime="1.036160165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:20:26.581570227 +0000 UTC m=+593.037826456" watchObservedRunningTime="2026-07-02 23:20:26.582856707 +0000 UTC m=+593.039112908"
Jul 02 23:20:34.478798 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:34.478747    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:34.479290 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:34.478894    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:34.491313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:34.491286    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:34.613811 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:34.613781    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qvpnh"
Jul 02 23:20:59.772959 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.772876    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"]
Jul 02 23:20:59.776849 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.776824    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.779028 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.779005    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 23:20:59.784667 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.784641    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"]
Jul 02 23:20:59.802478 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.802445    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx5wr\" (UniqueName: \"kubernetes.io/projected/4e833222-8357-4715-a48a-227619b0ff83-kube-api-access-qx5wr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.802639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.802497    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.802639 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.802568    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e833222-8357-4715-a48a-227619b0ff83-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.802752 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.802629    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.802752 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.802687    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.802752 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.802717    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.903268 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.903228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e833222-8357-4715-a48a-227619b0ff83-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.903482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.903293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.903482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.903323    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.903482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.903367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.903482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.903429    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx5wr\" (UniqueName: \"kubernetes.io/projected/4e833222-8357-4715-a48a-227619b0ff83-kube-api-access-qx5wr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.903482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.903466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.903938 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.903914    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.904029 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.903948    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.904029 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.903988    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.905967 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.905949    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e833222-8357-4715-a48a-227619b0ff83-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.906061 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.905975    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e833222-8357-4715-a48a-227619b0ff83-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:20:59.914114 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:20:59.914090    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx5wr\" (UniqueName: \"kubernetes.io/projected/4e833222-8357-4715-a48a-227619b0ff83-kube-api-access-qx5wr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6dhc9\" (UID: \"4e833222-8357-4715-a48a-227619b0ff83\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:21:00.087125 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:21:00.087041    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:21:00.223632 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:21:00.223597    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"]
Jul 02 23:21:00.226891 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:21:00.226863    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e833222_8357_4715_a48a_227619b0ff83.slice/crio-5fcdba58ab8efcfc6f7c7cd8654b2ff588cd99c8e4b18d6d7462d93091e7ac88 WatchSource:0}: Error finding container 5fcdba58ab8efcfc6f7c7cd8654b2ff588cd99c8e4b18d6d7462d93091e7ac88: Status 404 returned error can't find the container with id 5fcdba58ab8efcfc6f7c7cd8654b2ff588cd99c8e4b18d6d7462d93091e7ac88
Jul 02 23:21:00.228264 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:21:00.228249    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:21:00.721347 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:21:00.721257    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9" event={"ID":"4e833222-8357-4715-a48a-227619b0ff83","Type":"ContainerStarted","Data":"90c81af9b1adb4bf3926049132f6cd4d940a2ae125bb525f000c0ab024512980"}
Jul 02 23:21:00.721347 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:21:00.721307    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9" event={"ID":"4e833222-8357-4715-a48a-227619b0ff83","Type":"ContainerStarted","Data":"5fcdba58ab8efcfc6f7c7cd8654b2ff588cd99c8e4b18d6d7462d93091e7ac88"}
Jul 02 23:21:00.738369 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:21:00.738319    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9" podStartSLOduration=1.557724757 podStartE2EDuration="1.738301374s" totalImagesPullingTime="180.576617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:21:00.737081485 +0000 UTC m=+627.193337702" watchObservedRunningTime="2026-07-02 23:21:00.738301374 +0000 UTC m=+627.194557574"
Jul 02 23:21:10.087739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:21:10.087708    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:21:10.088211 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:21:10.087763    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:21:10.100394 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:21:10.100371    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:21:10.776798 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:21:10.776765    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6dhc9"
Jul 02 23:22:30.002605 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:30.002516    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674c5b574-dnmrt"]
Jul 02 23:22:30.003142 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:30.002722    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-674c5b574-dnmrt" podUID="ccd6ad4d-c71d-4084-8620-f99e1925d1f3" containerName="authorino" containerID="cri-o://7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8" gracePeriod=30
Jul 02 23:22:30.252317 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:30.252293    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674c5b574-dnmrt"
Jul 02 23:22:30.365494 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:30.365464    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-tls-cert\") pod \"ccd6ad4d-c71d-4084-8620-f99e1925d1f3\" (UID: \"ccd6ad4d-c71d-4084-8620-f99e1925d1f3\") "
Jul 02 23:22:30.365698 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:30.365511    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pvvf\" (UniqueName: \"kubernetes.io/projected/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-kube-api-access-9pvvf\") pod \"ccd6ad4d-c71d-4084-8620-f99e1925d1f3\" (UID: \"ccd6ad4d-c71d-4084-8620-f99e1925d1f3\") "
Jul 02 23:22:30.367478 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:30.367447    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-kube-api-access-9pvvf" (OuterVolumeSpecName: "kube-api-access-9pvvf") pod "ccd6ad4d-c71d-4084-8620-f99e1925d1f3" (UID: "ccd6ad4d-c71d-4084-8620-f99e1925d1f3"). InnerVolumeSpecName "kube-api-access-9pvvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:22:30.375332 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:30.375305    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ccd6ad4d-c71d-4084-8620-f99e1925d1f3" (UID: "ccd6ad4d-c71d-4084-8620-f99e1925d1f3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:22:30.466311 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:30.466275    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-tls-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:22:30.466311 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:30.466306    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pvvf\" (UniqueName: \"kubernetes.io/projected/ccd6ad4d-c71d-4084-8620-f99e1925d1f3-kube-api-access-9pvvf\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:22:31.114951 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:31.114913    2568 generic.go:356] "Generic (PLEG): container finished" podID="ccd6ad4d-c71d-4084-8620-f99e1925d1f3" containerID="7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8" exitCode=0
Jul 02 23:22:31.115382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:31.114970    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674c5b574-dnmrt"
Jul 02 23:22:31.115382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:31.114990    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674c5b574-dnmrt" event={"ID":"ccd6ad4d-c71d-4084-8620-f99e1925d1f3","Type":"ContainerDied","Data":"7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8"}
Jul 02 23:22:31.115382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:31.115030    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674c5b574-dnmrt" event={"ID":"ccd6ad4d-c71d-4084-8620-f99e1925d1f3","Type":"ContainerDied","Data":"3f1568cde74c6af8c65251648f31581fa1c73943bf17c3a18f5a4d51a40f24aa"}
Jul 02 23:22:31.115382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:31.115048    2568 scope.go:117] "RemoveContainer" containerID="7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8"
Jul 02 23:22:31.126305 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:31.126281    2568 scope.go:117] "RemoveContainer" containerID="7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8"
Jul 02 23:22:31.126657 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:22:31.126635    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8\": container with ID starting with 7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8 not found: ID does not exist" containerID="7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8"
Jul 02 23:22:31.126759 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:31.126688    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8"} err="failed to get container status \"7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8\": rpc error: code = NotFound desc = could not find container \"7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8\": container with ID starting with 7e7b88b2941d65173dc9424cdfb5f8cd20a065260e527a91ffa3e4441499ddc8 not found: ID does not exist"
Jul 02 23:22:31.140606 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:31.140586    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674c5b574-dnmrt"]
Jul 02 23:22:31.146936 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:31.146918    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-674c5b574-dnmrt"]
Jul 02 23:22:32.079572 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:22:32.079541    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccd6ad4d-c71d-4084-8620-f99e1925d1f3" path="/var/lib/kubelet/pods/ccd6ad4d-c71d-4084-8620-f99e1925d1f3/volumes"
Jul 02 23:28:21.600135 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:21.600102    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"]
Jul 02 23:28:21.600704 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:21.600645    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs" podUID="fd5c5f11-8743-4244-b740-83343b9bc57a" containerName="manager" containerID="cri-o://4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7" gracePeriod=10
Jul 02 23:28:24.056015 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.055987    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:28:24.169882 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.169795    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdr7t\" (UniqueName: \"kubernetes.io/projected/fd5c5f11-8743-4244-b740-83343b9bc57a-kube-api-access-kdr7t\") pod \"fd5c5f11-8743-4244-b740-83343b9bc57a\" (UID: \"fd5c5f11-8743-4244-b740-83343b9bc57a\") "
Jul 02 23:28:24.170029 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.169882    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5f11-8743-4244-b740-83343b9bc57a-extensions-socket-volume\") pod \"fd5c5f11-8743-4244-b740-83343b9bc57a\" (UID: \"fd5c5f11-8743-4244-b740-83343b9bc57a\") "
Jul 02 23:28:24.170265 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.170232    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5c5f11-8743-4244-b740-83343b9bc57a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd5c5f11-8743-4244-b740-83343b9bc57a" (UID: "fd5c5f11-8743-4244-b740-83343b9bc57a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:28:24.172132 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.172105    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5c5f11-8743-4244-b740-83343b9bc57a-kube-api-access-kdr7t" (OuterVolumeSpecName: "kube-api-access-kdr7t") pod "fd5c5f11-8743-4244-b740-83343b9bc57a" (UID: "fd5c5f11-8743-4244-b740-83343b9bc57a"). InnerVolumeSpecName "kube-api-access-kdr7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:28:24.271040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.271014    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdr7t\" (UniqueName: \"kubernetes.io/projected/fd5c5f11-8743-4244-b740-83343b9bc57a-kube-api-access-kdr7t\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:28:24.271040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.271038    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5f11-8743-4244-b740-83343b9bc57a-extensions-socket-volume\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:28:24.677312 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.677278    2568 generic.go:356] "Generic (PLEG): container finished" podID="fd5c5f11-8743-4244-b740-83343b9bc57a" containerID="4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7" exitCode=0
Jul 02 23:28:24.677484 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.677323    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"
Jul 02 23:28:24.677484 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.677348    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs" event={"ID":"fd5c5f11-8743-4244-b740-83343b9bc57a","Type":"ContainerDied","Data":"4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7"}
Jul 02 23:28:24.677484 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.677391    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs" event={"ID":"fd5c5f11-8743-4244-b740-83343b9bc57a","Type":"ContainerDied","Data":"63eea34857158ff0f0bb7f5aa144ad2f76ab7a8ceb35430353dc4e96bb3947b0"}
Jul 02 23:28:24.677484 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.677411    2568 scope.go:117] "RemoveContainer" containerID="4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7"
Jul 02 23:28:24.686451 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.686431    2568 scope.go:117] "RemoveContainer" containerID="4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7"
Jul 02 23:28:24.686722 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:28:24.686690    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7\": container with ID starting with 4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7 not found: ID does not exist" containerID="4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7"
Jul 02 23:28:24.686780 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.686737    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7"} err="failed to get container status \"4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7\": rpc error: code = NotFound desc = could not find container \"4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7\": container with ID starting with 4badada37aecb06672c9d3acd6b421af4c90748e6168965b05d1639a99fbbeb7 not found: ID does not exist"
Jul 02 23:28:24.698229 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.698211    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"]
Jul 02 23:28:24.703627 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:24.703608    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2c8hs"]
Jul 02 23:28:26.079142 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:28:26.079046    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd5c5f11-8743-4244-b740-83343b9bc57a" path="/var/lib/kubelet/pods/fd5c5f11-8743-4244-b740-83343b9bc57a/volumes"
Jul 02 23:29:22.790875 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.790834    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"]
Jul 02 23:29:22.791335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.791210    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccd6ad4d-c71d-4084-8620-f99e1925d1f3" containerName="authorino"
Jul 02 23:29:22.791335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.791226    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccd6ad4d-c71d-4084-8620-f99e1925d1f3" containerName="authorino"
Jul 02 23:29:22.791335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.791241    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5c5f11-8743-4244-b740-83343b9bc57a" containerName="manager"
Jul 02 23:29:22.791335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.791247    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5c5f11-8743-4244-b740-83343b9bc57a" containerName="manager"
Jul 02 23:29:22.791335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.791301    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5c5f11-8743-4244-b740-83343b9bc57a" containerName="manager"
Jul 02 23:29:22.791335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.791308    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccd6ad4d-c71d-4084-8620-f99e1925d1f3" containerName="authorino"
Jul 02 23:29:22.794103 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.794087    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"
Jul 02 23:29:22.796314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.796291    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zzc7z\""
Jul 02 23:29:22.810798 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.810776    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"]
Jul 02 23:29:22.869421 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.869391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/417ab045-2644-4bb5-9a80-36ac6b461385-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rkv84\" (UID: \"417ab045-2644-4bb5-9a80-36ac6b461385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"
Jul 02 23:29:22.869592 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.869462    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlgpr\" (UniqueName: \"kubernetes.io/projected/417ab045-2644-4bb5-9a80-36ac6b461385-kube-api-access-vlgpr\") pod \"kuadrant-operator-controller-manager-86878c769f-rkv84\" (UID: \"417ab045-2644-4bb5-9a80-36ac6b461385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"
Jul 02 23:29:22.970863 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.970810    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlgpr\" (UniqueName: \"kubernetes.io/projected/417ab045-2644-4bb5-9a80-36ac6b461385-kube-api-access-vlgpr\") pod \"kuadrant-operator-controller-manager-86878c769f-rkv84\" (UID: \"417ab045-2644-4bb5-9a80-36ac6b461385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"
Jul 02 23:29:22.971084 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.970962    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/417ab045-2644-4bb5-9a80-36ac6b461385-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rkv84\" (UID: \"417ab045-2644-4bb5-9a80-36ac6b461385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"
Jul 02 23:29:22.971350 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.971331    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/417ab045-2644-4bb5-9a80-36ac6b461385-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rkv84\" (UID: \"417ab045-2644-4bb5-9a80-36ac6b461385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"
Jul 02 23:29:22.978894 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:22.978860    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlgpr\" (UniqueName: \"kubernetes.io/projected/417ab045-2644-4bb5-9a80-36ac6b461385-kube-api-access-vlgpr\") pod \"kuadrant-operator-controller-manager-86878c769f-rkv84\" (UID: \"417ab045-2644-4bb5-9a80-36ac6b461385\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"
Jul 02 23:29:23.104495 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:23.104408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"
Jul 02 23:29:23.237919 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:23.237893    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"]
Jul 02 23:29:23.240284 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:29:23.240257    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod417ab045_2644_4bb5_9a80_36ac6b461385.slice/crio-bde9e2eb7caf1cf3d242a5b1ad55321b9cbcfb6aebe8e6eba45b2e67e2c849a3 WatchSource:0}: Error finding container bde9e2eb7caf1cf3d242a5b1ad55321b9cbcfb6aebe8e6eba45b2e67e2c849a3: Status 404 returned error can't find the container with id bde9e2eb7caf1cf3d242a5b1ad55321b9cbcfb6aebe8e6eba45b2e67e2c849a3
Jul 02 23:29:23.928112 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:23.928063    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84" event={"ID":"417ab045-2644-4bb5-9a80-36ac6b461385","Type":"ContainerStarted","Data":"31bd1a037a6c3bac194b46c5f13abf825d2006023e4c8929ab3f843ecfe4d220"}
Jul 02 23:29:23.928579 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:23.928148    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84" event={"ID":"417ab045-2644-4bb5-9a80-36ac6b461385","Type":"ContainerStarted","Data":"bde9e2eb7caf1cf3d242a5b1ad55321b9cbcfb6aebe8e6eba45b2e67e2c849a3"}
Jul 02 23:29:23.928579 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:23.928205    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"
Jul 02 23:29:23.947021 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:23.946970    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84" podStartSLOduration=1.9469540520000002 podStartE2EDuration="1.946954052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:29:23.945866738 +0000 UTC m=+1130.402122959" watchObservedRunningTime="2026-07-02 23:29:23.946954052 +0000 UTC m=+1130.403210253"
Jul 02 23:29:34.934986 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:29:34.934956    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rkv84"
Jul 02 23:35:29.125720 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.124162    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"]
Jul 02 23:35:29.129527 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.129502    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.132412 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.132386    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fc5f7b5c-openshift-default-dockercfg-5dnjm\""
Jul 02 23:35:29.145406 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.145375    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"]
Jul 02 23:35:29.184592 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.184550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-certs\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.184592 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.184601    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-envoy\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.184862 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.184618    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-data\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.184862 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.184748    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1fa0d55-4f21-402a-8677-07115cfa7828-istiod-ca-cert\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.184862 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.184807    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-credential-socket\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.185020 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.184862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-token\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.185020 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.184903    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-socket\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.185020 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.184943    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7thj\" (UniqueName: \"kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-kube-api-access-l7thj\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.185020 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.185003    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-podinfo\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286274    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7thj\" (UniqueName: \"kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-kube-api-access-l7thj\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-podinfo\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286373    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-certs\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286398    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-envoy\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286423    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-data\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286799 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286544    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1fa0d55-4f21-402a-8677-07115cfa7828-istiod-ca-cert\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286799 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286648    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-credential-socket\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286799 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-token\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286799 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-socket\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286995 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286894    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-certs\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.286995 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.286928    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-data\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.287139 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.287116    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-credential-socket\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.287272 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.287254    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-socket\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.287314 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.287279    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1fa0d55-4f21-402a-8677-07115cfa7828-istiod-ca-cert\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.289437 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.289408    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-envoy\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.289582 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.289564    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-podinfo\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.294323 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.294287    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-token\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.294442 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.294422    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7thj\" (UniqueName: \"kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-kube-api-access-l7thj\") pod \"e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") " pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.441620 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.441515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:29.587251 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.587222    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"]
Jul 02 23:35:29.589601 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:35:29.589572    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1fa0d55_4f21_402a_8677_07115cfa7828.slice/crio-44248f075a2807a31dfa668c982df6e585f607978b5f713aead664b9832fb935 WatchSource:0}: Error finding container 44248f075a2807a31dfa668c982df6e585f607978b5f713aead664b9832fb935: Status 404 returned error can't find the container with id 44248f075a2807a31dfa668c982df6e585f607978b5f713aead664b9832fb935
Jul 02 23:35:29.592144 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.592104    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:35:29.592248 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.592174    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:35:29.592248 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:29.592204    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:35:30.563219 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:30.563182    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp" event={"ID":"f1fa0d55-4f21-402a-8677-07115cfa7828","Type":"ContainerStarted","Data":"624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a"}
Jul 02 23:35:30.563642 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:30.563232    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp" event={"ID":"f1fa0d55-4f21-402a-8677-07115cfa7828","Type":"ContainerStarted","Data":"44248f075a2807a31dfa668c982df6e585f607978b5f713aead664b9832fb935"}
Jul 02 23:35:30.607508 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:30.607445    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp" podStartSLOduration=1.607429894 podStartE2EDuration="1.607429894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:30.606332072 +0000 UTC m=+1497.062588293" watchObservedRunningTime="2026-07-02 23:35:30.607429894 +0000 UTC m=+1497.063686096"
Jul 02 23:35:31.442720 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:31.442649    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:31.447954 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:31.447927    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:31.567594 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:31.567565    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:31.568740 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:31.568719    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:35.671736 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:35.671694    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"]
Jul 02 23:35:35.672223 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:35.671893    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp" podUID="f1fa0d55-4f21-402a-8677-07115cfa7828" containerName="istio-proxy" containerID="cri-o://624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a" gracePeriod=30
Jul 02 23:35:41.669248 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.669207    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"]
Jul 02 23:35:41.672381 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.672355    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.675121 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.675096    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-88a77b91-openshift-default-dockercfg-bzm5r\""
Jul 02 23:35:41.703933 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.703892    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"]
Jul 02 23:35:41.801495 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.801461    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-certs\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.801495 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.801501    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-credential-socket\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.801805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.801520    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-podinfo\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.801805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.801545    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/326e3d1c-b96c-4eee-805b-38ce21d2c597-istiod-ca-cert\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.801805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.801561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv6dw\" (UniqueName: \"kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-kube-api-access-gv6dw\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.801805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.801586    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-token\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.801805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.801660    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-envoy\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.801805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.801714    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-data\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.801805 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.801736    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-socket\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.830585 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.830553    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:41.902862 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.902761    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-certs\") pod \"f1fa0d55-4f21-402a-8677-07115cfa7828\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") "
Jul 02 23:35:41.902862 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.902801    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-podinfo\") pod \"f1fa0d55-4f21-402a-8677-07115cfa7828\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") "
Jul 02 23:35:41.902862 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.902832    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-envoy\") pod \"f1fa0d55-4f21-402a-8677-07115cfa7828\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") "
Jul 02 23:35:41.902862 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.902848    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-socket\") pod \"f1fa0d55-4f21-402a-8677-07115cfa7828\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") "
Jul 02 23:35:41.903200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.902881    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-data\") pod \"f1fa0d55-4f21-402a-8677-07115cfa7828\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") "
Jul 02 23:35:41.903200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.902902    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1fa0d55-4f21-402a-8677-07115cfa7828-istiod-ca-cert\") pod \"f1fa0d55-4f21-402a-8677-07115cfa7828\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") "
Jul 02 23:35:41.903200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.902923    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7thj\" (UniqueName: \"kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-kube-api-access-l7thj\") pod \"f1fa0d55-4f21-402a-8677-07115cfa7828\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") "
Jul 02 23:35:41.903200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.902955    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-credential-socket\") pod \"f1fa0d55-4f21-402a-8677-07115cfa7828\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") "
Jul 02 23:35:41.903200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903046    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-token\") pod \"f1fa0d55-4f21-402a-8677-07115cfa7828\" (UID: \"f1fa0d55-4f21-402a-8677-07115cfa7828\") "
Jul 02 23:35:41.903440 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903216    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-envoy\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.903440 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903234    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f1fa0d55-4f21-402a-8677-07115cfa7828" (UID: "f1fa0d55-4f21-402a-8677-07115cfa7828"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:41.903440 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903274    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-data\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.903440 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903315    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-socket\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.903440 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-certs\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.903440 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-credential-socket\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.903440 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-podinfo\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.903804 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903452    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/326e3d1c-b96c-4eee-805b-38ce21d2c597-istiod-ca-cert\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.903804 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv6dw\" (UniqueName: \"kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-kube-api-access-gv6dw\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.903804 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-token\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.903804 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903565    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1fa0d55-4f21-402a-8677-07115cfa7828-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f1fa0d55-4f21-402a-8677-07115cfa7828" (UID: "f1fa0d55-4f21-402a-8677-07115cfa7828"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:41.903999 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903827    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-data" (OuterVolumeSpecName: "istio-data") pod "f1fa0d55-4f21-402a-8677-07115cfa7828" (UID: "f1fa0d55-4f21-402a-8677-07115cfa7828"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:41.903999 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.903971    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-data\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.904098 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.904081    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f1fa0d55-4f21-402a-8677-07115cfa7828" (UID: "f1fa0d55-4f21-402a-8677-07115cfa7828"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:41.904209 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.904188    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f1fa0d55-4f21-402a-8677-07115cfa7828" (UID: "f1fa0d55-4f21-402a-8677-07115cfa7828"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:41.904209 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.904192    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-socket\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.904312 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.904213    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:35:41.904312 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.904266    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-credential-socket\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.904495 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.904472    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-certs\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.904795 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.904742    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/326e3d1c-b96c-4eee-805b-38ce21d2c597-istiod-ca-cert\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.905844 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.905799    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f1fa0d55-4f21-402a-8677-07115cfa7828" (UID: "f1fa0d55-4f21-402a-8677-07115cfa7828"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:35:41.906727 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.906703    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-token" (OuterVolumeSpecName: "istio-token") pod "f1fa0d55-4f21-402a-8677-07115cfa7828" (UID: "f1fa0d55-4f21-402a-8677-07115cfa7828"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:41.906841 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.906804    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f1fa0d55-4f21-402a-8677-07115cfa7828" (UID: "f1fa0d55-4f21-402a-8677-07115cfa7828"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:35:41.907342 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.907321    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-envoy\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.907483 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.907464    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-podinfo\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.907737 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.907713    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-kube-api-access-l7thj" (OuterVolumeSpecName: "kube-api-access-l7thj") pod "f1fa0d55-4f21-402a-8677-07115cfa7828" (UID: "f1fa0d55-4f21-402a-8677-07115cfa7828"). InnerVolumeSpecName "kube-api-access-l7thj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:41.911581 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.911555    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv6dw\" (UniqueName: \"kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-kube-api-access-gv6dw\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.912944 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.912923    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-token\") pod \"e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") " pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:41.985576 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:41.985533    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:42.005782 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.005744    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:35:42.005782 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.005781    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:35:42.006014 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.005795    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:35:42.006014 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.005808    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:35:42.006014 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.005820    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:35:42.006014 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.005832    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1fa0d55-4f21-402a-8677-07115cfa7828-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:35:42.006014 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.005846    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7thj\" (UniqueName: \"kubernetes.io/projected/f1fa0d55-4f21-402a-8677-07115cfa7828-kube-api-access-l7thj\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:35:42.006014 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.005860    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1fa0d55-4f21-402a-8677-07115cfa7828-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:35:42.137881 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.137845    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"]
Jul 02 23:35:42.141038 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:35:42.141011    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod326e3d1c_b96c_4eee_805b_38ce21d2c597.slice/crio-7331eb5a6262088b5a8e6b80b91aa5465480a161582401e24b25140a434b83b9 WatchSource:0}: Error finding container 7331eb5a6262088b5a8e6b80b91aa5465480a161582401e24b25140a434b83b9: Status 404 returned error can't find the container with id 7331eb5a6262088b5a8e6b80b91aa5465480a161582401e24b25140a434b83b9
Jul 02 23:35:42.143130 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.143097    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:35:42.143221 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.143160    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:35:42.143221 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.143188    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:35:42.622296 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.622251    2568 generic.go:356] "Generic (PLEG): container finished" podID="f1fa0d55-4f21-402a-8677-07115cfa7828" containerID="624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a" exitCode=0
Jul 02 23:35:42.622500 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.622316    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"
Jul 02 23:35:42.622500 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.622315    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp" event={"ID":"f1fa0d55-4f21-402a-8677-07115cfa7828","Type":"ContainerDied","Data":"624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a"}
Jul 02 23:35:42.622500 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.622444    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp" event={"ID":"f1fa0d55-4f21-402a-8677-07115cfa7828","Type":"ContainerDied","Data":"44248f075a2807a31dfa668c982df6e585f607978b5f713aead664b9832fb935"}
Jul 02 23:35:42.622500 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.622466    2568 scope.go:117] "RemoveContainer" containerID="624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a"
Jul 02 23:35:42.624198 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.624173    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv" event={"ID":"326e3d1c-b96c-4eee-805b-38ce21d2c597","Type":"ContainerStarted","Data":"91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79"}
Jul 02 23:35:42.624323 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.624231    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv" event={"ID":"326e3d1c-b96c-4eee-805b-38ce21d2c597","Type":"ContainerStarted","Data":"7331eb5a6262088b5a8e6b80b91aa5465480a161582401e24b25140a434b83b9"}
Jul 02 23:35:42.633036 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.633017    2568 scope.go:117] "RemoveContainer" containerID="624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a"
Jul 02 23:35:42.633335 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:35:42.633312    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a\": container with ID starting with 624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a not found: ID does not exist" containerID="624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a"
Jul 02 23:35:42.633444 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.633343    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a"} err="failed to get container status \"624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a\": rpc error: code = NotFound desc = could not find container \"624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a\": container with ID starting with 624b44d539c3c3795664ed8170a475aa4dde2479cae712b2f2ac8bcd9a12ce5a not found: ID does not exist"
Jul 02 23:35:42.648372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.648317    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv" podStartSLOduration=1.6482994309999999 podStartE2EDuration="1.648299431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:42.646718184 +0000 UTC m=+1509.102974404" watchObservedRunningTime="2026-07-02 23:35:42.648299431 +0000 UTC m=+1509.104555693"
Jul 02 23:35:42.659112 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.659066    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"]
Jul 02 23:35:42.664025 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.663994    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fc5f7b5c-openshift-default-755f4c956f-624pp"]
Jul 02 23:35:42.986559 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:42.986458    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:43.992379 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:43.992345    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:44.084916 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:44.084879    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1fa0d55-4f21-402a-8677-07115cfa7828" path="/var/lib/kubelet/pods/f1fa0d55-4f21-402a-8677-07115cfa7828/volumes"
Jul 02 23:35:44.635410 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:44.635372    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:44.636586 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:44.636564    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:53.680597 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:53.680561    2568 generic.go:356] "Generic (PLEG): container finished" podID="326e3d1c-b96c-4eee-805b-38ce21d2c597" containerID="91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79" exitCode=0
Jul 02 23:35:53.681108 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:53.680625    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv" event={"ID":"326e3d1c-b96c-4eee-805b-38ce21d2c597","Type":"ContainerDied","Data":"91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79"}
Jul 02 23:35:53.681108 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:53.681018    2568 scope.go:117] "RemoveContainer" containerID="91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79"
Jul 02 23:35:53.682054 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:53.682023    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:35:53.682156 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:53.682095    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:35:53.682156 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:53.682126    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:35:54.268896 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:54.268856    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"]
Jul 02 23:35:54.687816 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:54.687718    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv" event={"ID":"326e3d1c-b96c-4eee-805b-38ce21d2c597","Type":"ContainerStarted","Data":"b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59"}
Jul 02 23:35:54.687816 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:54.687769    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv" podUID="326e3d1c-b96c-4eee-805b-38ce21d2c597" containerName="istio-proxy" containerID="cri-o://b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59" gracePeriod=30
Jul 02 23:35:59.636260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:59.636215    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:35:59.950836 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:35:59.950809    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:36:00.074108 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074071    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-certs\") pod \"326e3d1c-b96c-4eee-805b-38ce21d2c597\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") "
Jul 02 23:36:00.074308 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074121    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-credential-socket\") pod \"326e3d1c-b96c-4eee-805b-38ce21d2c597\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") "
Jul 02 23:36:00.074308 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074146    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-token\") pod \"326e3d1c-b96c-4eee-805b-38ce21d2c597\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") "
Jul 02 23:36:00.074308 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074184    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-envoy\") pod \"326e3d1c-b96c-4eee-805b-38ce21d2c597\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") "
Jul 02 23:36:00.074308 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074209    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-data\") pod \"326e3d1c-b96c-4eee-805b-38ce21d2c597\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") "
Jul 02 23:36:00.074308 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074253    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-socket\") pod \"326e3d1c-b96c-4eee-805b-38ce21d2c597\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") "
Jul 02 23:36:00.074561 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074418    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-podinfo\") pod \"326e3d1c-b96c-4eee-805b-38ce21d2c597\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") "
Jul 02 23:36:00.074561 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074434    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "326e3d1c-b96c-4eee-805b-38ce21d2c597" (UID: "326e3d1c-b96c-4eee-805b-38ce21d2c597"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:00.074561 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074459    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/326e3d1c-b96c-4eee-805b-38ce21d2c597-istiod-ca-cert\") pod \"326e3d1c-b96c-4eee-805b-38ce21d2c597\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") "
Jul 02 23:36:00.074561 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074540    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "326e3d1c-b96c-4eee-805b-38ce21d2c597" (UID: "326e3d1c-b96c-4eee-805b-38ce21d2c597"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:00.074811 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074560    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv6dw\" (UniqueName: \"kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-kube-api-access-gv6dw\") pod \"326e3d1c-b96c-4eee-805b-38ce21d2c597\" (UID: \"326e3d1c-b96c-4eee-805b-38ce21d2c597\") "
Jul 02 23:36:00.074880 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074858    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:00.074937 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074874    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/326e3d1c-b96c-4eee-805b-38ce21d2c597-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "326e3d1c-b96c-4eee-805b-38ce21d2c597" (UID: "326e3d1c-b96c-4eee-805b-38ce21d2c597"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:36:00.074937 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074880    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:00.075024 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.074961    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "326e3d1c-b96c-4eee-805b-38ce21d2c597" (UID: "326e3d1c-b96c-4eee-805b-38ce21d2c597"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:00.075304 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.075274    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-data" (OuterVolumeSpecName: "istio-data") pod "326e3d1c-b96c-4eee-805b-38ce21d2c597" (UID: "326e3d1c-b96c-4eee-805b-38ce21d2c597"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:00.076732 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.076700    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "326e3d1c-b96c-4eee-805b-38ce21d2c597" (UID: "326e3d1c-b96c-4eee-805b-38ce21d2c597"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:36:00.077123 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.077043    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-token" (OuterVolumeSpecName: "istio-token") pod "326e3d1c-b96c-4eee-805b-38ce21d2c597" (UID: "326e3d1c-b96c-4eee-805b-38ce21d2c597"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:36:00.077211 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.077142    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "326e3d1c-b96c-4eee-805b-38ce21d2c597" (UID: "326e3d1c-b96c-4eee-805b-38ce21d2c597"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:00.077286 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.077263    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-kube-api-access-gv6dw" (OuterVolumeSpecName: "kube-api-access-gv6dw") pod "326e3d1c-b96c-4eee-805b-38ce21d2c597" (UID: "326e3d1c-b96c-4eee-805b-38ce21d2c597"). InnerVolumeSpecName "kube-api-access-gv6dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:36:00.175382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.175331    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv6dw\" (UniqueName: \"kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-kube-api-access-gv6dw\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:00.175382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.175370    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:00.175382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.175384    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:00.175382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.175395    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:00.175665 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.175406    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:00.175665 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.175417    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/326e3d1c-b96c-4eee-805b-38ce21d2c597-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:00.175665 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.175427    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/326e3d1c-b96c-4eee-805b-38ce21d2c597-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:00.436225 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.436190    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"]
Jul 02 23:36:00.436571 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.436558    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="326e3d1c-b96c-4eee-805b-38ce21d2c597" containerName="istio-proxy"
Jul 02 23:36:00.436610 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.436573    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="326e3d1c-b96c-4eee-805b-38ce21d2c597" containerName="istio-proxy"
Jul 02 23:36:00.436610 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.436584    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1fa0d55-4f21-402a-8677-07115cfa7828" containerName="istio-proxy"
Jul 02 23:36:00.436610 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.436590    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1fa0d55-4f21-402a-8677-07115cfa7828" containerName="istio-proxy"
Jul 02 23:36:00.436610 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.436601    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="326e3d1c-b96c-4eee-805b-38ce21d2c597" containerName="istio-proxy"
Jul 02 23:36:00.436610 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.436610    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="326e3d1c-b96c-4eee-805b-38ce21d2c597" containerName="istio-proxy"
Jul 02 23:36:00.436783 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.436709    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="326e3d1c-b96c-4eee-805b-38ce21d2c597" containerName="istio-proxy"
Jul 02 23:36:00.436783 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.436721    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1fa0d55-4f21-402a-8677-07115cfa7828" containerName="istio-proxy"
Jul 02 23:36:00.439143 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.439116    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.441223 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.441199    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2eb256fc-openshift-default-dockercfg-ch9mb\""
Jul 02 23:36:00.450532 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.450500    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"]
Jul 02 23:36:00.578408 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.578362    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-envoy\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.578408 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.578407    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-data\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.578657 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.578439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-socket\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.578657 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.578486    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b680897c-3185-4ef4-a2be-060eddd9381a-istio-podinfo\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.578657 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.578517    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-credential-socket\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.578657 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.578565    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-istio-token\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.578657 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.578601    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b680897c-3185-4ef4-a2be-060eddd9381a-istiod-ca-cert\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.578657 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.578616    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrj9g\" (UniqueName: \"kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-kube-api-access-zrj9g\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.578919 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.578735    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-certs\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.680013 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.679959    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b680897c-3185-4ef4-a2be-060eddd9381a-istiod-ca-cert\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.680013 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680011    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrj9g\" (UniqueName: \"kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-kube-api-access-zrj9g\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.680557 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-certs\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.680557 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680084    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-envoy\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.680557 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-data\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.680557 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-socket\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.680557 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b680897c-3185-4ef4-a2be-060eddd9381a-istio-podinfo\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.680557 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680318    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-credential-socket\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.680557 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680350    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-istio-token\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.680557 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680489    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-data\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.681000 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680603    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-certs\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.681000 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680809    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-credential-socket\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.681000 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680863    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b680897c-3185-4ef4-a2be-060eddd9381a-istiod-ca-cert\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.681000 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.680955    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-socket\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.682549 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.682530    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-envoy\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.682819 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.682793    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b680897c-3185-4ef4-a2be-060eddd9381a-istio-podinfo\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.693815 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.693737    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-istio-token\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.693938 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.693837    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrj9g\" (UniqueName: \"kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-kube-api-access-zrj9g\") pod \"e2e-derive-2eb256fc-openshift-default-699b889f-72jtl\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") " pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.718546 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.718508    2568 generic.go:356] "Generic (PLEG): container finished" podID="326e3d1c-b96c-4eee-805b-38ce21d2c597" containerID="b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59" exitCode=0
Jul 02 23:36:00.718747 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.718562    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"
Jul 02 23:36:00.718747 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.718594    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv" event={"ID":"326e3d1c-b96c-4eee-805b-38ce21d2c597","Type":"ContainerDied","Data":"b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59"}
Jul 02 23:36:00.718747 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.718664    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv" event={"ID":"326e3d1c-b96c-4eee-805b-38ce21d2c597","Type":"ContainerDied","Data":"7331eb5a6262088b5a8e6b80b91aa5465480a161582401e24b25140a434b83b9"}
Jul 02 23:36:00.718747 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.718712    2568 scope.go:117] "RemoveContainer" containerID="b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59"
Jul 02 23:36:00.727745 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.727722    2568 scope.go:117] "RemoveContainer" containerID="91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79"
Jul 02 23:36:00.734041 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.734014    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"]
Jul 02 23:36:00.737725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.737699    2568 scope.go:117] "RemoveContainer" containerID="b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59"
Jul 02 23:36:00.738121 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:36:00.738094    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59\": container with ID starting with b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59 not found: ID does not exist" containerID="b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59"
Jul 02 23:36:00.738214 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.738135    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59"} err="failed to get container status \"b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59\": rpc error: code = NotFound desc = could not find container \"b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59\": container with ID starting with b58e1476fd1fbef954def1a325131939792a732300257e7b985d7ad52001bb59 not found: ID does not exist"
Jul 02 23:36:00.738214 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.738160    2568 scope.go:117] "RemoveContainer" containerID="91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79"
Jul 02 23:36:00.738402 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.738385    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-88a77b91-openshift-default-6f8dcbfb45-v9nqv"]
Jul 02 23:36:00.738453 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:36:00.738438    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79\": container with ID starting with 91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79 not found: ID does not exist" containerID="91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79"
Jul 02 23:36:00.738492 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.738459    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79"} err="failed to get container status \"91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79\": rpc error: code = NotFound desc = could not find container \"91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79\": container with ID starting with 91f2892dfc229f723a024796db551f7429f46071ebdb54c83883cc8f5bfb4e79 not found: ID does not exist"
Jul 02 23:36:00.751739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.751700    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:00.901176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.901149    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"]
Jul 02 23:36:00.903832 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:36:00.903791    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb680897c_3185_4ef4_a2be_060eddd9381a.slice/crio-5ef7bbfeeb5922ee8ece3df263c4ee6c85e0ad20443c4c53fd8f8ec60b0ecf5a WatchSource:0}: Error finding container 5ef7bbfeeb5922ee8ece3df263c4ee6c85e0ad20443c4c53fd8f8ec60b0ecf5a: Status 404 returned error can't find the container with id 5ef7bbfeeb5922ee8ece3df263c4ee6c85e0ad20443c4c53fd8f8ec60b0ecf5a
Jul 02 23:36:00.906599 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.906559    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:36:00.906727 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.906650    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:36:00.906727 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:00.906711    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:36:01.737031 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:01.735284    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl" event={"ID":"b680897c-3185-4ef4-a2be-060eddd9381a","Type":"ContainerStarted","Data":"0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48"}
Jul 02 23:36:01.737031 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:01.735402    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl" event={"ID":"b680897c-3185-4ef4-a2be-060eddd9381a","Type":"ContainerStarted","Data":"5ef7bbfeeb5922ee8ece3df263c4ee6c85e0ad20443c4c53fd8f8ec60b0ecf5a"}
Jul 02 23:36:01.751952 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:01.751912    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:01.757074 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:01.757043    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:01.758292 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:01.758233    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl" podStartSLOduration=1.7582161649999999 podStartE2EDuration="1.758216165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:36:01.757947673 +0000 UTC m=+1528.214203886" watchObservedRunningTime="2026-07-02 23:36:01.758216165 +0000 UTC m=+1528.214472366"
Jul 02 23:36:02.079841 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:02.079805    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="326e3d1c-b96c-4eee-805b-38ce21d2c597" path="/var/lib/kubelet/pods/326e3d1c-b96c-4eee-805b-38ce21d2c597/volumes"
Jul 02 23:36:02.742407 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:02.742373    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:02.743280 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:02.743260    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:06.274081 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:06.274039    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"]
Jul 02 23:36:06.274509 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:06.274230    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl" podUID="b680897c-3185-4ef4-a2be-060eddd9381a" containerName="istio-proxy" containerID="cri-o://0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48" gracePeriod=30
Jul 02 23:36:11.541229 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.541146    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:11.579364 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579334    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b680897c-3185-4ef4-a2be-060eddd9381a-istio-podinfo\") pod \"b680897c-3185-4ef4-a2be-060eddd9381a\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") "
Jul 02 23:36:11.579532 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579372    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrj9g\" (UniqueName: \"kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-kube-api-access-zrj9g\") pod \"b680897c-3185-4ef4-a2be-060eddd9381a\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") "
Jul 02 23:36:11.579532 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579417    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-socket\") pod \"b680897c-3185-4ef4-a2be-060eddd9381a\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") "
Jul 02 23:36:11.579532 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579442    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b680897c-3185-4ef4-a2be-060eddd9381a-istiod-ca-cert\") pod \"b680897c-3185-4ef4-a2be-060eddd9381a\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") "
Jul 02 23:36:11.579532 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579462    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-istio-token\") pod \"b680897c-3185-4ef4-a2be-060eddd9381a\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") "
Jul 02 23:36:11.579532 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579521    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-certs\") pod \"b680897c-3185-4ef4-a2be-060eddd9381a\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") "
Jul 02 23:36:11.579874 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579707    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-envoy\") pod \"b680897c-3185-4ef4-a2be-060eddd9381a\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") "
Jul 02 23:36:11.579874 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579752    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-data\") pod \"b680897c-3185-4ef4-a2be-060eddd9381a\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") "
Jul 02 23:36:11.579874 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579802    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-credential-socket\") pod \"b680897c-3185-4ef4-a2be-060eddd9381a\" (UID: \"b680897c-3185-4ef4-a2be-060eddd9381a\") "
Jul 02 23:36:11.579874 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579831    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b680897c-3185-4ef4-a2be-060eddd9381a" (UID: "b680897c-3185-4ef4-a2be-060eddd9381a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:11.580060 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.579945    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b680897c-3185-4ef4-a2be-060eddd9381a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b680897c-3185-4ef4-a2be-060eddd9381a" (UID: "b680897c-3185-4ef4-a2be-060eddd9381a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:36:11.580252 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.580172    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b680897c-3185-4ef4-a2be-060eddd9381a" (UID: "b680897c-3185-4ef4-a2be-060eddd9381a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:11.580252 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.580197    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:11.580252 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.580218    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b680897c-3185-4ef4-a2be-060eddd9381a-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:11.580412 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.580263    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b680897c-3185-4ef4-a2be-060eddd9381a" (UID: "b680897c-3185-4ef4-a2be-060eddd9381a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:11.580412 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.580330    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b680897c-3185-4ef4-a2be-060eddd9381a" (UID: "b680897c-3185-4ef4-a2be-060eddd9381a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:11.582176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.582151    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b680897c-3185-4ef4-a2be-060eddd9381a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b680897c-3185-4ef4-a2be-060eddd9381a" (UID: "b680897c-3185-4ef4-a2be-060eddd9381a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:36:11.582237 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.582156    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b680897c-3185-4ef4-a2be-060eddd9381a" (UID: "b680897c-3185-4ef4-a2be-060eddd9381a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:36:11.582279 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.582252    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b680897c-3185-4ef4-a2be-060eddd9381a" (UID: "b680897c-3185-4ef4-a2be-060eddd9381a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:11.582349 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.582333    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-kube-api-access-zrj9g" (OuterVolumeSpecName: "kube-api-access-zrj9g") pod "b680897c-3185-4ef4-a2be-060eddd9381a" (UID: "b680897c-3185-4ef4-a2be-060eddd9381a"). InnerVolumeSpecName "kube-api-access-zrj9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:36:11.681627 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.681588    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:11.681627 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.681620    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:11.681627 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.681632    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:11.681918 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.681640    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b680897c-3185-4ef4-a2be-060eddd9381a-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:11.681918 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.681651    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrj9g\" (UniqueName: \"kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-kube-api-access-zrj9g\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:11.681918 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.681660    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b680897c-3185-4ef4-a2be-060eddd9381a-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:11.681918 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.681669    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b680897c-3185-4ef4-a2be-060eddd9381a-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:36:11.785494 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.785456    2568 generic.go:356] "Generic (PLEG): container finished" podID="b680897c-3185-4ef4-a2be-060eddd9381a" containerID="0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48" exitCode=0
Jul 02 23:36:11.785713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.785501    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"
Jul 02 23:36:11.785713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.785539    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl" event={"ID":"b680897c-3185-4ef4-a2be-060eddd9381a","Type":"ContainerDied","Data":"0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48"}
Jul 02 23:36:11.785713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.785594    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl" event={"ID":"b680897c-3185-4ef4-a2be-060eddd9381a","Type":"ContainerDied","Data":"5ef7bbfeeb5922ee8ece3df263c4ee6c85e0ad20443c4c53fd8f8ec60b0ecf5a"}
Jul 02 23:36:11.785713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.785615    2568 scope.go:117] "RemoveContainer" containerID="0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48"
Jul 02 23:36:11.795212 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.795188    2568 scope.go:117] "RemoveContainer" containerID="0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48"
Jul 02 23:36:11.795548 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:36:11.795526    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48\": container with ID starting with 0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48 not found: ID does not exist" containerID="0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48"
Jul 02 23:36:11.795596 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.795558    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48"} err="failed to get container status \"0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48\": rpc error: code = NotFound desc = could not find container \"0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48\": container with ID starting with 0dc408ff6c7d20135730b18fdb1f109f621de5e1ebd096ef42915f09d4b22a48 not found: ID does not exist"
Jul 02 23:36:11.806507 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.806472    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"]
Jul 02 23:36:11.810225 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:11.810196    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2eb256fc-openshift-default-699b889f-72jtl"]
Jul 02 23:36:12.079390 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:36:12.079304    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b680897c-3185-4ef4-a2be-060eddd9381a" path="/var/lib/kubelet/pods/b680897c-3185-4ef4-a2be-060eddd9381a/volumes"
Jul 02 23:37:48.424869 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.424832    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"]
Jul 02 23:37:48.425312 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.425226    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b680897c-3185-4ef4-a2be-060eddd9381a" containerName="istio-proxy"
Jul 02 23:37:48.425312 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.425238    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b680897c-3185-4ef4-a2be-060eddd9381a" containerName="istio-proxy"
Jul 02 23:37:48.425312 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.425290    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="326e3d1c-b96c-4eee-805b-38ce21d2c597" containerName="istio-proxy"
Jul 02 23:37:48.425312 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.425301    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b680897c-3185-4ef4-a2be-060eddd9381a" containerName="istio-proxy"
Jul 02 23:37:48.428390 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.428368    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.430553 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.430528    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5c689209-openshift-default-dockercfg-z2qb8\""
Jul 02 23:37:48.443784 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.443752    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-podinfo\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.443955 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.443790    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-envoy\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.443955 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.443815    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-socket\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.443955 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.443835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m59l\" (UniqueName: \"kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-kube-api-access-4m59l\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.443955 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.443890    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-certs\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.443955 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.443913    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a26930a9-d06b-42ba-87f5-ee442babf9c1-istiod-ca-cert\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.443955 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.443930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-token\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.444166 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.443957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-credential-socket\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.444166 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.443977    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-data\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.452291 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.452248    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"]
Jul 02 23:37:48.545057 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545025    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-podinfo\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545265 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545065    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-envoy\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545265 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545093    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-socket\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545265 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m59l\" (UniqueName: \"kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-kube-api-access-4m59l\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545265 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545153    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-certs\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545265 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545177    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a26930a9-d06b-42ba-87f5-ee442babf9c1-istiod-ca-cert\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545265 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545202    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-token\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545265 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545251    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-credential-socket\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545620 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-data\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545620 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545602    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-certs\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545764 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545642    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-socket\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545867 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545845    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-data\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.545933 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.545890    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-credential-socket\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.546206 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.546183    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a26930a9-d06b-42ba-87f5-ee442babf9c1-istiod-ca-cert\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.547600 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.547581    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-envoy\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.547729 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.547662    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-podinfo\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.553241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.553206    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-token\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.553358 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.553276    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m59l\" (UniqueName: \"kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-kube-api-access-4m59l\") pod \"e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") " pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.739343 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.739237    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:48.895696 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.895648    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"]
Jul 02 23:37:48.897153 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:37:48.897121    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26930a9_d06b_42ba_87f5_ee442babf9c1.slice/crio-653db177176fccc91fc317409dc94a51e4a815e3eba5abef71ab0df889324006 WatchSource:0}: Error finding container 653db177176fccc91fc317409dc94a51e4a815e3eba5abef71ab0df889324006: Status 404 returned error can't find the container with id 653db177176fccc91fc317409dc94a51e4a815e3eba5abef71ab0df889324006
Jul 02 23:37:48.899397 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.899357    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:37:48.899482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.899459    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:37:48.899520 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:48.899488    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:37:49.242372 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:49.242336    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" event={"ID":"a26930a9-d06b-42ba-87f5-ee442babf9c1","Type":"ContainerStarted","Data":"7f77fe26a032083c9720c9ab57afd68d53a0ddc17592dbe198af774899e1cff4"}
Jul 02 23:37:49.242591 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:49.242398    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" event={"ID":"a26930a9-d06b-42ba-87f5-ee442babf9c1","Type":"ContainerStarted","Data":"653db177176fccc91fc317409dc94a51e4a815e3eba5abef71ab0df889324006"}
Jul 02 23:37:49.263050 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:49.262979    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" podStartSLOduration=1.262958581 podStartE2EDuration="1.262958581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:37:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:37:49.262494734 +0000 UTC m=+1635.718750975" watchObservedRunningTime="2026-07-02 23:37:49.262958581 +0000 UTC m=+1635.719214784"
Jul 02 23:37:49.740341 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:49.740297    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:49.745547 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:49.745519    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:50.248080 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:50.248039    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:37:50.249153 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:37:50.249132    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:38:05.249576 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:05.249535    2568 patch_prober.go:28] interesting pod/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 02 23:38:05.250047 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:05.249605    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 02 23:38:05.322822 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:05.322788    2568 generic.go:356] "Generic (PLEG): container finished" podID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerID="7f77fe26a032083c9720c9ab57afd68d53a0ddc17592dbe198af774899e1cff4" exitCode=0
Jul 02 23:38:05.322822 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:05.322835    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" event={"ID":"a26930a9-d06b-42ba-87f5-ee442babf9c1","Type":"ContainerDied","Data":"7f77fe26a032083c9720c9ab57afd68d53a0ddc17592dbe198af774899e1cff4"}
Jul 02 23:38:05.323231 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:05.323215    2568 scope.go:117] "RemoveContainer" containerID="7f77fe26a032083c9720c9ab57afd68d53a0ddc17592dbe198af774899e1cff4"
Jul 02 23:38:05.324270 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:05.324242    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:38:05.324326 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:05.324311    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:38:05.324360 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:05.324344    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:38:06.332709 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:06.332657    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" event={"ID":"a26930a9-d06b-42ba-87f5-ee442babf9c1","Type":"ContainerStarted","Data":"31af8e8e037de46c7b3b3858e2ba00e5409bb9c2845787bcb72a69442d62af2f"}
Jul 02 23:38:06.740548 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:06.740446    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:38:06.740744 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:06.740712    2568 patch_prober.go:28] interesting pod/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 02 23:38:06.740806 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:06.740772    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 02 23:38:07.740392 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:07.740348    2568 patch_prober.go:28] interesting pod/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 02 23:38:07.740930 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:07.740429    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 02 23:38:08.739997 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:08.739956    2568 patch_prober.go:28] interesting pod/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 02 23:38:08.740185 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:08.740015    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 02 23:38:09.379378 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:09.379336    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"]
Jul 02 23:38:09.380212 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:09.380174    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy" containerID="cri-o://31af8e8e037de46c7b3b3858e2ba00e5409bb9c2845787bcb72a69442d62af2f" gracePeriod=30
Jul 02 23:38:15.376326 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.376285    2568 generic.go:356] "Generic (PLEG): container finished" podID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerID="31af8e8e037de46c7b3b3858e2ba00e5409bb9c2845787bcb72a69442d62af2f" exitCode=0
Jul 02 23:38:15.376822 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.376379    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" event={"ID":"a26930a9-d06b-42ba-87f5-ee442babf9c1","Type":"ContainerDied","Data":"31af8e8e037de46c7b3b3858e2ba00e5409bb9c2845787bcb72a69442d62af2f"}
Jul 02 23:38:15.376822 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.376441    2568 scope.go:117] "RemoveContainer" containerID="7f77fe26a032083c9720c9ab57afd68d53a0ddc17592dbe198af774899e1cff4"
Jul 02 23:38:15.446592 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.446562    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:38:15.610899 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.610851    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-socket\") pod \"a26930a9-d06b-42ba-87f5-ee442babf9c1\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") "
Jul 02 23:38:15.610899 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.610902    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-envoy\") pod \"a26930a9-d06b-42ba-87f5-ee442babf9c1\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") "
Jul 02 23:38:15.611161 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.610940    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m59l\" (UniqueName: \"kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-kube-api-access-4m59l\") pod \"a26930a9-d06b-42ba-87f5-ee442babf9c1\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") "
Jul 02 23:38:15.611161 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.610966    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-data\") pod \"a26930a9-d06b-42ba-87f5-ee442babf9c1\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") "
Jul 02 23:38:15.611161 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611026    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-certs\") pod \"a26930a9-d06b-42ba-87f5-ee442babf9c1\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") "
Jul 02 23:38:15.611161 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611050    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-token\") pod \"a26930a9-d06b-42ba-87f5-ee442babf9c1\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") "
Jul 02 23:38:15.611161 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611081    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-podinfo\") pod \"a26930a9-d06b-42ba-87f5-ee442babf9c1\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") "
Jul 02 23:38:15.611161 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611149    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a26930a9-d06b-42ba-87f5-ee442babf9c1-istiod-ca-cert\") pod \"a26930a9-d06b-42ba-87f5-ee442babf9c1\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") "
Jul 02 23:38:15.611465 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611196    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a26930a9-d06b-42ba-87f5-ee442babf9c1" (UID: "a26930a9-d06b-42ba-87f5-ee442babf9c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:38:15.611465 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611200    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-credential-socket\") pod \"a26930a9-d06b-42ba-87f5-ee442babf9c1\" (UID: \"a26930a9-d06b-42ba-87f5-ee442babf9c1\") "
Jul 02 23:38:15.611465 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611403    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a26930a9-d06b-42ba-87f5-ee442babf9c1" (UID: "a26930a9-d06b-42ba-87f5-ee442babf9c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:38:15.611628 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611540    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:38:15.611628 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611559    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:38:15.611774 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611709    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26930a9-d06b-42ba-87f5-ee442babf9c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a26930a9-d06b-42ba-87f5-ee442babf9c1" (UID: "a26930a9-d06b-42ba-87f5-ee442babf9c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:38:15.611774 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.611738    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a26930a9-d06b-42ba-87f5-ee442babf9c1" (UID: "a26930a9-d06b-42ba-87f5-ee442babf9c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:38:15.612084 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.612051    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "a26930a9-d06b-42ba-87f5-ee442babf9c1" (UID: "a26930a9-d06b-42ba-87f5-ee442babf9c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:38:15.613593 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.613549    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "a26930a9-d06b-42ba-87f5-ee442babf9c1" (UID: "a26930a9-d06b-42ba-87f5-ee442babf9c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:38:15.613752 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.613646    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a26930a9-d06b-42ba-87f5-ee442babf9c1" (UID: "a26930a9-d06b-42ba-87f5-ee442babf9c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:38:15.613752 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.613662    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-kube-api-access-4m59l" (OuterVolumeSpecName: "kube-api-access-4m59l") pod "a26930a9-d06b-42ba-87f5-ee442babf9c1" (UID: "a26930a9-d06b-42ba-87f5-ee442babf9c1"). InnerVolumeSpecName "kube-api-access-4m59l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:38:15.614075 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.614044    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a26930a9-d06b-42ba-87f5-ee442babf9c1" (UID: "a26930a9-d06b-42ba-87f5-ee442babf9c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:38:15.712499 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.712453    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a26930a9-d06b-42ba-87f5-ee442babf9c1-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:38:15.712499 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.712491    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:38:15.712499 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.712501    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m59l\" (UniqueName: \"kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-kube-api-access-4m59l\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:38:15.712499 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.712510    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:38:15.712820 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.712519    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26930a9-d06b-42ba-87f5-ee442babf9c1-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:38:15.712820 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.712527    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:38:15.712820 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:15.712534    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a26930a9-d06b-42ba-87f5-ee442babf9c1-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:38:16.382824 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:16.382746    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"
Jul 02 23:38:16.382824 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:16.382771    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb" event={"ID":"a26930a9-d06b-42ba-87f5-ee442babf9c1","Type":"ContainerDied","Data":"653db177176fccc91fc317409dc94a51e4a815e3eba5abef71ab0df889324006"}
Jul 02 23:38:16.383301 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:16.382837    2568 scope.go:117] "RemoveContainer" containerID="31af8e8e037de46c7b3b3858e2ba00e5409bb9c2845787bcb72a69442d62af2f"
Jul 02 23:38:16.417311 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:16.417278    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"]
Jul 02 23:38:16.430038 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:16.430008    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5c689209-openshift-default-7b599d77f9-hqrpb"]
Jul 02 23:38:18.078530 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:18.078490    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" path="/var/lib/kubelet/pods/a26930a9-d06b-42ba-87f5-ee442babf9c1/volumes"
Jul 02 23:38:28.450382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.450340    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"]
Jul 02 23:38:28.450926 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.450884    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy"
Jul 02 23:38:28.450926 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.450903    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy"
Jul 02 23:38:28.451068 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.450979    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy"
Jul 02 23:38:28.455504 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.455480    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.457645 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.457620    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ea34dc2c-openshift-default-dockercfg-5tfcn\""
Jul 02 23:38:28.465606 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.465575    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"]
Jul 02 23:38:28.533292 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.533249    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istiod-ca-cert\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.533292 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.533298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-envoy\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.533560 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.533313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-data\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.533560 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.533373    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-certs\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.533560 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.533416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-podinfo\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.533560 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.533466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-socket\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.533560 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.533482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59gfx\" (UniqueName: \"kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-kube-api-access-59gfx\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.533560 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.533528    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-credential-socket\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.533560 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.533554    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-token\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.634783 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.634742    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-socket\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.634783 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.634784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59gfx\" (UniqueName: \"kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-kube-api-access-59gfx\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.634824    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-credential-socket\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.634845    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-token\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.634870    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istiod-ca-cert\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.634909    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-envoy\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.634931    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-data\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.634958    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-certs\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635055 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.634983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-podinfo\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.635228    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-socket\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.635339    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-data\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.635517    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-certs\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.635567    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-credential-socket\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.635949 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.635825    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istiod-ca-cert\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.637462 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.637443    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-envoy\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.637546 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.637523    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-podinfo\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.642308 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.642281    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-token\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.642462 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.642414    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59gfx\" (UniqueName: \"kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-kube-api-access-59gfx\") pod \"e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") " pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.767445 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.767370    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:28.915854 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.915827    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"]
Jul 02 23:38:28.918362 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:38:28.918332    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5c156e_2a6f_485c_9a52_82fb1c9cb2c5.slice/crio-095426b4d48181a1d399558884b5d85ee0ed91586e6aa57a40130c57ae23d8e8 WatchSource:0}: Error finding container 095426b4d48181a1d399558884b5d85ee0ed91586e6aa57a40130c57ae23d8e8: Status 404 returned error can't find the container with id 095426b4d48181a1d399558884b5d85ee0ed91586e6aa57a40130c57ae23d8e8
Jul 02 23:38:28.920386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.920351    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:38:28.920478 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.920428    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:38:28.920478 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:28.920457    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:38:29.448408 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:29.448371    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" event={"ID":"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5","Type":"ContainerStarted","Data":"c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c"}
Jul 02 23:38:29.448625 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:29.448432    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" event={"ID":"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5","Type":"ContainerStarted","Data":"095426b4d48181a1d399558884b5d85ee0ed91586e6aa57a40130c57ae23d8e8"}
Jul 02 23:38:29.469163 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:29.469109    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" podStartSLOduration=1.46908991 podStartE2EDuration="1.46908991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:38:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:38:29.467020027 +0000 UTC m=+1675.923276229" watchObservedRunningTime="2026-07-02 23:38:29.46908991 +0000 UTC m=+1675.925346180"
Jul 02 23:38:29.768021 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:29.767990    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:29.773087 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:29.773059    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:30.453653 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:30.453622    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:30.454665 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:30.454645    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:43.358222 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.358186    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"]
Jul 02 23:38:43.358826 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.358796    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy"
Jul 02 23:38:43.358916 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.358829    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy"
Jul 02 23:38:43.358916 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.358914    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26930a9-d06b-42ba-87f5-ee442babf9c1" containerName="istio-proxy"
Jul 02 23:38:43.362197 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.362172    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.364494 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.364471    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ea34dc2c\"/\"openshift-service-ca.crt\""
Jul 02 23:38:43.364624 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.364473    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ea34dc2c\"/\"default-dockercfg-4q5ds\""
Jul 02 23:38:43.365139 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.365115    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ea34dc2c\"/\"kube-root-ca.crt\""
Jul 02 23:38:43.365253 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.365115    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ea34dc2c\"/\"e2e-lifecycle-model-ea34dc2c-kserve-self-signed-certs\""
Jul 02 23:38:43.370154 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.370125    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"]
Jul 02 23:38:43.461980 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.461942    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-home\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.462187 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.461998    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-dshm\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.462187 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.462033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-model-cache\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.462187 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.462061    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfff9763-6569-43f4-9daf-e2e627d1c61b-tls-certs\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.462354 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.462208    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj85b\" (UniqueName: \"kubernetes.io/projected/cfff9763-6569-43f4-9daf-e2e627d1c61b-kube-api-access-nj85b\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.462354 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.462309    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-tmp-dir\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.563437 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.563326    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-home\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.563437 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.563378    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-dshm\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.563437 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.563399    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-model-cache\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.563437 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.563425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfff9763-6569-43f4-9daf-e2e627d1c61b-tls-certs\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.563791 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.563490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj85b\" (UniqueName: \"kubernetes.io/projected/cfff9763-6569-43f4-9daf-e2e627d1c61b-kube-api-access-nj85b\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.563791 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.563546    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-tmp-dir\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.563937 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.563894    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-model-cache\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.564031 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.564005    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-home\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.564088 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.564037    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-tmp-dir\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.565856 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.565831    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-dshm\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.566192 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.566170    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfff9763-6569-43f4-9daf-e2e627d1c61b-tls-certs\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.572368 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.572328    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj85b\" (UniqueName: \"kubernetes.io/projected/cfff9763-6569-43f4-9daf-e2e627d1c61b-kube-api-access-nj85b\") pod \"e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") " pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.676156 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.676110    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:43.834451 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:43.834422    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"]
Jul 02 23:38:43.837297 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:38:43.837262    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfff9763_6569_43f4_9daf_e2e627d1c61b.slice/crio-da097f257388b720c32ae419c3f65415541bab630d22367b5a5d42dcea72771f WatchSource:0}: Error finding container da097f257388b720c32ae419c3f65415541bab630d22367b5a5d42dcea72771f: Status 404 returned error can't find the container with id da097f257388b720c32ae419c3f65415541bab630d22367b5a5d42dcea72771f
Jul 02 23:38:44.524844 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:44.524804    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs" event={"ID":"cfff9763-6569-43f4-9daf-e2e627d1c61b","Type":"ContainerStarted","Data":"00860e1757b7c2c6361c00dcd437265a82a1703d0a47c634b9d709e342dc1493"}
Jul 02 23:38:44.525305 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:44.524853    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs" event={"ID":"cfff9763-6569-43f4-9daf-e2e627d1c61b","Type":"ContainerStarted","Data":"da097f257388b720c32ae419c3f65415541bab630d22367b5a5d42dcea72771f"}
Jul 02 23:38:44.540142 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:44.540077    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs" podStartSLOduration=1.540053516 podStartE2EDuration="1.540053516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:38:44.539721652 +0000 UTC m=+1690.995977855" watchObservedRunningTime="2026-07-02 23:38:44.540053516 +0000 UTC m=+1690.996309711"
Jul 02 23:38:45.895472 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:45.894626    2568 patch_prober.go:28] interesting pod/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:49244->10.133.0.44:15021: read: connection reset by peer" start-of-body=
Jul 02 23:38:45.895472 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:45.894735    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:49244->10.133.0.44:15021: read: connection reset by peer"
Jul 02 23:38:46.535892 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:46.535860    2568 generic.go:356] "Generic (PLEG): container finished" podID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerID="c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c" exitCode=0
Jul 02 23:38:46.536086 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:46.535941    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" event={"ID":"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5","Type":"ContainerDied","Data":"c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c"}
Jul 02 23:38:46.536354 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:46.536337    2568 scope.go:117] "RemoveContainer" containerID="c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c"
Jul 02 23:38:46.537355 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:46.537326    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:38:46.537415 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:46.537399    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:38:46.537460 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:46.537441    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:38:47.543168 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:47.543136    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" event={"ID":"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5","Type":"ContainerStarted","Data":"00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b"}
Jul 02 23:38:47.767859 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:47.767817    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:47.768146 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:47.768123    2568 patch_prober.go:28] interesting pod/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 02 23:38:47.768193 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:47.768175    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 02 23:38:48.767782 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:48.767745    2568 patch_prober.go:28] interesting pod/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 02 23:38:48.768193 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:48.767802    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 02 23:38:49.768499 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:49.768461    2568 patch_prober.go:28] interesting pod/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 02 23:38:49.768955 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:49.768534    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 02 23:38:50.768590 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:50.768546    2568 patch_prober.go:28] interesting pod/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 02 23:38:50.769028 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:50.768615    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 02 23:38:51.814120 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:51.814082    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:51.814608 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:51.814437    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:51.815343 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:51.815318    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:38:53.676442 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:53.676401    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:53.676994 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:53.676463    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:53.689234 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:53.689201    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:38:54.589691 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:38:54.589649    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:39:29.546912 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:29.546824    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"]
Jul 02 23:39:44.568164 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.568106    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs" podUID="cfff9763-6569-43f4-9daf-e2e627d1c61b" containerName="main" containerID="cri-o://00860e1757b7c2c6361c00dcd437265a82a1703d0a47c634b9d709e342dc1493" gracePeriod=45
Jul 02 23:39:44.578969 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.578935    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs" podUID="cfff9763-6569-43f4-9daf-e2e627d1c61b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": dial tcp 10.133.0.45:8000: connect: connection refused"
Jul 02 23:39:44.822049 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.821969    2568 generic.go:356] "Generic (PLEG): container finished" podID="cfff9763-6569-43f4-9daf-e2e627d1c61b" containerID="00860e1757b7c2c6361c00dcd437265a82a1703d0a47c634b9d709e342dc1493" exitCode=0
Jul 02 23:39:44.822181 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.822042    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs" event={"ID":"cfff9763-6569-43f4-9daf-e2e627d1c61b","Type":"ContainerDied","Data":"00860e1757b7c2c6361c00dcd437265a82a1703d0a47c634b9d709e342dc1493"}
Jul 02 23:39:44.822181 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.822087    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs" event={"ID":"cfff9763-6569-43f4-9daf-e2e627d1c61b","Type":"ContainerDied","Data":"da097f257388b720c32ae419c3f65415541bab630d22367b5a5d42dcea72771f"}
Jul 02 23:39:44.822181 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.822104    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da097f257388b720c32ae419c3f65415541bab630d22367b5a5d42dcea72771f"
Jul 02 23:39:44.823929 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.823915    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:39:44.915768 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.915733    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-home\") pod \"cfff9763-6569-43f4-9daf-e2e627d1c61b\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") "
Jul 02 23:39:44.915952 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.915806    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfff9763-6569-43f4-9daf-e2e627d1c61b-tls-certs\") pod \"cfff9763-6569-43f4-9daf-e2e627d1c61b\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") "
Jul 02 23:39:44.915952 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.915844    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-tmp-dir\") pod \"cfff9763-6569-43f4-9daf-e2e627d1c61b\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") "
Jul 02 23:39:44.915952 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.915877    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-dshm\") pod \"cfff9763-6569-43f4-9daf-e2e627d1c61b\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") "
Jul 02 23:39:44.915952 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.915893    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-model-cache\") pod \"cfff9763-6569-43f4-9daf-e2e627d1c61b\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") "
Jul 02 23:39:44.915952 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.915927    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj85b\" (UniqueName: \"kubernetes.io/projected/cfff9763-6569-43f4-9daf-e2e627d1c61b-kube-api-access-nj85b\") pod \"cfff9763-6569-43f4-9daf-e2e627d1c61b\" (UID: \"cfff9763-6569-43f4-9daf-e2e627d1c61b\") "
Jul 02 23:39:44.916229 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.916036    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-home" (OuterVolumeSpecName: "home") pod "cfff9763-6569-43f4-9daf-e2e627d1c61b" (UID: "cfff9763-6569-43f4-9daf-e2e627d1c61b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:39:44.916229 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.916131    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cfff9763-6569-43f4-9daf-e2e627d1c61b" (UID: "cfff9763-6569-43f4-9daf-e2e627d1c61b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:39:44.916229 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.916146    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-model-cache" (OuterVolumeSpecName: "model-cache") pod "cfff9763-6569-43f4-9daf-e2e627d1c61b" (UID: "cfff9763-6569-43f4-9daf-e2e627d1c61b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:39:44.916229 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.916229    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-model-cache\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:39:44.916375 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.916242    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-home\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:39:44.916375 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.916251    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-tmp-dir\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:39:44.918103 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.918078    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-dshm" (OuterVolumeSpecName: "dshm") pod "cfff9763-6569-43f4-9daf-e2e627d1c61b" (UID: "cfff9763-6569-43f4-9daf-e2e627d1c61b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:39:44.918205 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.918160    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfff9763-6569-43f4-9daf-e2e627d1c61b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cfff9763-6569-43f4-9daf-e2e627d1c61b" (UID: "cfff9763-6569-43f4-9daf-e2e627d1c61b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:39:44.918205 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:44.918196    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfff9763-6569-43f4-9daf-e2e627d1c61b-kube-api-access-nj85b" (OuterVolumeSpecName: "kube-api-access-nj85b") pod "cfff9763-6569-43f4-9daf-e2e627d1c61b" (UID: "cfff9763-6569-43f4-9daf-e2e627d1c61b"). InnerVolumeSpecName "kube-api-access-nj85b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:39:45.016926 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:45.016890    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfff9763-6569-43f4-9daf-e2e627d1c61b-tls-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:39:45.016926 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:45.016922    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfff9763-6569-43f4-9daf-e2e627d1c61b-dshm\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:39:45.016926 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:45.016931    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj85b\" (UniqueName: \"kubernetes.io/projected/cfff9763-6569-43f4-9daf-e2e627d1c61b-kube-api-access-nj85b\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:39:45.826534 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:45.826502    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"
Jul 02 23:39:45.847141 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:45.847114    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"]
Jul 02 23:39:45.851657 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:45.851632    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ea34dc2c/e2e-lifecycle-model-ea34dc2c-kserve-868bb5967-w7ljs"]
Jul 02 23:39:46.079087 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:39:46.079008    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfff9763-6569-43f4-9daf-e2e627d1c61b" path="/var/lib/kubelet/pods/cfff9763-6569-43f4-9daf-e2e627d1c61b/volumes"
Jul 02 23:40:12.545208 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:12.545173    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"]
Jul 02 23:40:12.545748 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:12.545387    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy" containerID="cri-o://00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b" gracePeriod=30
Jul 02 23:40:17.810931 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.810859    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:40:17.910236 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910199    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-certs\") pod \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") "
Jul 02 23:40:17.910433 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910257    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59gfx\" (UniqueName: \"kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-kube-api-access-59gfx\") pod \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") "
Jul 02 23:40:17.910433 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910287    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istiod-ca-cert\") pod \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") "
Jul 02 23:40:17.910433 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910309    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-credential-socket\") pod \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") "
Jul 02 23:40:17.910433 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910331    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-token\") pod \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") "
Jul 02 23:40:17.910433 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910357    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-socket\") pod \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") "
Jul 02 23:40:17.910433 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910387    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-data\") pod \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") "
Jul 02 23:40:17.910433 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910431    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-envoy\") pod \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") "
Jul 02 23:40:17.910837 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910480    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-podinfo\") pod \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\" (UID: \"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5\") "
Jul 02 23:40:17.910837 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910494    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" (UID: "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:40:17.910837 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910638    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" (UID: "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:40:17.910837 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910751    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" (UID: "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:40:17.911072 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910856    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" (UID: "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:40:17.911072 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910946    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:40:17.911072 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910967    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:40:17.911072 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.910982    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:40:17.911375 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.911342    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" (UID: "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:40:17.912715 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.912666    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" (UID: "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:40:17.912715 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.912703    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-kube-api-access-59gfx" (OuterVolumeSpecName: "kube-api-access-59gfx") pod "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" (UID: "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5"). InnerVolumeSpecName "kube-api-access-59gfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:40:17.912957 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.912933    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" (UID: "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:40:17.913027 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.913005    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" (UID: "ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:40:17.978073 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.978032    2568 generic.go:356] "Generic (PLEG): container finished" podID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerID="00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b" exitCode=0
Jul 02 23:40:17.978234 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.978078    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"
Jul 02 23:40:17.978234 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.978071    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" event={"ID":"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5","Type":"ContainerDied","Data":"00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b"}
Jul 02 23:40:17.978234 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.978199    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78" event={"ID":"ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5","Type":"ContainerDied","Data":"095426b4d48181a1d399558884b5d85ee0ed91586e6aa57a40130c57ae23d8e8"}
Jul 02 23:40:17.978234 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.978228    2568 scope.go:117] "RemoveContainer" containerID="00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b"
Jul 02 23:40:17.987752 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.987735    2568 scope.go:117] "RemoveContainer" containerID="c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c"
Jul 02 23:40:17.995877 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.995859    2568 scope.go:117] "RemoveContainer" containerID="00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b"
Jul 02 23:40:17.996139 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:40:17.996120    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b\": container with ID starting with 00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b not found: ID does not exist" containerID="00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b"
Jul 02 23:40:17.996198 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.996147    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b"} err="failed to get container status \"00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b\": rpc error: code = NotFound desc = could not find container \"00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b\": container with ID starting with 00cf02e90849f02986dc5fea1ac22efa8c1317626a7b9fe07503a8ecf7366b3b not found: ID does not exist"
Jul 02 23:40:17.996198 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.996165    2568 scope.go:117] "RemoveContainer" containerID="c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c"
Jul 02 23:40:17.996409 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:40:17.996395    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c\": container with ID starting with c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c not found: ID does not exist" containerID="c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c"
Jul 02 23:40:17.996457 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.996411    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c"} err="failed to get container status \"c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c\": rpc error: code = NotFound desc = could not find container \"c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c\": container with ID starting with c2e6c7abe16d6c0e22eb8c362a5dcba109498185b6005e7ffb2512cd3aa6150c not found: ID does not exist"
Jul 02 23:40:17.999704 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:17.999658    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"]
Jul 02 23:40:18.003456 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:18.003422    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ea34dc2c-openshift-default-76c77cd95-dxz78"]
Jul 02 23:40:18.011984 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:18.011964    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59gfx\" (UniqueName: \"kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-kube-api-access-59gfx\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:40:18.011984 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:18.011986    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:40:18.012109 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:18.011996    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:40:18.012109 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:18.012005    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:40:18.012109 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:18.012013    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:40:18.012109 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:18.012021    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:40:18.078888 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:40:18.078800    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" path="/var/lib/kubelet/pods/ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5/volumes"
Jul 02 23:41:06.638724 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.638692    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"]
Jul 02 23:41:06.639176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.639044    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy"
Jul 02 23:41:06.639176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.639055    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy"
Jul 02 23:41:06.639176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.639072    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfff9763-6569-43f4-9daf-e2e627d1c61b" containerName="main"
Jul 02 23:41:06.639176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.639077    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfff9763-6569-43f4-9daf-e2e627d1c61b" containerName="main"
Jul 02 23:41:06.639176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.639089    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy"
Jul 02 23:41:06.639176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.639094    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy"
Jul 02 23:41:06.639176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.639141    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy"
Jul 02 23:41:06.639176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.639149    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab5c156e-2a6f-485c-9a52-82fb1c9cb2c5" containerName="istio-proxy"
Jul 02 23:41:06.639176 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.639156    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfff9763-6569-43f4-9daf-e2e627d1c61b" containerName="main"
Jul 02 23:41:06.642262 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.642241    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.644567 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.644536    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a4ec8d-openshift-default-dockercfg-jtcd9\""
Jul 02 23:41:06.657637 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.657609    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"]
Jul 02 23:41:06.745854 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.745816    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-envoy\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.746039 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.745879    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-data\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.746039 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.745915    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe764821-e1dd-437d-9425-67d0c005c8ac-istiod-ca-cert\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.746039 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.745948    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-socket\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.746039 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.745984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-token\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.746039 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.746020    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-certs\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.746241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.746043    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5t8q\" (UniqueName: \"kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-kube-api-access-n5t8q\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.746241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.746115    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-credential-socket\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.746241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.746150    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-podinfo\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.847406 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-data\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.847406 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe764821-e1dd-437d-9425-67d0c005c8ac-istiod-ca-cert\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.847646 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-socket\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.847646 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-token\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.847646 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-certs\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.847646 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5t8q\" (UniqueName: \"kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-kube-api-access-n5t8q\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.847646 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-credential-socket\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.847646 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-podinfo\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.847981 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-envoy\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.847981 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847899    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-data\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.848157 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.847984    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-certs\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.848157 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.848031    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-socket\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.848269 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.848228    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-credential-socket\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.848356 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.848338    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe764821-e1dd-437d-9425-67d0c005c8ac-istiod-ca-cert\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.850063 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.850027    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-envoy\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.850451 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.850421    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-podinfo\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.856833 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.856807    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-token\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.856982 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.856959    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5t8q\" (UniqueName: \"kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-kube-api-access-n5t8q\") pod \"e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") " pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:06.952929 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:06.952839    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:07.091252 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:07.091225    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"]
Jul 02 23:41:07.092904 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:41:07.092861    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe764821_e1dd_437d_9425_67d0c005c8ac.slice/crio-09a2578f5406a54483ade053bf399174ae72e625fa688907e69a0d006f716b26 WatchSource:0}: Error finding container 09a2578f5406a54483ade053bf399174ae72e625fa688907e69a0d006f716b26: Status 404 returned error can't find the container with id 09a2578f5406a54483ade053bf399174ae72e625fa688907e69a0d006f716b26
Jul 02 23:41:07.095050 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:07.095009    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:07.095126 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:07.095081    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:07.095126 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:07.095119    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:07.211024 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:07.210917    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" event={"ID":"fe764821-e1dd-437d-9425-67d0c005c8ac","Type":"ContainerStarted","Data":"945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f"}
Jul 02 23:41:07.211024 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:07.211000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" event={"ID":"fe764821-e1dd-437d-9425-67d0c005c8ac","Type":"ContainerStarted","Data":"09a2578f5406a54483ade053bf399174ae72e625fa688907e69a0d006f716b26"}
Jul 02 23:41:07.230300 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:07.230236    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" podStartSLOduration=1.230212036 podStartE2EDuration="1.230212036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:41:07.228144594 +0000 UTC m=+1833.684400796" watchObservedRunningTime="2026-07-02 23:41:07.230212036 +0000 UTC m=+1833.686468241"
Jul 02 23:41:07.953333 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:07.953293    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:08.958963 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:08.958931    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:09.221352 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:09.221265    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:09.222170 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:09.222150    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:14.365636 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.365601    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"]
Jul 02 23:41:14.369228 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.369207    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.371221 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.371199    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e96520-openshift-default-dockercfg-285qc\""
Jul 02 23:41:14.379351 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.379326    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"]
Jul 02 23:41:14.415337 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.415305    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-envoy\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.415493 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.415360    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8fvj\" (UniqueName: \"kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-kube-api-access-c8fvj\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.415493 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.415428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-data\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.415493 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.415469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-istio-token\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.415493 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.415489    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7d7fb79-e339-44df-af20-734c56997a2d-istiod-ca-cert\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.415717 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.415512    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7d7fb79-e339-44df-af20-734c56997a2d-istio-podinfo\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.415717 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.415617    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-certs\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.415717 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.415663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-socket\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.415854 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.415718    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-credential-socket\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516148 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516110    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-data\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516148 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516154    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-istio-token\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516395 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516177    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7d7fb79-e339-44df-af20-734c56997a2d-istiod-ca-cert\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516395 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516199    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7d7fb79-e339-44df-af20-734c56997a2d-istio-podinfo\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516395 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516235    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-certs\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516395 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-socket\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516395 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-credential-socket\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516395 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516316    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-envoy\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516395 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516370    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8fvj\" (UniqueName: \"kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-kube-api-access-c8fvj\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516788 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516599    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-data\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.516788 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516763    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-credential-socket\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.517008 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.516986    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-socket\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.517095 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.517029    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7d7fb79-e339-44df-af20-734c56997a2d-istiod-ca-cert\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.517095 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.517036    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-certs\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.519159 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.519134    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-envoy\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.519361 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.519344    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7d7fb79-e339-44df-af20-734c56997a2d-istio-podinfo\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.524063 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.524037    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-istio-token\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.524266 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.524248    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8fvj\" (UniqueName: \"kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-kube-api-access-c8fvj\") pod \"e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") " pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.681846 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.681754    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:14.818886 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.818861    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"]
Jul 02 23:41:14.820807 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:41:14.820777    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d7fb79_e339_44df_af20_734c56997a2d.slice/crio-1c24c482d4c09e01a6730af4095d1210ef92d6d02fe6ec2cf0dcca54a31794b9 WatchSource:0}: Error finding container 1c24c482d4c09e01a6730af4095d1210ef92d6d02fe6ec2cf0dcca54a31794b9: Status 404 returned error can't find the container with id 1c24c482d4c09e01a6730af4095d1210ef92d6d02fe6ec2cf0dcca54a31794b9
Jul 02 23:41:14.822847 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.822815    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:14.822922 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.822885    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:14.822959 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:14.822918    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:15.249697 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:15.249650    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" event={"ID":"f7d7fb79-e339-44df-af20-734c56997a2d","Type":"ContainerStarted","Data":"38f1adb1ea437435d683d35febdc1ae21aa29090e87e9898dda755867e77ea95"}
Jul 02 23:41:15.249909 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:15.249719    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" event={"ID":"f7d7fb79-e339-44df-af20-734c56997a2d","Type":"ContainerStarted","Data":"1c24c482d4c09e01a6730af4095d1210ef92d6d02fe6ec2cf0dcca54a31794b9"}
Jul 02 23:41:15.269462 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:15.269404    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" podStartSLOduration=1.26938632 podStartE2EDuration="1.26938632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:41:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:41:15.268478035 +0000 UTC m=+1841.724734235" watchObservedRunningTime="2026-07-02 23:41:15.26938632 +0000 UTC m=+1841.725642520"
Jul 02 23:41:15.682306 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:15.682267    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:15.687733 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:15.687705    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:16.254765 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:16.254727    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:16.255894 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:16.255868    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:24.223503 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:24.223466    2568 patch_prober.go:28] interesting pod/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 02 23:41:24.224184 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:24.224149    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 02 23:41:24.292158 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:24.292126    2568 generic.go:356] "Generic (PLEG): container finished" podID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerID="945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f" exitCode=0
Jul 02 23:41:24.292327 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:24.292204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" event={"ID":"fe764821-e1dd-437d-9425-67d0c005c8ac","Type":"ContainerDied","Data":"945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f"}
Jul 02 23:41:24.292615 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:24.292601    2568 scope.go:117] "RemoveContainer" containerID="945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f"
Jul 02 23:41:24.293649 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:24.293618    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:24.293761 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:24.293741    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:24.293809 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:24.293794    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:25.298934 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:25.298902    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" event={"ID":"fe764821-e1dd-437d-9425-67d0c005c8ac","Type":"ContainerStarted","Data":"164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc"}
Jul 02 23:41:25.953949 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:25.953911    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:25.954283 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:25.954133    2568 patch_prober.go:28] interesting pod/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 02 23:41:25.954468 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:25.954439    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 02 23:41:26.953775 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:26.953740    2568 patch_prober.go:28] interesting pod/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 02 23:41:26.954230 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:26.953805    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 02 23:41:27.953829 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:27.953787    2568 patch_prober.go:28] interesting pod/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 02 23:41:27.954315 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:27.953851    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 02 23:41:28.954171 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:28.954122    2568 patch_prober.go:28] interesting pod/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 02 23:41:28.954712 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:28.954180    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 02 23:41:29.958101 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:29.958065    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:29.958506 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:29.958419    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:29.959220 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:29.959199    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:41:30.329869 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:30.329784    2568 generic.go:356] "Generic (PLEG): container finished" podID="f7d7fb79-e339-44df-af20-734c56997a2d" containerID="38f1adb1ea437435d683d35febdc1ae21aa29090e87e9898dda755867e77ea95" exitCode=0
Jul 02 23:41:30.329869 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:30.329854    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" event={"ID":"f7d7fb79-e339-44df-af20-734c56997a2d","Type":"ContainerDied","Data":"38f1adb1ea437435d683d35febdc1ae21aa29090e87e9898dda755867e77ea95"}
Jul 02 23:41:30.330304 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:30.330288    2568 scope.go:117] "RemoveContainer" containerID="38f1adb1ea437435d683d35febdc1ae21aa29090e87e9898dda755867e77ea95"
Jul 02 23:41:30.331306 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:30.331281    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:30.331376 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:30.331360    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:30.331422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:30.331407    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:41:31.255578 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:31.255538    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:31.337721 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:31.337680    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" event={"ID":"f7d7fb79-e339-44df-af20-734c56997a2d","Type":"ContainerStarted","Data":"84573bae3c1030e29c1157735197e48a50307ff1a826f783c56a24f6a874005d"}
Jul 02 23:41:31.682832 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:31.682791    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:31.684103 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:31.684076    2568 patch_prober.go:28] interesting pod/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 02 23:41:31.684232 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:31.684122    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 02 23:41:32.682427 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:32.682392    2568 patch_prober.go:28] interesting pod/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 02 23:41:32.682868 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:32.682447    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 02 23:41:33.682630 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:33.682588    2568 patch_prober.go:28] interesting pod/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 02 23:41:33.683063 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:33.682653    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 02 23:41:34.682528 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:34.682488    2568 patch_prober.go:28] interesting pod/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 02 23:41:34.682741 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:34.682549    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 02 23:41:35.686924 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:35.686885    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:35.687382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:35.687164    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:35.687947 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:35.687930    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:41:59.572206 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.572117    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"]
Jul 02 23:41:59.575041 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.575022    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.577341 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.577317    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e96520\"/\"openshift-service-ca.crt\""
Jul 02 23:41:59.577866 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.577847    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e96520\"/\"test-model-e96520-kserve-self-signed-certs\""
Jul 02 23:41:59.577961 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.577897    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e96520\"/\"kube-root-ca.crt\""
Jul 02 23:41:59.577961 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.577944    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e96520\"/\"default-dockercfg-6kv59\""
Jul 02 23:41:59.584996 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.584972    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"]
Jul 02 23:41:59.648502 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.648469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-dshm\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.648686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.648510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8dkg\" (UniqueName: \"kubernetes.io/projected/14f793a9-684b-4914-b6be-93825a7a58df-kube-api-access-z8dkg\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.648686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.648540    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-model-cache\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.648686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.648599    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-home\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.648820 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.648709    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14f793a9-684b-4914-b6be-93825a7a58df-tls-certs\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.648820 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.648757    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-tmp-dir\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.750183 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.750145    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-home\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.750361 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.750207    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14f793a9-684b-4914-b6be-93825a7a58df-tls-certs\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.750361 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.750236    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-tmp-dir\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.750361 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.750256    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-dshm\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.750361 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.750275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8dkg\" (UniqueName: \"kubernetes.io/projected/14f793a9-684b-4914-b6be-93825a7a58df-kube-api-access-z8dkg\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.750361 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.750305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-model-cache\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.750619 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.750550    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-home\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.750717 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.750633    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-tmp-dir\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.750770 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.750732    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-model-cache\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.752630 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.752608    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-dshm\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.752771 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.752755    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14f793a9-684b-4914-b6be-93825a7a58df-tls-certs\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.757534 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.757508    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8dkg\" (UniqueName: \"kubernetes.io/projected/14f793a9-684b-4914-b6be-93825a7a58df-kube-api-access-z8dkg\") pod \"test-model-e96520-kserve-564f54df55-fxrt6\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") " pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:41:59.885220 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:41:59.885121    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:42:00.019936 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:00.019909    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"]
Jul 02 23:42:00.021651 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:42:00.021621    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14f793a9_684b_4914_b6be_93825a7a58df.slice/crio-ede293525eab4ef08856cdf19a4bf34af943b59ca201a2d074452a6570a56aea WatchSource:0}: Error finding container ede293525eab4ef08856cdf19a4bf34af943b59ca201a2d074452a6570a56aea: Status 404 returned error can't find the container with id ede293525eab4ef08856cdf19a4bf34af943b59ca201a2d074452a6570a56aea
Jul 02 23:42:00.473241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:00.473206    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6" event={"ID":"14f793a9-684b-4914-b6be-93825a7a58df","Type":"ContainerStarted","Data":"27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854"}
Jul 02 23:42:00.473241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:00.473246    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6" event={"ID":"14f793a9-684b-4914-b6be-93825a7a58df","Type":"ContainerStarted","Data":"ede293525eab4ef08856cdf19a4bf34af943b59ca201a2d074452a6570a56aea"}
Jul 02 23:42:00.489042 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:00.488991    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6" podStartSLOduration=1.488974361 podStartE2EDuration="1.488974361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:42:00.487641785 +0000 UTC m=+1886.943898005" watchObservedRunningTime="2026-07-02 23:42:00.488974361 +0000 UTC m=+1886.945230562"
Jul 02 23:42:09.886237 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:09.886192    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:42:09.886775 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:09.886261    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:42:09.898817 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:09.898785    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:42:10.533771 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:10.533742    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:42:26.211158 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:26.211125    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"]
Jul 02 23:42:41.233518 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.233454    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6" podUID="14f793a9-684b-4914-b6be-93825a7a58df" containerName="main" containerID="cri-o://27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854" gracePeriod=45
Jul 02 23:42:41.488395 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.488332    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:42:41.543488 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.543457    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-dshm\") pod \"14f793a9-684b-4914-b6be-93825a7a58df\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") "
Jul 02 23:42:41.543488 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.543491    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-home\") pod \"14f793a9-684b-4914-b6be-93825a7a58df\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") "
Jul 02 23:42:41.543719 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.543565    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-model-cache\") pod \"14f793a9-684b-4914-b6be-93825a7a58df\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") "
Jul 02 23:42:41.543719 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.543589    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14f793a9-684b-4914-b6be-93825a7a58df-tls-certs\") pod \"14f793a9-684b-4914-b6be-93825a7a58df\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") "
Jul 02 23:42:41.543719 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.543647    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8dkg\" (UniqueName: \"kubernetes.io/projected/14f793a9-684b-4914-b6be-93825a7a58df-kube-api-access-z8dkg\") pod \"14f793a9-684b-4914-b6be-93825a7a58df\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") "
Jul 02 23:42:41.543719 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.543709    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-tmp-dir\") pod \"14f793a9-684b-4914-b6be-93825a7a58df\" (UID: \"14f793a9-684b-4914-b6be-93825a7a58df\") "
Jul 02 23:42:41.543898 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.543853    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-model-cache" (OuterVolumeSpecName: "model-cache") pod "14f793a9-684b-4914-b6be-93825a7a58df" (UID: "14f793a9-684b-4914-b6be-93825a7a58df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:42:41.543898 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.543865    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-home" (OuterVolumeSpecName: "home") pod "14f793a9-684b-4914-b6be-93825a7a58df" (UID: "14f793a9-684b-4914-b6be-93825a7a58df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:42:41.544016 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.543997    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-model-cache\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:42:41.544076 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.544029    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-home\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:42:41.544130 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.544070    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "14f793a9-684b-4914-b6be-93825a7a58df" (UID: "14f793a9-684b-4914-b6be-93825a7a58df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:42:41.545886 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.545860    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14f793a9-684b-4914-b6be-93825a7a58df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "14f793a9-684b-4914-b6be-93825a7a58df" (UID: "14f793a9-684b-4914-b6be-93825a7a58df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:42:41.545886 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.545877    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-dshm" (OuterVolumeSpecName: "dshm") pod "14f793a9-684b-4914-b6be-93825a7a58df" (UID: "14f793a9-684b-4914-b6be-93825a7a58df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:42:41.546028 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.545923    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f793a9-684b-4914-b6be-93825a7a58df-kube-api-access-z8dkg" (OuterVolumeSpecName: "kube-api-access-z8dkg") pod "14f793a9-684b-4914-b6be-93825a7a58df" (UID: "14f793a9-684b-4914-b6be-93825a7a58df"). InnerVolumeSpecName "kube-api-access-z8dkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:42:41.645341 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.645306    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8dkg\" (UniqueName: \"kubernetes.io/projected/14f793a9-684b-4914-b6be-93825a7a58df-kube-api-access-z8dkg\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:42:41.645341 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.645336    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-tmp-dir\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:42:41.645341 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.645346    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14f793a9-684b-4914-b6be-93825a7a58df-dshm\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:42:41.645591 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.645354    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14f793a9-684b-4914-b6be-93825a7a58df-tls-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:42:41.670569 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.670536    2568 generic.go:356] "Generic (PLEG): container finished" podID="14f793a9-684b-4914-b6be-93825a7a58df" containerID="27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854" exitCode=0
Jul 02 23:42:41.670756 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.670579    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"
Jul 02 23:42:41.670756 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.670601    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6" event={"ID":"14f793a9-684b-4914-b6be-93825a7a58df","Type":"ContainerDied","Data":"27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854"}
Jul 02 23:42:41.670756 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.670635    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6" event={"ID":"14f793a9-684b-4914-b6be-93825a7a58df","Type":"ContainerDied","Data":"ede293525eab4ef08856cdf19a4bf34af943b59ca201a2d074452a6570a56aea"}
Jul 02 23:42:41.670756 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.670651    2568 scope.go:117] "RemoveContainer" containerID="27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854"
Jul 02 23:42:41.680046 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.680031    2568 scope.go:117] "RemoveContainer" containerID="27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854"
Jul 02 23:42:41.680306 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:42:41.680286    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854\": container with ID starting with 27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854 not found: ID does not exist" containerID="27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854"
Jul 02 23:42:41.680359 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.680320    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854"} err="failed to get container status \"27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854\": rpc error: code = NotFound desc = could not find container \"27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854\": container with ID starting with 27e23ede7ee07bf2368ac6c26b3ba24833da447bee6647b6b8e69a8941f72854 not found: ID does not exist"
Jul 02 23:42:41.691144 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.691124    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"]
Jul 02 23:42:41.695427 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:41.695409    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e96520/test-model-e96520-kserve-564f54df55-fxrt6"]
Jul 02 23:42:42.080025 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:42:42.079991    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14f793a9-684b-4914-b6be-93825a7a58df" path="/var/lib/kubelet/pods/14f793a9-684b-4914-b6be-93825a7a58df/volumes"
Jul 02 23:43:08.870167 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:08.870126    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"]
Jul 02 23:43:08.870650 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:08.870363    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy" containerID="cri-o://164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc" gracePeriod=30
Jul 02 23:43:14.130103 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.130076    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:43:14.225400 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225310    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5t8q\" (UniqueName: \"kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-kube-api-access-n5t8q\") pod \"fe764821-e1dd-437d-9425-67d0c005c8ac\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") "
Jul 02 23:43:14.225400 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225346    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-socket\") pod \"fe764821-e1dd-437d-9425-67d0c005c8ac\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") "
Jul 02 23:43:14.225400 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225389    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-certs\") pod \"fe764821-e1dd-437d-9425-67d0c005c8ac\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") "
Jul 02 23:43:14.225713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225418    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-data\") pod \"fe764821-e1dd-437d-9425-67d0c005c8ac\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") "
Jul 02 23:43:14.225713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225441    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-podinfo\") pod \"fe764821-e1dd-437d-9425-67d0c005c8ac\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") "
Jul 02 23:43:14.225713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225473    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-envoy\") pod \"fe764821-e1dd-437d-9425-67d0c005c8ac\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") "
Jul 02 23:43:14.225713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225503    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe764821-e1dd-437d-9425-67d0c005c8ac-istiod-ca-cert\") pod \"fe764821-e1dd-437d-9425-67d0c005c8ac\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") "
Jul 02 23:43:14.225713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225525    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-token\") pod \"fe764821-e1dd-437d-9425-67d0c005c8ac\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") "
Jul 02 23:43:14.225713 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225560    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-credential-socket\") pod \"fe764821-e1dd-437d-9425-67d0c005c8ac\" (UID: \"fe764821-e1dd-437d-9425-67d0c005c8ac\") "
Jul 02 23:43:14.226040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225740    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe764821-e1dd-437d-9425-67d0c005c8ac" (UID: "fe764821-e1dd-437d-9425-67d0c005c8ac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:14.226040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.225786    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe764821-e1dd-437d-9425-67d0c005c8ac" (UID: "fe764821-e1dd-437d-9425-67d0c005c8ac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:14.226154 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.226013    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe764821-e1dd-437d-9425-67d0c005c8ac" (UID: "fe764821-e1dd-437d-9425-67d0c005c8ac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:14.226154 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.226119    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe764821-e1dd-437d-9425-67d0c005c8ac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe764821-e1dd-437d-9425-67d0c005c8ac" (UID: "fe764821-e1dd-437d-9425-67d0c005c8ac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:43:14.226642 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.226621    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:14.226748 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.226646    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:14.226748 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.226643    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe764821-e1dd-437d-9425-67d0c005c8ac" (UID: "fe764821-e1dd-437d-9425-67d0c005c8ac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:14.226748 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.226662    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe764821-e1dd-437d-9425-67d0c005c8ac-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:14.226748 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.226697    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:14.227797 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.227767    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe764821-e1dd-437d-9425-67d0c005c8ac" (UID: "fe764821-e1dd-437d-9425-67d0c005c8ac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:14.227879 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.227843    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-kube-api-access-n5t8q" (OuterVolumeSpecName: "kube-api-access-n5t8q") pod "fe764821-e1dd-437d-9425-67d0c005c8ac" (UID: "fe764821-e1dd-437d-9425-67d0c005c8ac"). InnerVolumeSpecName "kube-api-access-n5t8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:43:14.228054 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.228039    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe764821-e1dd-437d-9425-67d0c005c8ac" (UID: "fe764821-e1dd-437d-9425-67d0c005c8ac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:43:14.228095 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.228052    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe764821-e1dd-437d-9425-67d0c005c8ac" (UID: "fe764821-e1dd-437d-9425-67d0c005c8ac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:43:14.327834 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.327800    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5t8q\" (UniqueName: \"kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-kube-api-access-n5t8q\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:14.327834 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.327829    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:14.327834 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.327842    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:14.328063 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.327853    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:14.328063 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.327863    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe764821-e1dd-437d-9425-67d0c005c8ac-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:14.823641 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.823601    2568 generic.go:356] "Generic (PLEG): container finished" podID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerID="164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc" exitCode=0
Jul 02 23:43:14.823832 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.823667    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"
Jul 02 23:43:14.823832 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.823705    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" event={"ID":"fe764821-e1dd-437d-9425-67d0c005c8ac","Type":"ContainerDied","Data":"164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc"}
Jul 02 23:43:14.823832 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.823784    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57" event={"ID":"fe764821-e1dd-437d-9425-67d0c005c8ac","Type":"ContainerDied","Data":"09a2578f5406a54483ade053bf399174ae72e625fa688907e69a0d006f716b26"}
Jul 02 23:43:14.823832 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.823806    2568 scope.go:117] "RemoveContainer" containerID="164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc"
Jul 02 23:43:14.833797 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.833775    2568 scope.go:117] "RemoveContainer" containerID="945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f"
Jul 02 23:43:14.841076 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.841055    2568 scope.go:117] "RemoveContainer" containerID="164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc"
Jul 02 23:43:14.841335 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:43:14.841317    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc\": container with ID starting with 164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc not found: ID does not exist" containerID="164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc"
Jul 02 23:43:14.841388 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.841344    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc"} err="failed to get container status \"164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc\": rpc error: code = NotFound desc = could not find container \"164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc\": container with ID starting with 164651476fea939219487420a48fc766cd0c10fa64e1ecdc45150a6e5347cbbc not found: ID does not exist"
Jul 02 23:43:14.841388 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.841361    2568 scope.go:117] "RemoveContainer" containerID="945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f"
Jul 02 23:43:14.841604 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:43:14.841587    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f\": container with ID starting with 945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f not found: ID does not exist" containerID="945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f"
Jul 02 23:43:14.841646 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.841610    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f"} err="failed to get container status \"945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f\": rpc error: code = NotFound desc = could not find container \"945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f\": container with ID starting with 945e6178872a288f9c2471479b572ff8df150a3238d7295e08fa9ba15d51e46f not found: ID does not exist"
Jul 02 23:43:14.845823 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.845802    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"]
Jul 02 23:43:14.850217 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:14.850197    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a4ec8d-openshift-default-697fb7859f-c4k57"]
Jul 02 23:43:15.707761 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:15.707727    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"]
Jul 02 23:43:15.708218 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:15.707982    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy" containerID="cri-o://84573bae3c1030e29c1157735197e48a50307ff1a826f783c56a24f6a874005d" gracePeriod=30
Jul 02 23:43:16.078737 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.078708    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" path="/var/lib/kubelet/pods/fe764821-e1dd-437d-9425-67d0c005c8ac/volumes"
Jul 02 23:43:16.554781 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.554749    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"]
Jul 02 23:43:16.555122 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.555109    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy"
Jul 02 23:43:16.555188 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.555124    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy"
Jul 02 23:43:16.555188 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.555138    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy"
Jul 02 23:43:16.555188 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.555148    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy"
Jul 02 23:43:16.555188 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.555165    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14f793a9-684b-4914-b6be-93825a7a58df" containerName="main"
Jul 02 23:43:16.555188 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.555170    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="14f793a9-684b-4914-b6be-93825a7a58df" containerName="main"
Jul 02 23:43:16.555443 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.555228    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy"
Jul 02 23:43:16.555443 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.555237    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe764821-e1dd-437d-9425-67d0c005c8ac" containerName="istio-proxy"
Jul 02 23:43:16.555443 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.555242    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="14f793a9-684b-4914-b6be-93825a7a58df" containerName="main"
Jul 02 23:43:16.559703 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.559668    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.561792 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.561776    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-5898bd-openshift-default-dockercfg-s6j62\""
Jul 02 23:43:16.568423 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.568402    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"]
Jul 02 23:43:16.648886 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.648843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8l5v\" (UniqueName: \"kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-kube-api-access-g8l5v\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.648886 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.648896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-data\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.649104 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.648952    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-socket\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.649104 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.648970    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-envoy\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.649104 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.649068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istiod-ca-cert\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.649219 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.649108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-token\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.649219 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.649133    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-credential-socket\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.649219 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.649160    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-podinfo\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.649219 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.649175    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-certs\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.750556 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.750506    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istiod-ca-cert\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751051 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.750573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-token\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751051 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.750604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-credential-socket\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751051 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.750635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-podinfo\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751051 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.750659    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-certs\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751051 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.750723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8l5v\" (UniqueName: \"kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-kube-api-access-g8l5v\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751051 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.750762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-data\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751051 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.750829    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-socket\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751051 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.750857    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-envoy\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751423 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.751144    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-credential-socket\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751423 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.751207    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-certs\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751423 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.751222    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-data\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751423 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.751336    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istiod-ca-cert\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.751423 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.751382    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-socket\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.753245 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.753224    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-envoy\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.753357 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.753316    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-podinfo\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.758527 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.758500    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-token\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.758704 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.758684    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8l5v\" (UniqueName: \"kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-kube-api-access-g8l5v\") pod \"e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") " pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:16.870112 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:16.870024    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:17.002349 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:17.002321    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"]
Jul 02 23:43:17.004574 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:43:17.004531    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e874b35_7ff5_4bac_b7f0_0d771a8d7c89.slice/crio-b2fbdd1bf664716ab4486507312b8ca58fb8f8a0dc411302e4eb914432192a73 WatchSource:0}: Error finding container b2fbdd1bf664716ab4486507312b8ca58fb8f8a0dc411302e4eb914432192a73: Status 404 returned error can't find the container with id b2fbdd1bf664716ab4486507312b8ca58fb8f8a0dc411302e4eb914432192a73
Jul 02 23:43:17.006925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:17.006885    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:17.007013 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:17.006965    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:17.007013 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:17.007005    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:17.840912 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:17.840874    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" event={"ID":"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89","Type":"ContainerStarted","Data":"d3bb533b7cb35a1fd4b75dee842504f86ccca94fd622358e8852ebc8c7ac5b4c"}
Jul 02 23:43:17.841276 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:17.840924    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" event={"ID":"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89","Type":"ContainerStarted","Data":"b2fbdd1bf664716ab4486507312b8ca58fb8f8a0dc411302e4eb914432192a73"}
Jul 02 23:43:17.863133 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:17.863087    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" podStartSLOduration=1.863072937 podStartE2EDuration="1.863072937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:43:17.860700401 +0000 UTC m=+1964.316956626" watchObservedRunningTime="2026-07-02 23:43:17.863072937 +0000 UTC m=+1964.319329138"
Jul 02 23:43:17.870282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:17.870259    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:18.875297 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:18.875265    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:19.850891 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:19.850861    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:19.851905 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:19.851885    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:20.689533 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:20.689494    2568 patch_prober.go:28] interesting pod/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 23:43:20.689939 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:20.689559    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:43:20.858144 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:20.858105    2568 generic.go:356] "Generic (PLEG): container finished" podID="f7d7fb79-e339-44df-af20-734c56997a2d" containerID="84573bae3c1030e29c1157735197e48a50307ff1a826f783c56a24f6a874005d" exitCode=0
Jul 02 23:43:20.858341 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:20.858172    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" event={"ID":"f7d7fb79-e339-44df-af20-734c56997a2d","Type":"ContainerDied","Data":"84573bae3c1030e29c1157735197e48a50307ff1a826f783c56a24f6a874005d"}
Jul 02 23:43:20.858341 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:20.858244    2568 scope.go:117] "RemoveContainer" containerID="38f1adb1ea437435d683d35febdc1ae21aa29090e87e9898dda755867e77ea95"
Jul 02 23:43:20.963601 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:20.963578    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:43:21.091462 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091429    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-credential-socket\") pod \"f7d7fb79-e339-44df-af20-734c56997a2d\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") "
Jul 02 23:43:21.091647 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091487    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-data\") pod \"f7d7fb79-e339-44df-af20-734c56997a2d\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") "
Jul 02 23:43:21.091647 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091517    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-certs\") pod \"f7d7fb79-e339-44df-af20-734c56997a2d\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") "
Jul 02 23:43:21.091647 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091578    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7d7fb79-e339-44df-af20-734c56997a2d-istiod-ca-cert\") pod \"f7d7fb79-e339-44df-af20-734c56997a2d\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") "
Jul 02 23:43:21.091647 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091603    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-socket\") pod \"f7d7fb79-e339-44df-af20-734c56997a2d\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") "
Jul 02 23:43:21.091925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091663    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7d7fb79-e339-44df-af20-734c56997a2d-istio-podinfo\") pod \"f7d7fb79-e339-44df-af20-734c56997a2d\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") "
Jul 02 23:43:21.091925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091730    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-envoy\") pod \"f7d7fb79-e339-44df-af20-734c56997a2d\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") "
Jul 02 23:43:21.091925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091763    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8fvj\" (UniqueName: \"kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-kube-api-access-c8fvj\") pod \"f7d7fb79-e339-44df-af20-734c56997a2d\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") "
Jul 02 23:43:21.091925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091793    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-istio-token\") pod \"f7d7fb79-e339-44df-af20-734c56997a2d\" (UID: \"f7d7fb79-e339-44df-af20-734c56997a2d\") "
Jul 02 23:43:21.091925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091797    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f7d7fb79-e339-44df-af20-734c56997a2d" (UID: "f7d7fb79-e339-44df-af20-734c56997a2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:21.091925 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.091898    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f7d7fb79-e339-44df-af20-734c56997a2d" (UID: "f7d7fb79-e339-44df-af20-734c56997a2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:21.092219 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.092054    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:21.092219 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.092067    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:21.092518 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.092328    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f7d7fb79-e339-44df-af20-734c56997a2d" (UID: "f7d7fb79-e339-44df-af20-734c56997a2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:21.092518 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.092482    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f7d7fb79-e339-44df-af20-734c56997a2d" (UID: "f7d7fb79-e339-44df-af20-734c56997a2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:21.092695 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.092613    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7d7fb79-e339-44df-af20-734c56997a2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f7d7fb79-e339-44df-af20-734c56997a2d" (UID: "f7d7fb79-e339-44df-af20-734c56997a2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:43:21.095607 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.095473    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-kube-api-access-c8fvj" (OuterVolumeSpecName: "kube-api-access-c8fvj") pod "f7d7fb79-e339-44df-af20-734c56997a2d" (UID: "f7d7fb79-e339-44df-af20-734c56997a2d"). InnerVolumeSpecName "kube-api-access-c8fvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:43:21.096182 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.096155    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f7d7fb79-e339-44df-af20-734c56997a2d" (UID: "f7d7fb79-e339-44df-af20-734c56997a2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:21.096426 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.096201    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7d7fb79-e339-44df-af20-734c56997a2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f7d7fb79-e339-44df-af20-734c56997a2d" (UID: "f7d7fb79-e339-44df-af20-734c56997a2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:43:21.097174 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.097113    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7d7fb79-e339-44df-af20-734c56997a2d" (UID: "f7d7fb79-e339-44df-af20-734c56997a2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:43:21.193061 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.193027    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:21.193061 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.193055    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7d7fb79-e339-44df-af20-734c56997a2d-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:21.193061 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.193064    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:21.193291 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.193072    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7d7fb79-e339-44df-af20-734c56997a2d-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:21.193291 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.193080    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7d7fb79-e339-44df-af20-734c56997a2d-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:21.193291 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.193088    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8fvj\" (UniqueName: \"kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-kube-api-access-c8fvj\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:21.193291 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.193096    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7d7fb79-e339-44df-af20-734c56997a2d-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:21.863794 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.863767    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"
Jul 02 23:43:21.863794 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.863783    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd" event={"ID":"f7d7fb79-e339-44df-af20-734c56997a2d","Type":"ContainerDied","Data":"1c24c482d4c09e01a6730af4095d1210ef92d6d02fe6ec2cf0dcca54a31794b9"}
Jul 02 23:43:21.864382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.863838    2568 scope.go:117] "RemoveContainer" containerID="84573bae3c1030e29c1157735197e48a50307ff1a826f783c56a24f6a874005d"
Jul 02 23:43:21.884985 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.884955    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"]
Jul 02 23:43:21.888335 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:21.888315    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e96520-openshift-default-6cd744c9b9-wjmtd"]
Jul 02 23:43:22.079315 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:22.079282    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" path="/var/lib/kubelet/pods/f7d7fb79-e339-44df-af20-734c56997a2d/volumes"
Jul 02 23:43:25.024486 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.024443    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"]
Jul 02 23:43:25.025035 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.025015    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy"
Jul 02 23:43:25.025118 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.025036    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy"
Jul 02 23:43:25.025118 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.025051    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy"
Jul 02 23:43:25.025118 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.025059    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy"
Jul 02 23:43:25.025319 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.025153    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy"
Jul 02 23:43:25.025319 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.025166    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7d7fb79-e339-44df-af20-734c56997a2d" containerName="istio-proxy"
Jul 02 23:43:25.029960 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.029929    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.032089 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.032062    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-dff6aa-openshift-default-dockercfg-9tg2w\""
Jul 02 23:43:25.041930 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.041905    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"]
Jul 02 23:43:25.125837 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.125800    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-certs\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.126086 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.126055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-podinfo\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.126200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.126107    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-socket\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.126200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.126136    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-envoy\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.126200 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.126189    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbj5j\" (UniqueName: \"kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-kube-api-access-lbj5j\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.126361 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.126271    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-credential-socket\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.126361 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.126347    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-data\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.126473 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.126379    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-token\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.126473 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.126420    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istiod-ca-cert\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.226898 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.226858    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-certs\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227063 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.226904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-podinfo\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227063 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.226943    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-socket\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227063 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.226969    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-envoy\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227063 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.227008    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbj5j\" (UniqueName: \"kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-kube-api-access-lbj5j\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227308 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.227063    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-credential-socket\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227308 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.227097    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-data\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227308 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.227129    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-token\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227308 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.227155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istiod-ca-cert\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227526 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.227318    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-certs\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227526 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.227350    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-socket\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227628 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.227576    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-data\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227868 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.227843    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-credential-socket\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.227971 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.227850    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istiod-ca-cert\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.229260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.229235    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-envoy\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.229476 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.229459    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-podinfo\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.236954 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.236934    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbj5j\" (UniqueName: \"kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-kube-api-access-lbj5j\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.238514 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.238494    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-token\") pod \"e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") " pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.341855 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.341771    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:25.474823 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.474800    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"]
Jul 02 23:43:25.476409 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:43:25.476379    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf4baa8_13fa_4d5f_9d88_c1d66f5519fd.slice/crio-712d6f21d065688a51767d9c49c9a1af555e1daeb4f2ba5bc203ff7523a99665 WatchSource:0}: Error finding container 712d6f21d065688a51767d9c49c9a1af555e1daeb4f2ba5bc203ff7523a99665: Status 404 returned error can't find the container with id 712d6f21d065688a51767d9c49c9a1af555e1daeb4f2ba5bc203ff7523a99665
Jul 02 23:43:25.478414 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.478385    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:25.478487 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.478447    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:25.478487 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.478476    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:25.884704 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.884647    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" event={"ID":"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd","Type":"ContainerStarted","Data":"f41b9bb7645c93620acc20c7178703dd687c4c50d595eb9325b77eeb8599985b"}
Jul 02 23:43:25.884886 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.884724    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" event={"ID":"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd","Type":"ContainerStarted","Data":"712d6f21d065688a51767d9c49c9a1af555e1daeb4f2ba5bc203ff7523a99665"}
Jul 02 23:43:25.930079 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:25.930030    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" podStartSLOduration=0.930013923 podStartE2EDuration="930.013923ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:43:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:43:25.92543673 +0000 UTC m=+1972.381692928" watchObservedRunningTime="2026-07-02 23:43:25.930013923 +0000 UTC m=+1972.386270123"
Jul 02 23:43:26.342868 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:26.342831    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:26.347725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:26.347694    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:26.889632 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:26.889603    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:26.890627 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:26.890607    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:32.922466 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:32.922387    2568 generic.go:356] "Generic (PLEG): container finished" podID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerID="d3bb533b7cb35a1fd4b75dee842504f86ccca94fd622358e8852ebc8c7ac5b4c" exitCode=0
Jul 02 23:43:32.922466 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:32.922433    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" event={"ID":"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89","Type":"ContainerDied","Data":"d3bb533b7cb35a1fd4b75dee842504f86ccca94fd622358e8852ebc8c7ac5b4c"}
Jul 02 23:43:32.923031 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:32.922925    2568 scope.go:117] "RemoveContainer" containerID="d3bb533b7cb35a1fd4b75dee842504f86ccca94fd622358e8852ebc8c7ac5b4c"
Jul 02 23:43:32.923943 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:32.923891    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:32.924052 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:32.923949    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:32.924052 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:32.923983    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:33.932595 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:33.932560    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" event={"ID":"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89","Type":"ContainerStarted","Data":"3fad8148c1bcad0b27d3d2bb7f6e959669cd2c1044efb2ec46de435c6a9cf5b1"}
Jul 02 23:43:34.851655 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:34.851602    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:34.871114 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:34.871086    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:34.871964 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:34.871943    2568 patch_prober.go:28] interesting pod/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 02 23:43:34.872021 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:34.871988    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 02 23:43:35.870821 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:35.870785    2568 patch_prober.go:28] interesting pod/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 02 23:43:35.871218 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:35.870852    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 02 23:43:36.871032 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:36.870996    2568 patch_prober.go:28] interesting pod/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 02 23:43:36.871449 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:36.871064    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 02 23:43:37.873938 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:37.873902    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:37.874946 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:37.874927    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:44.985905 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:44.985873    2568 generic.go:356] "Generic (PLEG): container finished" podID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerID="f41b9bb7645c93620acc20c7178703dd687c4c50d595eb9325b77eeb8599985b" exitCode=0
Jul 02 23:43:44.986303 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:44.985948    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" event={"ID":"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd","Type":"ContainerDied","Data":"f41b9bb7645c93620acc20c7178703dd687c4c50d595eb9325b77eeb8599985b"}
Jul 02 23:43:44.986349 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:44.986328    2568 scope.go:117] "RemoveContainer" containerID="f41b9bb7645c93620acc20c7178703dd687c4c50d595eb9325b77eeb8599985b"
Jul 02 23:43:44.987283 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:44.987256    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:44.987345 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:44.987322    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:44.987382 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:44.987352    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:45.992585 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:45.992547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" event={"ID":"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd","Type":"ContainerStarted","Data":"ee0b92ba1b255c51121eb03b1ed694e87fdb0c65eaaa2a88103a2d3bcfa68612"}
Jul 02 23:43:46.342553 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:46.342512    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:46.342806 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:46.342784    2568 patch_prober.go:28] interesting pod/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 02 23:43:46.342888 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:46.342869    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 02 23:43:46.888223 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:46.888192    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"]
Jul 02 23:43:46.888452 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:46.888429    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerName="istio-proxy" containerID="cri-o://3fad8148c1bcad0b27d3d2bb7f6e959669cd2c1044efb2ec46de435c6a9cf5b1" gracePeriod=30
Jul 02 23:43:47.342921 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:47.342881    2568 patch_prober.go:28] interesting pod/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 02 23:43:47.343324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:47.342946    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 02 23:43:48.342536 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:48.342497    2568 patch_prober.go:28] interesting pod/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 02 23:43:48.342769 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:48.342565    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 02 23:43:49.342865 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:49.342822    2568 patch_prober.go:28] interesting pod/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 02 23:43:49.343349 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:49.342898    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 02 23:43:50.346689 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:50.346643    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:50.347140 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:50.347129    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:50.347922 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:50.347900    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:52.035893 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.035860    2568 generic.go:356] "Generic (PLEG): container finished" podID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerID="3fad8148c1bcad0b27d3d2bb7f6e959669cd2c1044efb2ec46de435c6a9cf5b1" exitCode=0
Jul 02 23:43:52.036503 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.035945    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" event={"ID":"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89","Type":"ContainerDied","Data":"3fad8148c1bcad0b27d3d2bb7f6e959669cd2c1044efb2ec46de435c6a9cf5b1"}
Jul 02 23:43:52.036503 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.036038    2568 scope.go:117] "RemoveContainer" containerID="d3bb533b7cb35a1fd4b75dee842504f86ccca94fd622358e8852ebc8c7ac5b4c"
Jul 02 23:43:52.160289 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.160242    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:52.286168 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286137    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-credential-socket\") pod \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") "
Jul 02 23:43:52.286329 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286177    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-data\") pod \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") "
Jul 02 23:43:52.286329 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286198    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8l5v\" (UniqueName: \"kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-kube-api-access-g8l5v\") pod \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") "
Jul 02 23:43:52.286329 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286234    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-token\") pod \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") "
Jul 02 23:43:52.286329 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286258    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-certs\") pod \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") "
Jul 02 23:43:52.286329 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286290    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-podinfo\") pod \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") "
Jul 02 23:43:52.286583 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286335    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istiod-ca-cert\") pod \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") "
Jul 02 23:43:52.286583 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286380    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-socket\") pod \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") "
Jul 02 23:43:52.286583 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286434    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-envoy\") pod \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\" (UID: \"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89\") "
Jul 02 23:43:52.286583 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286431    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" (UID: "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:52.286826 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286703    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:52.286826 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286694    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" (UID: "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:52.286914 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286860    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" (UID: "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:43:52.286961 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.286934    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" (UID: "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:52.287058 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.287032    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" (UID: "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:52.288462 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.288438    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" (UID: "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:43:52.288555 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.288497    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" (UID: "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:43:52.288882 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.288865    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" (UID: "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:52.288946 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.288871    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-kube-api-access-g8l5v" (OuterVolumeSpecName: "kube-api-access-g8l5v") pod "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" (UID: "0e874b35-7ff5-4bac-b7f0-0d771a8d7c89"). InnerVolumeSpecName "kube-api-access-g8l5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:43:52.387448 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.387415    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:52.387448 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.387444    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8l5v\" (UniqueName: \"kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-kube-api-access-g8l5v\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:52.387448 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.387454    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:52.387686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.387463    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:52.387686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.387471    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:52.387686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.387479    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:52.387686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.387486    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:52.387686 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:52.387494    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:53.042690 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:53.042647    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"
Jul 02 23:43:53.043124 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:53.042709    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx" event={"ID":"0e874b35-7ff5-4bac-b7f0-0d771a8d7c89","Type":"ContainerDied","Data":"b2fbdd1bf664716ab4486507312b8ca58fb8f8a0dc411302e4eb914432192a73"}
Jul 02 23:43:53.043124 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:53.042768    2568 scope.go:117] "RemoveContainer" containerID="3fad8148c1bcad0b27d3d2bb7f6e959669cd2c1044efb2ec46de435c6a9cf5b1"
Jul 02 23:43:53.063698 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:53.063658    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"]
Jul 02 23:43:53.067430 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:53.067407    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-5898bd-openshift-default-794466dcf-lqjmx"]
Jul 02 23:43:53.864293 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:53.864263    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"]
Jul 02 23:43:53.864500 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:53.864458    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy" containerID="cri-o://ee0b92ba1b255c51121eb03b1ed694e87fdb0c65eaaa2a88103a2d3bcfa68612" gracePeriod=30
Jul 02 23:43:54.079237 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.079204    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" path="/var/lib/kubelet/pods/0e874b35-7ff5-4bac-b7f0-0d771a8d7c89/volumes"
Jul 02 23:43:54.742002 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.741971    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"]
Jul 02 23:43:54.742311 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.742299    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerName="istio-proxy"
Jul 02 23:43:54.742357 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.742313    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerName="istio-proxy"
Jul 02 23:43:54.742357 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.742325    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerName="istio-proxy"
Jul 02 23:43:54.742357 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.742331    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerName="istio-proxy"
Jul 02 23:43:54.742447 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.742410    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerName="istio-proxy"
Jul 02 23:43:54.742447 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.742419    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e874b35-7ff5-4bac-b7f0-0d771a8d7c89" containerName="istio-proxy"
Jul 02 23:43:54.745302 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.745278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:54.747242 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.747218    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-aefe3e-openshift-default-dockercfg-zcxf2\""
Jul 02 23:43:54.755714 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.755692    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"]
Jul 02 23:43:54.909313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.909280    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istiod-ca-cert\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:54.909507 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.909327    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-envoy\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:54.909507 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.909387    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-certs\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:54.909507 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.909406    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-socket\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:54.909507 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.909428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t86jt\" (UniqueName: \"kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-kube-api-access-t86jt\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:54.909772 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.909502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-credential-socket\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:54.909772 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.909538    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-token\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:54.909772 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.909581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-data\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:54.909772 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:54.909638    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-podinfo\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.010490 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.010397    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-envoy\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.010490 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.010456    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-certs\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.010800 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.010498    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-socket\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.010800 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.010647    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t86jt\" (UniqueName: \"kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-kube-api-access-t86jt\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.010800 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.010733    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-credential-socket\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.010800 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.010762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-token\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.010980 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.010811    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-data\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.010980 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.010859    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-podinfo\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.010980 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.010911    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-socket\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.010980 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.010925    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istiod-ca-cert\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.011283 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.011261    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-credential-socket\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.011591 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.011571    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-certs\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.011734 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.011711    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-data\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.011810 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.011744    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istiod-ca-cert\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.013293 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.013268    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-envoy\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.013809 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.013787    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-podinfo\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.018503 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.018480    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t86jt\" (UniqueName: \"kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-kube-api-access-t86jt\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.018910 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.018891    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-token\") pod \"e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") " pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.055773 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.055744    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:55.198731 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.198705    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"]
Jul 02 23:43:55.200591 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:43:55.200564    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92629cfb_aba6_4e1a_9e59_a94d4a40e238.slice/crio-da8ee069d401f3bd3a0a0c4b9b5aa408e0cec0c4b0ab83599a8c5958f4565b33 WatchSource:0}: Error finding container da8ee069d401f3bd3a0a0c4b9b5aa408e0cec0c4b0ab83599a8c5958f4565b33: Status 404 returned error can't find the container with id da8ee069d401f3bd3a0a0c4b9b5aa408e0cec0c4b0ab83599a8c5958f4565b33
Jul 02 23:43:55.202871 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.202841    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:55.202973 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.202920    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:55.203039 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:55.202990    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:43:56.059110 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:56.059075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" event={"ID":"92629cfb-aba6-4e1a-9e59-a94d4a40e238","Type":"ContainerStarted","Data":"144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33"}
Jul 02 23:43:56.059283 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:56.059128    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" event={"ID":"92629cfb-aba6-4e1a-9e59-a94d4a40e238","Type":"ContainerStarted","Data":"da8ee069d401f3bd3a0a0c4b9b5aa408e0cec0c4b0ab83599a8c5958f4565b33"}
Jul 02 23:43:56.080374 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:56.080311    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" podStartSLOduration=2.08029295 podStartE2EDuration="2.08029295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:43:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:43:56.077350094 +0000 UTC m=+2002.533606296" watchObservedRunningTime="2026-07-02 23:43:56.08029295 +0000 UTC m=+2002.536549153"
Jul 02 23:43:57.056350 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:57.056316    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:57.061466 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:57.061434    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:57.064204 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:57.064183    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:57.065038 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:57.065007    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:43:59.077090 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.077059    2568 generic.go:356] "Generic (PLEG): container finished" podID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerID="ee0b92ba1b255c51121eb03b1ed694e87fdb0c65eaaa2a88103a2d3bcfa68612" exitCode=0
Jul 02 23:43:59.077527 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.077140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" event={"ID":"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd","Type":"ContainerDied","Data":"ee0b92ba1b255c51121eb03b1ed694e87fdb0c65eaaa2a88103a2d3bcfa68612"}
Jul 02 23:43:59.077527 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.077203    2568 scope.go:117] "RemoveContainer" containerID="f41b9bb7645c93620acc20c7178703dd687c4c50d595eb9325b77eeb8599985b"
Jul 02 23:43:59.137421 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.137359    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:43:59.252856 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.252826    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-credential-socket\") pod \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") "
Jul 02 23:43:59.253023 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.252863    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-data\") pod \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") "
Jul 02 23:43:59.253023 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.252903    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-certs\") pod \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") "
Jul 02 23:43:59.253023 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.252921    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbj5j\" (UniqueName: \"kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-kube-api-access-lbj5j\") pod \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") "
Jul 02 23:43:59.253023 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.252958    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-socket\") pod \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") "
Jul 02 23:43:59.253023 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253000    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-token\") pod \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") "
Jul 02 23:43:59.253282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253043    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istiod-ca-cert\") pod \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") "
Jul 02 23:43:59.253282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253084    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-envoy\") pod \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") "
Jul 02 23:43:59.253282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253112    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" (UID: "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:59.253282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253126    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-podinfo\") pod \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\" (UID: \"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd\") "
Jul 02 23:43:59.253282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253216    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" (UID: "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:59.253551 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253402    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" (UID: "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:43:59.253612 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253573    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" (UID: "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:59.253612 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253581    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:59.253612 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253600    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:59.253794 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253614    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:59.253995 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.253968    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" (UID: "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:59.255321 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.255298    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" (UID: "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:43:59.255420 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.255330    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" (UID: "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:43:59.255898 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.255880    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" (UID: "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:43:59.255969 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.255898    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-kube-api-access-lbj5j" (OuterVolumeSpecName: "kube-api-access-lbj5j") pod "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" (UID: "5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd"). InnerVolumeSpecName "kube-api-access-lbj5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:43:59.354041 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.354007    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbj5j\" (UniqueName: \"kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-kube-api-access-lbj5j\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:59.354041 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.354036    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:59.354041 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.354045    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:59.354257 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.354053    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:59.354257 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.354061    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:43:59.354257 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:43:59.354068    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:44:00.082085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:00.082060    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"
Jul 02 23:44:00.082549 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:00.082057    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs" event={"ID":"5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd","Type":"ContainerDied","Data":"712d6f21d065688a51767d9c49c9a1af555e1daeb4f2ba5bc203ff7523a99665"}
Jul 02 23:44:00.082549 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:00.082193    2568 scope.go:117] "RemoveContainer" containerID="ee0b92ba1b255c51121eb03b1ed694e87fdb0c65eaaa2a88103a2d3bcfa68612"
Jul 02 23:44:00.104085 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:00.104055    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"]
Jul 02 23:44:00.108633 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:00.108610    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-dff6aa-openshift-default-8498b49bd5-s9jjs"]
Jul 02 23:44:02.079264 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:02.079227    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" path="/var/lib/kubelet/pods/5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd/volumes"
Jul 02 23:44:03.158154 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.158123    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"]
Jul 02 23:44:03.158517 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.158447    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy"
Jul 02 23:44:03.158517 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.158458    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy"
Jul 02 23:44:03.158611 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.158527    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy"
Jul 02 23:44:03.158611 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.158536    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy"
Jul 02 23:44:03.161243 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.161226    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.163422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.163402    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b07c26-openshift-default-dockercfg-28pfx\""
Jul 02 23:44:03.179466 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.179442    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"]
Jul 02 23:44:03.286812 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.286748    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-envoy\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.287015 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.286815    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf72g\" (UniqueName: \"kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-kube-api-access-pf72g\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.287015 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.286929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-socket\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.287015 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.286976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-data\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.287178 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.287024    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-token\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.287178 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.287082    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-certs\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.287178 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.287130    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8635b78f-e254-4346-9490-4cba7a5d19d6-istiod-ca-cert\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.287347 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.287216    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-credential-socket\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.287347 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.287257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-podinfo\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388428 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388392    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-data\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388428 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388428    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-token\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388640 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-certs\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388709 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388636    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8635b78f-e254-4346-9490-4cba7a5d19d6-istiod-ca-cert\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388758 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388740    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-credential-socket\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388808 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388794    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-podinfo\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388864 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388809    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-certs\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388864 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388819    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-envoy\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388864 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388847    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf72g\" (UniqueName: \"kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-kube-api-access-pf72g\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388985 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-socket\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.388985 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.388916    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-data\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.389150 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.389126    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-credential-socket\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.389290 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.389268    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-socket\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.389347 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.389313    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8635b78f-e254-4346-9490-4cba7a5d19d6-istiod-ca-cert\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.391024 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.391005    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-envoy\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.391265 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.391245    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-podinfo\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.406953 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.406927    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-token\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.410555 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.410499    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf72g\" (UniqueName: \"kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-kube-api-access-pf72g\") pod \"e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") " pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.471461 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.471431    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:03.608409 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.608382    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"]
Jul 02 23:44:03.610916 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:44:03.610877    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8635b78f_e254_4346_9490_4cba7a5d19d6.slice/crio-fdcad68a068fc59f9ba0e25b26b689e5a975985621607226f3718bf8a1b98951 WatchSource:0}: Error finding container fdcad68a068fc59f9ba0e25b26b689e5a975985621607226f3718bf8a1b98951: Status 404 returned error can't find the container with id fdcad68a068fc59f9ba0e25b26b689e5a975985621607226f3718bf8a1b98951
Jul 02 23:44:03.613184 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.613153    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:44:03.613280 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.613232    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:44:03.613339 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:03.613275    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:44:04.101423 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:04.101388    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" event={"ID":"8635b78f-e254-4346-9490-4cba7a5d19d6","Type":"ContainerStarted","Data":"06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53"}
Jul 02 23:44:04.101590 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:04.101441    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" event={"ID":"8635b78f-e254-4346-9490-4cba7a5d19d6","Type":"ContainerStarted","Data":"fdcad68a068fc59f9ba0e25b26b689e5a975985621607226f3718bf8a1b98951"}
Jul 02 23:44:04.134106 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:04.134051    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" podStartSLOduration=1.13403449 podStartE2EDuration="1.13403449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:44:04.131704287 +0000 UTC m=+2010.587960515" watchObservedRunningTime="2026-07-02 23:44:04.13403449 +0000 UTC m=+2010.590290691"
Jul 02 23:44:04.471998 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:04.471905    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:04.477368 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:04.477344    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:05.110119 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:05.110089    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:05.114367 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:05.114338    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:11.150076 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:11.150040    2568 generic.go:356] "Generic (PLEG): container finished" podID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerID="144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33" exitCode=0
Jul 02 23:44:11.150538 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:11.150116    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" event={"ID":"92629cfb-aba6-4e1a-9e59-a94d4a40e238","Type":"ContainerDied","Data":"144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33"}
Jul 02 23:44:11.150538 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:11.150522    2568 scope.go:117] "RemoveContainer" containerID="144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33"
Jul 02 23:44:11.151612 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:11.151587    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:44:11.151684 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:11.151651    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:44:11.151735 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:11.151704    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:44:12.065026 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:12.064987    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:44:12.159209 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:12.159175    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" event={"ID":"92629cfb-aba6-4e1a-9e59-a94d4a40e238","Type":"ContainerStarted","Data":"2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14"}
Jul 02 23:44:13.056288 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:13.056256    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:44:13.057473 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:13.057445    2568 patch_prober.go:28] interesting pod/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 02 23:44:13.057614 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:13.057493    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 02 23:44:14.056375 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:14.056318    2568 patch_prober.go:28] interesting pod/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 02 23:44:14.056904 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:14.056409    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 02 23:44:15.057061 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:15.057020    2568 patch_prober.go:28] interesting pod/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 02 23:44:15.057471 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:15.057094    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 02 23:44:16.056575 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:16.056533    2568 patch_prober.go:28] interesting pod/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 02 23:44:16.056852 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:16.056604    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 02 23:44:17.060495 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:17.060466    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:44:17.060948 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:17.060713    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:44:17.061406 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:17.061390    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:44:18.188311 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:18.188228    2568 generic.go:356] "Generic (PLEG): container finished" podID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerID="06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53" exitCode=0
Jul 02 23:44:18.188753 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:18.188302    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" event={"ID":"8635b78f-e254-4346-9490-4cba7a5d19d6","Type":"ContainerDied","Data":"06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53"}
Jul 02 23:44:18.188753 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:18.188748    2568 scope.go:117] "RemoveContainer" containerID="06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53"
Jul 02 23:44:18.189664 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:18.189638    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:44:18.189761 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:18.189744    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:44:18.189823 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:18.189809    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 23:44:19.194981 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:19.194948    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" event={"ID":"8635b78f-e254-4346-9490-4cba7a5d19d6","Type":"ContainerStarted","Data":"a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875"}
Jul 02 23:44:19.472239 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:19.472158    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:19.473166 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:19.473136    2568 patch_prober.go:28] interesting pod/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 02 23:44:19.473301 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:19.473185    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 02 23:44:20.110774 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:20.110743    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:20.472256 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:20.472166    2568 patch_prober.go:28] interesting pod/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 02 23:44:20.472256 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:20.472220    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 02 23:44:21.472606 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:21.472566    2568 patch_prober.go:28] interesting pod/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 02 23:44:21.473035 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:21.472637    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 02 23:44:22.472040 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:22.471994    2568 patch_prober.go:28] interesting pod/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 02 23:44:22.472223 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:22.472052    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 02 23:44:23.476715 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:23.476655    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:23.477786 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:23.477767    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:44:53.065432 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.065398    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"]
Jul 02 23:44:53.065911 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.065854    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy"
Jul 02 23:44:53.065911 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.065867    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cf4baa8-13fa-4d5f-9d88-c1d66f5519fd" containerName="istio-proxy"
Jul 02 23:44:53.069198 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.069179    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.071986 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.071962    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"kube-root-ca.crt\""
Jul 02 23:44:53.072127 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.072020    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"auth-test-model-b07c26-kserve-self-signed-certs\""
Jul 02 23:44:53.072127 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.072057    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"default-dockercfg-pp9pl\""
Jul 02 23:44:53.072127 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.072080    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"openshift-service-ca.crt\""
Jul 02 23:44:53.084259 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.082646    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"]
Jul 02 23:44:53.155152 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.155113    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-tmp-dir\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.155152 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.155156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-home\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.155385 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.155277    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9caca719-f1e1-4407-a879-6beff0f62d50-tls-certs\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.155385 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.155335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-model-cache\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.155385 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.155373    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-dshm\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.155516 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.155415    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lccsm\" (UniqueName: \"kubernetes.io/projected/9caca719-f1e1-4407-a879-6beff0f62d50-kube-api-access-lccsm\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.256917 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.256883    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9caca719-f1e1-4407-a879-6beff0f62d50-tls-certs\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.257123 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.256934    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-model-cache\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.257123 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.256952    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-dshm\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.257123 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.256974    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lccsm\" (UniqueName: \"kubernetes.io/projected/9caca719-f1e1-4407-a879-6beff0f62d50-kube-api-access-lccsm\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.257123 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.257020    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-tmp-dir\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.257123 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.257041    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-home\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.257478 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.257457    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-home\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.257560 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.257480    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-tmp-dir\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.257560 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.257524    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-model-cache\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.259703 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.259686    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-dshm\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.260068 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.260042    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9caca719-f1e1-4407-a879-6beff0f62d50-tls-certs\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.264666 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.264644    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lccsm\" (UniqueName: \"kubernetes.io/projected/9caca719-f1e1-4407-a879-6beff0f62d50-kube-api-access-lccsm\") pod \"auth-test-model-b07c26-kserve-645c6d6c8c-qqd47\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") " pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.377944 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.377868    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:44:53.507743 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:53.507721    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"]
Jul 02 23:44:53.509995 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:44:53.509962    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9caca719_f1e1_4407_a879_6beff0f62d50.slice/crio-db04425027bff322e4d4bfe81c1b90e644b9db0eb8c741331f91c3ae6cda8c90 WatchSource:0}: Error finding container db04425027bff322e4d4bfe81c1b90e644b9db0eb8c741331f91c3ae6cda8c90: Status 404 returned error can't find the container with id db04425027bff322e4d4bfe81c1b90e644b9db0eb8c741331f91c3ae6cda8c90
Jul 02 23:44:54.355632 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:54.355592    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47" event={"ID":"9caca719-f1e1-4407-a879-6beff0f62d50","Type":"ContainerStarted","Data":"62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130"}
Jul 02 23:44:54.356023 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:54.355645    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47" event={"ID":"9caca719-f1e1-4407-a879-6beff0f62d50","Type":"ContainerStarted","Data":"db04425027bff322e4d4bfe81c1b90e644b9db0eb8c741331f91c3ae6cda8c90"}
Jul 02 23:44:54.372373 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:44:54.372323    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47" podStartSLOduration=1.372309936 podStartE2EDuration="1.372309936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:44:54.369949014 +0000 UTC m=+2060.826205215" watchObservedRunningTime="2026-07-02 23:44:54.372309936 +0000 UTC m=+2060.828566189"
Jul 02 23:45:03.379043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:45:03.378920    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:45:03.379043 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:45:03.379001    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:45:03.391601 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:45:03.391577    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:45:03.413623 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:45:03.413588    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:45:34.215744 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:45:34.215715    2568 scope.go:117] "RemoveContainer" containerID="00860e1757b7c2c6361c00dcd437265a82a1703d0a47c634b9d709e342dc1493"
Jul 02 23:46:49.166714 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:46:49.166619    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"]
Jul 02 23:47:04.186860 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.186815    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47" podUID="9caca719-f1e1-4407-a879-6beff0f62d50" containerName="main" containerID="cri-o://62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130" gracePeriod=45
Jul 02 23:47:04.439076 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.439015    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:47:04.528912 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.528880    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-model-cache\") pod \"9caca719-f1e1-4407-a879-6beff0f62d50\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") "
Jul 02 23:47:04.529117 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.528928    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9caca719-f1e1-4407-a879-6beff0f62d50-tls-certs\") pod \"9caca719-f1e1-4407-a879-6beff0f62d50\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") "
Jul 02 23:47:04.529117 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.528957    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-home\") pod \"9caca719-f1e1-4407-a879-6beff0f62d50\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") "
Jul 02 23:47:04.529117 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.528995    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lccsm\" (UniqueName: \"kubernetes.io/projected/9caca719-f1e1-4407-a879-6beff0f62d50-kube-api-access-lccsm\") pod \"9caca719-f1e1-4407-a879-6beff0f62d50\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") "
Jul 02 23:47:04.529117 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.529014    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-tmp-dir\") pod \"9caca719-f1e1-4407-a879-6beff0f62d50\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") "
Jul 02 23:47:04.529117 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.529069    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-dshm\") pod \"9caca719-f1e1-4407-a879-6beff0f62d50\" (UID: \"9caca719-f1e1-4407-a879-6beff0f62d50\") "
Jul 02 23:47:04.529352 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.529217    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-model-cache" (OuterVolumeSpecName: "model-cache") pod "9caca719-f1e1-4407-a879-6beff0f62d50" (UID: "9caca719-f1e1-4407-a879-6beff0f62d50"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:47:04.529352 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.529313    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-model-cache\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:47:04.529418 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.529344    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9caca719-f1e1-4407-a879-6beff0f62d50" (UID: "9caca719-f1e1-4407-a879-6beff0f62d50"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:47:04.529540 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.529509    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-home" (OuterVolumeSpecName: "home") pod "9caca719-f1e1-4407-a879-6beff0f62d50" (UID: "9caca719-f1e1-4407-a879-6beff0f62d50"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:47:04.531347 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.531317    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-dshm" (OuterVolumeSpecName: "dshm") pod "9caca719-f1e1-4407-a879-6beff0f62d50" (UID: "9caca719-f1e1-4407-a879-6beff0f62d50"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:47:04.531347 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.531318    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9caca719-f1e1-4407-a879-6beff0f62d50-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9caca719-f1e1-4407-a879-6beff0f62d50" (UID: "9caca719-f1e1-4407-a879-6beff0f62d50"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:47:04.531482 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.531455    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9caca719-f1e1-4407-a879-6beff0f62d50-kube-api-access-lccsm" (OuterVolumeSpecName: "kube-api-access-lccsm") pod "9caca719-f1e1-4407-a879-6beff0f62d50" (UID: "9caca719-f1e1-4407-a879-6beff0f62d50"). InnerVolumeSpecName "kube-api-access-lccsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:47:04.630492 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.630462    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-home\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:47:04.630492 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.630490    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lccsm\" (UniqueName: \"kubernetes.io/projected/9caca719-f1e1-4407-a879-6beff0f62d50-kube-api-access-lccsm\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:47:04.630729 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.630518    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-tmp-dir\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:47:04.630729 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.630527    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9caca719-f1e1-4407-a879-6beff0f62d50-dshm\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:47:04.630729 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.630535    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9caca719-f1e1-4407-a879-6beff0f62d50-tls-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:47:04.967825 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.967791    2568 generic.go:356] "Generic (PLEG): container finished" podID="9caca719-f1e1-4407-a879-6beff0f62d50" containerID="62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130" exitCode=0
Jul 02 23:47:04.968013 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.967849    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"
Jul 02 23:47:04.968013 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.967871    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47" event={"ID":"9caca719-f1e1-4407-a879-6beff0f62d50","Type":"ContainerDied","Data":"62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130"}
Jul 02 23:47:04.968013 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.967920    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47" event={"ID":"9caca719-f1e1-4407-a879-6beff0f62d50","Type":"ContainerDied","Data":"db04425027bff322e4d4bfe81c1b90e644b9db0eb8c741331f91c3ae6cda8c90"}
Jul 02 23:47:04.968013 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.967938    2568 scope.go:117] "RemoveContainer" containerID="62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130"
Jul 02 23:47:04.976725 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.976704    2568 scope.go:117] "RemoveContainer" containerID="62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130"
Jul 02 23:47:04.976992 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:47:04.976972    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130\": container with ID starting with 62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130 not found: ID does not exist" containerID="62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130"
Jul 02 23:47:04.977061 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.977003    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130"} err="failed to get container status \"62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130\": rpc error: code = NotFound desc = could not find container \"62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130\": container with ID starting with 62fd8d0d98b39f6c47f6a9209a464a7cc9b2d4a45b263db5f6a9f1ff998ba130 not found: ID does not exist"
Jul 02 23:47:04.987583 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.987554    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"]
Jul 02 23:47:04.990808 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:04.990789    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/auth-test-model-b07c26-kserve-645c6d6c8c-qqd47"]
Jul 02 23:47:06.079047 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:06.079011    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9caca719-f1e1-4407-a879-6beff0f62d50" path="/var/lib/kubelet/pods/9caca719-f1e1-4407-a879-6beff0f62d50/volumes"
Jul 02 23:47:13.863555 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.863517    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"]
Jul 02 23:47:13.864109 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.863876    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caca719-f1e1-4407-a879-6beff0f62d50" containerName="main"
Jul 02 23:47:13.864109 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.863887    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caca719-f1e1-4407-a879-6beff0f62d50" containerName="main"
Jul 02 23:47:13.864109 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.863953    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9caca719-f1e1-4407-a879-6beff0f62d50" containerName="main"
Jul 02 23:47:13.866952 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.866933    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:13.869084 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.869064    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"openshift-service-ca.crt\""
Jul 02 23:47:13.869193 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.869065    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"kube-root-ca.crt\""
Jul 02 23:47:13.869193 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.869067    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"default-dockercfg-pp9pl\""
Jul 02 23:47:13.869911 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.869893    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"sub-test-model-b07c26-kserve-self-signed-certs\""
Jul 02 23:47:13.877157 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.877127    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"]
Jul 02 23:47:13.907067 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.907030    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c45e83-de09-4a1a-baba-630e115a4435-tls-certs\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:13.907228 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.907075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-home\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:13.907228 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.907091    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-dshm\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:13.907228 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.907113    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-tmp-dir\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:13.907228 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.907202    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-model-cache\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:13.907228 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:13.907227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rkcl\" (UniqueName: \"kubernetes.io/projected/94c45e83-de09-4a1a-baba-630e115a4435-kube-api-access-8rkcl\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.007841 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.007806    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-model-cache\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.008041 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.007849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rkcl\" (UniqueName: \"kubernetes.io/projected/94c45e83-de09-4a1a-baba-630e115a4435-kube-api-access-8rkcl\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.008041 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.007899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c45e83-de09-4a1a-baba-630e115a4435-tls-certs\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.008041 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.007926    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-home\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.008041 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.007950    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-dshm\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.008041 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.007978    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-tmp-dir\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.008332 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.008228    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-model-cache\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.008396 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.008353    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-tmp-dir\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.008518 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.008499    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-home\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.010755 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.010730    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-dshm\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.011338 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.011206    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c45e83-de09-4a1a-baba-630e115a4435-tls-certs\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.016580 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.016558    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rkcl\" (UniqueName: \"kubernetes.io/projected/94c45e83-de09-4a1a-baba-630e115a4435-kube-api-access-8rkcl\") pod \"sub-test-model-b07c26-kserve-847865f547-zlkhp\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") " pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.177450 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.177357    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:14.310626 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:14.310602    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"]
Jul 02 23:47:14.313713 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:47:14.313654    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94c45e83_de09_4a1a_baba_630e115a4435.slice/crio-95718fd3f2801222e23fbb1e19010954fb483eadf67754c44dbeb30b962c3a52 WatchSource:0}: Error finding container 95718fd3f2801222e23fbb1e19010954fb483eadf67754c44dbeb30b962c3a52: Status 404 returned error can't find the container with id 95718fd3f2801222e23fbb1e19010954fb483eadf67754c44dbeb30b962c3a52
Jul 02 23:47:15.019499 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:15.019467    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp" event={"ID":"94c45e83-de09-4a1a-baba-630e115a4435","Type":"ContainerStarted","Data":"d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30"}
Jul 02 23:47:15.019889 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:15.019508    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp" event={"ID":"94c45e83-de09-4a1a-baba-630e115a4435","Type":"ContainerStarted","Data":"95718fd3f2801222e23fbb1e19010954fb483eadf67754c44dbeb30b962c3a52"}
Jul 02 23:47:15.036245 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:15.036197    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp" podStartSLOduration=2.036180212 podStartE2EDuration="2.036180212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:47:15.034521407 +0000 UTC m=+2201.490777608" watchObservedRunningTime="2026-07-02 23:47:15.036180212 +0000 UTC m=+2201.492436413"
Jul 02 23:47:24.178432 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:24.178389    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:24.178898 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:24.178449    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:24.190927 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:24.190903    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:47:25.080696 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:47:25.080649    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:48:08.750416 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:08.750380    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"]
Jul 02 23:48:23.770754 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:23.770689    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp" podUID="94c45e83-de09-4a1a-baba-630e115a4435" containerName="main" containerID="cri-o://d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30" gracePeriod=45
Jul 02 23:48:24.019215 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.019189    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:48:24.131973 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.131883    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rkcl\" (UniqueName: \"kubernetes.io/projected/94c45e83-de09-4a1a-baba-630e115a4435-kube-api-access-8rkcl\") pod \"94c45e83-de09-4a1a-baba-630e115a4435\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") "
Jul 02 23:48:24.132151 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.131984    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-dshm\") pod \"94c45e83-de09-4a1a-baba-630e115a4435\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") "
Jul 02 23:48:24.132151 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.132004    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c45e83-de09-4a1a-baba-630e115a4435-tls-certs\") pod \"94c45e83-de09-4a1a-baba-630e115a4435\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") "
Jul 02 23:48:24.132151 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.132020    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-tmp-dir\") pod \"94c45e83-de09-4a1a-baba-630e115a4435\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") "
Jul 02 23:48:24.132151 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.132045    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-model-cache\") pod \"94c45e83-de09-4a1a-baba-630e115a4435\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") "
Jul 02 23:48:24.132151 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.132083    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-home\") pod \"94c45e83-de09-4a1a-baba-630e115a4435\" (UID: \"94c45e83-de09-4a1a-baba-630e115a4435\") "
Jul 02 23:48:24.132436 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.132333    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "94c45e83-de09-4a1a-baba-630e115a4435" (UID: "94c45e83-de09-4a1a-baba-630e115a4435"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:48:24.132436 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.132354    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-home" (OuterVolumeSpecName: "home") pod "94c45e83-de09-4a1a-baba-630e115a4435" (UID: "94c45e83-de09-4a1a-baba-630e115a4435"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:48:24.132436 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.132344    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-model-cache" (OuterVolumeSpecName: "model-cache") pod "94c45e83-de09-4a1a-baba-630e115a4435" (UID: "94c45e83-de09-4a1a-baba-630e115a4435"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:48:24.132598 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.132504    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-tmp-dir\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:48:24.132598 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.132527    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-model-cache\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:48:24.132598 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.132543    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-home\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:48:24.134286 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.134260    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94c45e83-de09-4a1a-baba-630e115a4435-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "94c45e83-de09-4a1a-baba-630e115a4435" (UID: "94c45e83-de09-4a1a-baba-630e115a4435"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:48:24.134540 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.134521    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-dshm" (OuterVolumeSpecName: "dshm") pod "94c45e83-de09-4a1a-baba-630e115a4435" (UID: "94c45e83-de09-4a1a-baba-630e115a4435"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:48:24.134606 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.134557    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94c45e83-de09-4a1a-baba-630e115a4435-kube-api-access-8rkcl" (OuterVolumeSpecName: "kube-api-access-8rkcl") pod "94c45e83-de09-4a1a-baba-630e115a4435" (UID: "94c45e83-de09-4a1a-baba-630e115a4435"). InnerVolumeSpecName "kube-api-access-8rkcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:48:24.233449 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.233413    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94c45e83-de09-4a1a-baba-630e115a4435-dshm\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:48:24.233449 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.233443    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94c45e83-de09-4a1a-baba-630e115a4435-tls-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:48:24.233449 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.233453    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rkcl\" (UniqueName: \"kubernetes.io/projected/94c45e83-de09-4a1a-baba-630e115a4435-kube-api-access-8rkcl\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:48:24.347540 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.347503    2568 generic.go:356] "Generic (PLEG): container finished" podID="94c45e83-de09-4a1a-baba-630e115a4435" containerID="d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30" exitCode=0
Jul 02 23:48:24.347745 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.347550    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"
Jul 02 23:48:24.347745 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.347586    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp" event={"ID":"94c45e83-de09-4a1a-baba-630e115a4435","Type":"ContainerDied","Data":"d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30"}
Jul 02 23:48:24.347745 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.347625    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp" event={"ID":"94c45e83-de09-4a1a-baba-630e115a4435","Type":"ContainerDied","Data":"95718fd3f2801222e23fbb1e19010954fb483eadf67754c44dbeb30b962c3a52"}
Jul 02 23:48:24.347745 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.347642    2568 scope.go:117] "RemoveContainer" containerID="d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30"
Jul 02 23:48:24.356546 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.356530    2568 scope.go:117] "RemoveContainer" containerID="d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30"
Jul 02 23:48:24.356834 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:48:24.356814    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30\": container with ID starting with d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30 not found: ID does not exist" containerID="d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30"
Jul 02 23:48:24.356894 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.356842    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30"} err="failed to get container status \"d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30\": rpc error: code = NotFound desc = could not find container \"d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30\": container with ID starting with d939bb23346ce08864e9fd91565057a243932228d9571a5b90dfc62a3f4a8b30 not found: ID does not exist"
Jul 02 23:48:24.367552 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.367528    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"]
Jul 02 23:48:24.370938 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:24.370916    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/sub-test-model-b07c26-kserve-847865f547-zlkhp"]
Jul 02 23:48:26.079224 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:26.079188    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94c45e83-de09-4a1a-baba-630e115a4435" path="/var/lib/kubelet/pods/94c45e83-de09-4a1a-baba-630e115a4435/volumes"
Jul 02 23:48:42.069368 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.069330    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"]
Jul 02 23:48:42.069933 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.069912    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94c45e83-de09-4a1a-baba-630e115a4435" containerName="main"
Jul 02 23:48:42.069986 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.069937    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="94c45e83-de09-4a1a-baba-630e115a4435" containerName="main"
Jul 02 23:48:42.070054 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.070041    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="94c45e83-de09-4a1a-baba-630e115a4435" containerName="main"
Jul 02 23:48:42.073349 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.073327    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.076155 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.076124    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"default-dockercfg-pp9pl\""
Jul 02 23:48:42.076299 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.076125    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"rate-test-model-b07c26-kserve-self-signed-certs\""
Jul 02 23:48:42.076299 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.076125    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"openshift-service-ca.crt\""
Jul 02 23:48:42.076299 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.076132    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b07c26\"/\"kube-root-ca.crt\""
Jul 02 23:48:42.081650 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.081626    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"]
Jul 02 23:48:42.199730 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.199662    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-home\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.199907 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.199813    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48915d14-f817-4540-aefc-b24bfeb3668e-tls-certs\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.199907 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.199878    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm7dn\" (UniqueName: \"kubernetes.io/projected/48915d14-f817-4540-aefc-b24bfeb3668e-kube-api-access-pm7dn\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.200003 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.199977    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-dshm\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.200071 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.200055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-model-cache\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.200116 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.200101    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-tmp-dir\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.301422 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.301388    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-model-cache\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.301609 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.301434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-tmp-dir\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.301609 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.301456    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-home\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.301609 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.301493    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48915d14-f817-4540-aefc-b24bfeb3668e-tls-certs\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.301609 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.301525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm7dn\" (UniqueName: \"kubernetes.io/projected/48915d14-f817-4540-aefc-b24bfeb3668e-kube-api-access-pm7dn\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.301609 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.301551    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-dshm\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.301956 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.301889    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-model-cache\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.301956 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.301921    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-tmp-dir\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.302232 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.302212    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-home\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.304329 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.304074    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-dshm\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.304501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.304474    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48915d14-f817-4540-aefc-b24bfeb3668e-tls-certs\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.309875 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.309849    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm7dn\" (UniqueName: \"kubernetes.io/projected/48915d14-f817-4540-aefc-b24bfeb3668e-kube-api-access-pm7dn\") pod \"rate-test-model-b07c26-kserve-6b98f86b99-hfj4r\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") " pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.385177 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.385091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:42.519029 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:42.519003    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"]
Jul 02 23:48:42.521551 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:48:42.521525    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48915d14_f817_4540_aefc_b24bfeb3668e.slice/crio-dff8477cabd26c715062d2f469f94a593772fce5f898a5c3001c607ef95849ff WatchSource:0}: Error finding container dff8477cabd26c715062d2f469f94a593772fce5f898a5c3001c607ef95849ff: Status 404 returned error can't find the container with id dff8477cabd26c715062d2f469f94a593772fce5f898a5c3001c607ef95849ff
Jul 02 23:48:43.434310 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:43.434273    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r" event={"ID":"48915d14-f817-4540-aefc-b24bfeb3668e","Type":"ContainerStarted","Data":"3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99"}
Jul 02 23:48:43.434310 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:43.434317    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r" event={"ID":"48915d14-f817-4540-aefc-b24bfeb3668e","Type":"ContainerStarted","Data":"dff8477cabd26c715062d2f469f94a593772fce5f898a5c3001c607ef95849ff"}
Jul 02 23:48:43.450376 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:43.450328    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r" podStartSLOduration=1.450311796 podStartE2EDuration="1.450311796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:48:43.449187903 +0000 UTC m=+2289.905444105" watchObservedRunningTime="2026-07-02 23:48:43.450311796 +0000 UTC m=+2289.906567997"
Jul 02 23:48:52.385535 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:52.385502    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:52.386070 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:52.385710    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:52.397737 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:52.397713    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:48:52.488219 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:48:52.488187    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:49:23.653770 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:23.653728    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"]
Jul 02 23:49:38.674217 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:38.674108    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r" podUID="48915d14-f817-4540-aefc-b24bfeb3668e" containerName="main" containerID="cri-o://3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99" gracePeriod=45
Jul 02 23:49:38.930188 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:38.930120    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:49:39.003760 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.003730    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-model-cache\") pod \"48915d14-f817-4540-aefc-b24bfeb3668e\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") "
Jul 02 23:49:39.003966 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.003784    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm7dn\" (UniqueName: \"kubernetes.io/projected/48915d14-f817-4540-aefc-b24bfeb3668e-kube-api-access-pm7dn\") pod \"48915d14-f817-4540-aefc-b24bfeb3668e\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") "
Jul 02 23:49:39.003966 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.003810    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-tmp-dir\") pod \"48915d14-f817-4540-aefc-b24bfeb3668e\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") "
Jul 02 23:49:39.003966 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.003865    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48915d14-f817-4540-aefc-b24bfeb3668e-tls-certs\") pod \"48915d14-f817-4540-aefc-b24bfeb3668e\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") "
Jul 02 23:49:39.003966 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.003919    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-home\") pod \"48915d14-f817-4540-aefc-b24bfeb3668e\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") "
Jul 02 23:49:39.003966 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.003964    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-dshm\") pod \"48915d14-f817-4540-aefc-b24bfeb3668e\" (UID: \"48915d14-f817-4540-aefc-b24bfeb3668e\") "
Jul 02 23:49:39.004227 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.004127    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "48915d14-f817-4540-aefc-b24bfeb3668e" (UID: "48915d14-f817-4540-aefc-b24bfeb3668e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:49:39.004227 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.004168    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-home" (OuterVolumeSpecName: "home") pod "48915d14-f817-4540-aefc-b24bfeb3668e" (UID: "48915d14-f817-4540-aefc-b24bfeb3668e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:49:39.004343 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.004276    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-tmp-dir\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:49:39.004343 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.004295    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-home\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:49:39.004343 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.004330    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-model-cache" (OuterVolumeSpecName: "model-cache") pod "48915d14-f817-4540-aefc-b24bfeb3668e" (UID: "48915d14-f817-4540-aefc-b24bfeb3668e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:49:39.006133 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.006105    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-dshm" (OuterVolumeSpecName: "dshm") pod "48915d14-f817-4540-aefc-b24bfeb3668e" (UID: "48915d14-f817-4540-aefc-b24bfeb3668e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:49:39.006412 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.006387    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48915d14-f817-4540-aefc-b24bfeb3668e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "48915d14-f817-4540-aefc-b24bfeb3668e" (UID: "48915d14-f817-4540-aefc-b24bfeb3668e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:49:39.006509 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.006452    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48915d14-f817-4540-aefc-b24bfeb3668e-kube-api-access-pm7dn" (OuterVolumeSpecName: "kube-api-access-pm7dn") pod "48915d14-f817-4540-aefc-b24bfeb3668e" (UID: "48915d14-f817-4540-aefc-b24bfeb3668e"). InnerVolumeSpecName "kube-api-access-pm7dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:49:39.105005 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.104792    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-dshm\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:49:39.105005 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.104826    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48915d14-f817-4540-aefc-b24bfeb3668e-model-cache\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:49:39.105005 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.104843    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm7dn\" (UniqueName: \"kubernetes.io/projected/48915d14-f817-4540-aefc-b24bfeb3668e-kube-api-access-pm7dn\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:49:39.105005 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.104857    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48915d14-f817-4540-aefc-b24bfeb3668e-tls-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:49:39.701976 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.701940    2568 generic.go:356] "Generic (PLEG): container finished" podID="48915d14-f817-4540-aefc-b24bfeb3668e" containerID="3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99" exitCode=0
Jul 02 23:49:39.702435 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.701986    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"
Jul 02 23:49:39.702435 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.702033    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r" event={"ID":"48915d14-f817-4540-aefc-b24bfeb3668e","Type":"ContainerDied","Data":"3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99"}
Jul 02 23:49:39.702435 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.702082    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r" event={"ID":"48915d14-f817-4540-aefc-b24bfeb3668e","Type":"ContainerDied","Data":"dff8477cabd26c715062d2f469f94a593772fce5f898a5c3001c607ef95849ff"}
Jul 02 23:49:39.702435 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.702102    2568 scope.go:117] "RemoveContainer" containerID="3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99"
Jul 02 23:49:39.711652 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.711635    2568 scope.go:117] "RemoveContainer" containerID="3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99"
Jul 02 23:49:39.711939 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:49:39.711899    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99\": container with ID starting with 3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99 not found: ID does not exist" containerID="3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99"
Jul 02 23:49:39.712003 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.711949    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99"} err="failed to get container status \"3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99\": rpc error: code = NotFound desc = could not find container \"3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99\": container with ID starting with 3bea2403e98c825c69e585dae491033b1299bc7b994169c84d60caacb3ce0c99 not found: ID does not exist"
Jul 02 23:49:39.722488 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.722461    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"]
Jul 02 23:49:39.729140 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:39.729111    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b07c26/rate-test-model-b07c26-kserve-6b98f86b99-hfj4r"]
Jul 02 23:49:40.078616 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:49:40.078580    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48915d14-f817-4540-aefc-b24bfeb3668e" path="/var/lib/kubelet/pods/48915d14-f817-4540-aefc-b24bfeb3668e/volumes"
Jul 02 23:50:07.152048 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:07.152010    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"]
Jul 02 23:50:07.152537 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:07.152307    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy" containerID="cri-o://2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14" gracePeriod=30
Jul 02 23:50:12.397349 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.397326    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:50:12.488732 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.488647    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t86jt\" (UniqueName: \"kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-kube-api-access-t86jt\") pod \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") "
Jul 02 23:50:12.488732 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.488706    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-podinfo\") pod \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") "
Jul 02 23:50:12.488732 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.488734    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-socket\") pod \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") "
Jul 02 23:50:12.488984 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.488755    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-certs\") pod \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") "
Jul 02 23:50:12.488984 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.488775    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istiod-ca-cert\") pod \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") "
Jul 02 23:50:12.488984 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.488796    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-envoy\") pod \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") "
Jul 02 23:50:12.488984 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.488863    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-credential-socket\") pod \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") "
Jul 02 23:50:12.488984 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.488932    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-token\") pod \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") "
Jul 02 23:50:12.488984 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.488954    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-data\") pod \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\" (UID: \"92629cfb-aba6-4e1a-9e59-a94d4a40e238\") "
Jul 02 23:50:12.489284 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.489056    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92629cfb-aba6-4e1a-9e59-a94d4a40e238" (UID: "92629cfb-aba6-4e1a-9e59-a94d4a40e238"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:50:12.489284 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.489193    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92629cfb-aba6-4e1a-9e59-a94d4a40e238" (UID: "92629cfb-aba6-4e1a-9e59-a94d4a40e238"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:50:12.489284 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.489071    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92629cfb-aba6-4e1a-9e59-a94d4a40e238" (UID: "92629cfb-aba6-4e1a-9e59-a94d4a40e238"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:50:12.489284 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.489254    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:12.489501 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.489317    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92629cfb-aba6-4e1a-9e59-a94d4a40e238" (UID: "92629cfb-aba6-4e1a-9e59-a94d4a40e238"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:50:12.489769 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.489748    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-data" (OuterVolumeSpecName: "istio-data") pod "92629cfb-aba6-4e1a-9e59-a94d4a40e238" (UID: "92629cfb-aba6-4e1a-9e59-a94d4a40e238"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:50:12.491027 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.491003    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92629cfb-aba6-4e1a-9e59-a94d4a40e238" (UID: "92629cfb-aba6-4e1a-9e59-a94d4a40e238"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:50:12.491142 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.491037    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-token" (OuterVolumeSpecName: "istio-token") pod "92629cfb-aba6-4e1a-9e59-a94d4a40e238" (UID: "92629cfb-aba6-4e1a-9e59-a94d4a40e238"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:50:12.491260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.491241    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-kube-api-access-t86jt" (OuterVolumeSpecName: "kube-api-access-t86jt") pod "92629cfb-aba6-4e1a-9e59-a94d4a40e238" (UID: "92629cfb-aba6-4e1a-9e59-a94d4a40e238"). InnerVolumeSpecName "kube-api-access-t86jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:50:12.491260 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.491246    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92629cfb-aba6-4e1a-9e59-a94d4a40e238" (UID: "92629cfb-aba6-4e1a-9e59-a94d4a40e238"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:50:12.590386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.590355    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:12.590386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.590380    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:12.590386 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.590389    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:12.590601 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.590397    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t86jt\" (UniqueName: \"kubernetes.io/projected/92629cfb-aba6-4e1a-9e59-a94d4a40e238-kube-api-access-t86jt\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:12.590601 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.590406    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:12.590601 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.590414    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:12.590601 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.590421    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:12.590601 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.590429    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92629cfb-aba6-4e1a-9e59-a94d4a40e238-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:12.854860 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.854824    2568 generic.go:356] "Generic (PLEG): container finished" podID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerID="2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14" exitCode=0
Jul 02 23:50:12.855019 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.854873    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"
Jul 02 23:50:12.855019 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.854904    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" event={"ID":"92629cfb-aba6-4e1a-9e59-a94d4a40e238","Type":"ContainerDied","Data":"2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14"}
Jul 02 23:50:12.855019 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.854962    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt" event={"ID":"92629cfb-aba6-4e1a-9e59-a94d4a40e238","Type":"ContainerDied","Data":"da8ee069d401f3bd3a0a0c4b9b5aa408e0cec0c4b0ab83599a8c5958f4565b33"}
Jul 02 23:50:12.855019 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.854993    2568 scope.go:117] "RemoveContainer" containerID="2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14"
Jul 02 23:50:12.865468 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.865433    2568 scope.go:117] "RemoveContainer" containerID="144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33"
Jul 02 23:50:12.873510 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.873489    2568 scope.go:117] "RemoveContainer" containerID="2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14"
Jul 02 23:50:12.873853 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:50:12.873820    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14\": container with ID starting with 2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14 not found: ID does not exist" containerID="2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14"
Jul 02 23:50:12.873959 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.873850    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14"} err="failed to get container status \"2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14\": rpc error: code = NotFound desc = could not find container \"2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14\": container with ID starting with 2167520aa62e6c436cf855835f903bdabacb68916f893797073b95474195aa14 not found: ID does not exist"
Jul 02 23:50:12.873959 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.873866    2568 scope.go:117] "RemoveContainer" containerID="144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33"
Jul 02 23:50:12.874116 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:50:12.874095    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33\": container with ID starting with 144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33 not found: ID does not exist" containerID="144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33"
Jul 02 23:50:12.874174 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.874122    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33"} err="failed to get container status \"144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33\": rpc error: code = NotFound desc = could not find container \"144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33\": container with ID starting with 144b5f4b9c8d1c197090b36bd8141731f65ad8b63737acd93695138dd8801c33 not found: ID does not exist"
Jul 02 23:50:12.875542 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.875520    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"]
Jul 02 23:50:12.879282 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:12.879263    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-aefe3e-openshift-default-7fcf87558c-pwkpt"]
Jul 02 23:50:14.082324 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:14.082286    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" path="/var/lib/kubelet/pods/92629cfb-aba6-4e1a-9e59-a94d4a40e238/volumes"
Jul 02 23:50:14.097853 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:14.097824    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"]
Jul 02 23:50:14.098051 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:14.098021    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy" containerID="cri-o://a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875" gracePeriod=30
Jul 02 23:50:19.276656 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.276622    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2mm7b_d065eb0b-fab0-4f57-a343-cda94b3fc4d4/manager/0.log"
Jul 02 23:50:19.342412 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.342387    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:50:19.393913 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.393835    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zf4dk_bcad56d5-27c5-4202-aae3-4fb1befcc556/manager/0.log"
Jul 02 23:50:19.446906 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.446876    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-envoy\") pod \"8635b78f-e254-4346-9490-4cba7a5d19d6\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") "
Jul 02 23:50:19.447056 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.446960    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-credential-socket\") pod \"8635b78f-e254-4346-9490-4cba7a5d19d6\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") "
Jul 02 23:50:19.447056 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.446991    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-certs\") pod \"8635b78f-e254-4346-9490-4cba7a5d19d6\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") "
Jul 02 23:50:19.447056 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447018    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8635b78f-e254-4346-9490-4cba7a5d19d6-istiod-ca-cert\") pod \"8635b78f-e254-4346-9490-4cba7a5d19d6\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") "
Jul 02 23:50:19.447222 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447073    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-data\") pod \"8635b78f-e254-4346-9490-4cba7a5d19d6\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") "
Jul 02 23:50:19.447222 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447100    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-podinfo\") pod \"8635b78f-e254-4346-9490-4cba7a5d19d6\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") "
Jul 02 23:50:19.447222 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447137    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-socket\") pod \"8635b78f-e254-4346-9490-4cba7a5d19d6\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") "
Jul 02 23:50:19.447222 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447168    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf72g\" (UniqueName: \"kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-kube-api-access-pf72g\") pod \"8635b78f-e254-4346-9490-4cba7a5d19d6\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") "
Jul 02 23:50:19.447222 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447191    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-token\") pod \"8635b78f-e254-4346-9490-4cba7a5d19d6\" (UID: \"8635b78f-e254-4346-9490-4cba7a5d19d6\") "
Jul 02 23:50:19.447486 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447280    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8635b78f-e254-4346-9490-4cba7a5d19d6" (UID: "8635b78f-e254-4346-9490-4cba7a5d19d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:50:19.447486 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447398    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8635b78f-e254-4346-9490-4cba7a5d19d6" (UID: "8635b78f-e254-4346-9490-4cba7a5d19d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:50:19.447602 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447228    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8635b78f-e254-4346-9490-4cba7a5d19d6" (UID: "8635b78f-e254-4346-9490-4cba7a5d19d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:50:19.447659 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447643    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-credential-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:19.447739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447664    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-certs\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:19.447739 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.447702    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-workload-socket\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:19.448190 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.448160    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8635b78f-e254-4346-9490-4cba7a5d19d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8635b78f-e254-4346-9490-4cba7a5d19d6" (UID: "8635b78f-e254-4346-9490-4cba7a5d19d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:50:19.448330 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.448213    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "8635b78f-e254-4346-9490-4cba7a5d19d6" (UID: "8635b78f-e254-4346-9490-4cba7a5d19d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:50:19.449661 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.449642    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8635b78f-e254-4346-9490-4cba7a5d19d6" (UID: "8635b78f-e254-4346-9490-4cba7a5d19d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:50:19.449775 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.449691    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-kube-api-access-pf72g" (OuterVolumeSpecName: "kube-api-access-pf72g") pod "8635b78f-e254-4346-9490-4cba7a5d19d6" (UID: "8635b78f-e254-4346-9490-4cba7a5d19d6"). InnerVolumeSpecName "kube-api-access-pf72g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:50:19.449826 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.449784    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "8635b78f-e254-4346-9490-4cba7a5d19d6" (UID: "8635b78f-e254-4346-9490-4cba7a5d19d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:50:19.449826 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.449782    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8635b78f-e254-4346-9490-4cba7a5d19d6" (UID: "8635b78f-e254-4346-9490-4cba7a5d19d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 23:50:19.548664 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.548633    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-envoy\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:19.548664 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.548660    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8635b78f-e254-4346-9490-4cba7a5d19d6-istiod-ca-cert\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:19.548664 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.548681    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-data\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:19.548664 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.548690    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-podinfo\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:19.548940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.548698    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf72g\" (UniqueName: \"kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-kube-api-access-pf72g\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:19.548940 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.548707    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8635b78f-e254-4346-9490-4cba7a5d19d6-istio-token\") on node \"ip-10-0-137-25.ec2.internal\" DevicePath \"\""
Jul 02 23:50:19.888540 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.888510    2568 generic.go:356] "Generic (PLEG): container finished" podID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerID="a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875" exitCode=0
Jul 02 23:50:19.888728 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.888560    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"
Jul 02 23:50:19.888728 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.888595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" event={"ID":"8635b78f-e254-4346-9490-4cba7a5d19d6","Type":"ContainerDied","Data":"a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875"}
Jul 02 23:50:19.888728 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.888656    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27" event={"ID":"8635b78f-e254-4346-9490-4cba7a5d19d6","Type":"ContainerDied","Data":"fdcad68a068fc59f9ba0e25b26b689e5a975985621607226f3718bf8a1b98951"}
Jul 02 23:50:19.888728 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.888712    2568 scope.go:117] "RemoveContainer" containerID="a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875"
Jul 02 23:50:19.897834 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.897813    2568 scope.go:117] "RemoveContainer" containerID="06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53"
Jul 02 23:50:19.905438 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.905416    2568 scope.go:117] "RemoveContainer" containerID="a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875"
Jul 02 23:50:19.905710 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:50:19.905691    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875\": container with ID starting with a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875 not found: ID does not exist" containerID="a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875"
Jul 02 23:50:19.905765 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.905719    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875"} err="failed to get container status \"a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875\": rpc error: code = NotFound desc = could not find container \"a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875\": container with ID starting with a36e0d7536c374a91d9c486a4e11b781368b01543a7bf9e93f860a8c5154b875 not found: ID does not exist"
Jul 02 23:50:19.905765 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.905744    2568 scope.go:117] "RemoveContainer" containerID="06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53"
Jul 02 23:50:19.905984 ip-10-0-137-25 kubenswrapper[2568]: E0702 23:50:19.905967    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53\": container with ID starting with 06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53 not found: ID does not exist" containerID="06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53"
Jul 02 23:50:19.906027 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.905989    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53"} err="failed to get container status \"06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53\": rpc error: code = NotFound desc = could not find container \"06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53\": container with ID starting with 06377451b020af99de343ac32728ee19892e1bfc7a65652338325654bd058d53 not found: ID does not exist"
Jul 02 23:50:19.909225 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.909204    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"]
Jul 02 23:50:19.912439 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:19.912418    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b07c26-openshift-default-69b98b8759-tmp27"]
Jul 02 23:50:20.066581 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:20.066549    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6wft9_9ccf47d2-e249-41fe-982c-751e16bd35b7/manager/0.log"
Jul 02 23:50:20.078777 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:20.078752    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" path="/var/lib/kubelet/pods/8635b78f-e254-4346-9490-4cba7a5d19d6/volumes"
Jul 02 23:50:20.424486 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:20.424460    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc9978976-nrclr_27b545fe-74a0-4c4a-9d50-5edf5484d340/copy-manifests/0.log"
Jul 02 23:50:20.430823 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:20.430804    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc9978976-nrclr_27b545fe-74a0-4c4a-9d50-5edf5484d340/manager/0.log"
Jul 02 23:50:21.908516 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:21.908489    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lbc92_aeb3c012-5516-4d46-a6a4-c38ee5d61617/manager/0.log"
Jul 02 23:50:22.020545 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:22.020515    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-df2vw_fe694108-ce41-416b-b20d-5f5139b867a5/manager/0.log"
Jul 02 23:50:22.128274 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:22.128246    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sf5z8_874dab85-bc7b-46c5-b3f0-e5fa3b9628ea/kuadrant-console-plugin/0.log"
Jul 02 23:50:22.237956 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:22.237872    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7dbpk_1f7c9207-60ef-46d6-9146-80e9482c9e9d/registry-server/0.log"
Jul 02 23:50:22.356503 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:22.356472    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rkv84_417ab045-2644-4bb5-9a80-36ac6b461385/manager/0.log"
Jul 02 23:50:22.601307 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:22.601279    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mbfm4_84d83def-bfb6-4b96-9fb8-31ac2a79bfbd/manager/0.log"
Jul 02 23:50:22.954373 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:22.954289    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zs8jq_c262ba43-0ad4-41b0-913a-63134a7555bf/istio-proxy/0.log"
Jul 02 23:50:23.182086 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:23.182056    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69478b7d6-nqzmg_45b01f44-34eb-4c7f-ac42-21230baf43df/kube-auth-proxy/0.log"
Jul 02 23:50:23.412533 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:23.412504    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zzrr2_27e191d8-835b-4e74-888c-a7cc04b7c5c4/istio-proxy/1.log"
Jul 02 23:50:24.296560 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:24.296533    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-qvpnh_101eb54e-9488-4e90-b132-dac6ff01fe69/main/0.log"
Jul 02 23:50:24.516513 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:24.516481    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-6dhc9_4e833222-8357-4715-a48a-227619b0ff83/main/0.log"
Jul 02 23:50:29.200859 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.200829    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d4ctc/must-gather-95752"]
Jul 02 23:50:29.201241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201151    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy"
Jul 02 23:50:29.201241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201162    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy"
Jul 02 23:50:29.201241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201173    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48915d14-f817-4540-aefc-b24bfeb3668e" containerName="main"
Jul 02 23:50:29.201241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201179    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="48915d14-f817-4540-aefc-b24bfeb3668e" containerName="main"
Jul 02 23:50:29.201241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201189    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy"
Jul 02 23:50:29.201241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201194    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy"
Jul 02 23:50:29.201241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201205    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy"
Jul 02 23:50:29.201241 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201210    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy"
Jul 02 23:50:29.201491 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201260    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy"
Jul 02 23:50:29.201491 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201268    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="48915d14-f817-4540-aefc-b24bfeb3668e" containerName="main"
Jul 02 23:50:29.201491 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201276    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy"
Jul 02 23:50:29.201491 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201284    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="92629cfb-aba6-4e1a-9e59-a94d4a40e238" containerName="istio-proxy"
Jul 02 23:50:29.201491 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201291    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy"
Jul 02 23:50:29.201491 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201345    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy"
Jul 02 23:50:29.201491 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.201351    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8635b78f-e254-4346-9490-4cba7a5d19d6" containerName="istio-proxy"
Jul 02 23:50:29.205565 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.205550    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d4ctc/must-gather-95752"
Jul 02 23:50:29.207689 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.207656    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d4ctc\"/\"kube-root-ca.crt\""
Jul 02 23:50:29.207811 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.207698    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d4ctc\"/\"openshift-service-ca.crt\""
Jul 02 23:50:29.207811 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.207716    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d4ctc\"/\"default-dockercfg-jvzp8\""
Jul 02 23:50:29.212039 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.212012    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d4ctc/must-gather-95752"]
Jul 02 23:50:29.233721 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.233696    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/629e54ab-8504-4fc3-982f-71a641ed6d2a-must-gather-output\") pod \"must-gather-95752\" (UID: \"629e54ab-8504-4fc3-982f-71a641ed6d2a\") " pod="openshift-must-gather-d4ctc/must-gather-95752"
Jul 02 23:50:29.233826 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.233753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk4tx\" (UniqueName: \"kubernetes.io/projected/629e54ab-8504-4fc3-982f-71a641ed6d2a-kube-api-access-vk4tx\") pod \"must-gather-95752\" (UID: \"629e54ab-8504-4fc3-982f-71a641ed6d2a\") " pod="openshift-must-gather-d4ctc/must-gather-95752"
Jul 02 23:50:29.335057 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.335024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/629e54ab-8504-4fc3-982f-71a641ed6d2a-must-gather-output\") pod \"must-gather-95752\" (UID: \"629e54ab-8504-4fc3-982f-71a641ed6d2a\") " pod="openshift-must-gather-d4ctc/must-gather-95752"
Jul 02 23:50:29.335189 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.335074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk4tx\" (UniqueName: \"kubernetes.io/projected/629e54ab-8504-4fc3-982f-71a641ed6d2a-kube-api-access-vk4tx\") pod \"must-gather-95752\" (UID: \"629e54ab-8504-4fc3-982f-71a641ed6d2a\") " pod="openshift-must-gather-d4ctc/must-gather-95752"
Jul 02 23:50:29.335340 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.335321    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/629e54ab-8504-4fc3-982f-71a641ed6d2a-must-gather-output\") pod \"must-gather-95752\" (UID: \"629e54ab-8504-4fc3-982f-71a641ed6d2a\") " pod="openshift-must-gather-d4ctc/must-gather-95752"
Jul 02 23:50:29.343092 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.343074    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk4tx\" (UniqueName: \"kubernetes.io/projected/629e54ab-8504-4fc3-982f-71a641ed6d2a-kube-api-access-vk4tx\") pod \"must-gather-95752\" (UID: \"629e54ab-8504-4fc3-982f-71a641ed6d2a\") " pod="openshift-must-gather-d4ctc/must-gather-95752"
Jul 02 23:50:29.515795 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.515721    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d4ctc/must-gather-95752"
Jul 02 23:50:29.643129 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.643075    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d4ctc/must-gather-95752"]
Jul 02 23:50:29.645512 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:50:29.645485    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod629e54ab_8504_4fc3_982f_71a641ed6d2a.slice/crio-3a67a1ad3f0491dfea89d664517666e32825efd69b9f151549f196fb733009bd WatchSource:0}: Error finding container 3a67a1ad3f0491dfea89d664517666e32825efd69b9f151549f196fb733009bd: Status 404 returned error can't find the container with id 3a67a1ad3f0491dfea89d664517666e32825efd69b9f151549f196fb733009bd
Jul 02 23:50:29.650441 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.650421    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:50:29.937320 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:29.937282    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d4ctc/must-gather-95752" event={"ID":"629e54ab-8504-4fc3-982f-71a641ed6d2a","Type":"ContainerStarted","Data":"3a67a1ad3f0491dfea89d664517666e32825efd69b9f151549f196fb733009bd"}
Jul 02 23:50:30.943937 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:30.943894    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d4ctc/must-gather-95752" event={"ID":"629e54ab-8504-4fc3-982f-71a641ed6d2a","Type":"ContainerStarted","Data":"5421f3b4255b2cdd750b3f8407cf0ec8a7978eabadb262b7a37774eebf9c4323"}
Jul 02 23:50:30.944367 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:30.943946    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d4ctc/must-gather-95752" event={"ID":"629e54ab-8504-4fc3-982f-71a641ed6d2a","Type":"ContainerStarted","Data":"a4b77e948cbd94be15b9c48ca5a7ca7b6ac3831dc2969c89cf88bb77c03c7724"}
Jul 02 23:50:30.959813 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:30.959769    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d4ctc/must-gather-95752" podStartSLOduration=1.147745166 podStartE2EDuration="1.959752425s" totalImagesPullingTime="812.007259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:50:30.958989512 +0000 UTC m=+2397.415245731" watchObservedRunningTime="2026-07-02 23:50:30.959752425 +0000 UTC m=+2397.416008626"
Jul 02 23:50:32.100395 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:32.100364    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-62bxx_13d09a11-ac14-43c3-915a-34f5c085d0d4/global-pull-secret-syncer/0.log"
Jul 02 23:50:32.237376 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:32.237336    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jddwq_18d6352c-e630-4530-ab2b-246bd97aae1d/konnectivity-agent/0.log"
Jul 02 23:50:32.388650 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:32.388539    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-25.ec2.internal_473300bc9019cc21b12b801a14fc1b1d/haproxy/0.log"
Jul 02 23:50:37.034102 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:37.034050    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lbc92_aeb3c012-5516-4d46-a6a4-c38ee5d61617/manager/0.log"
Jul 02 23:50:37.082111 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:37.082075    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-df2vw_fe694108-ce41-416b-b20d-5f5139b867a5/manager/0.log"
Jul 02 23:50:37.136753 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:37.136716    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-sf5z8_874dab85-bc7b-46c5-b3f0-e5fa3b9628ea/kuadrant-console-plugin/0.log"
Jul 02 23:50:37.185643 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:37.185601    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7dbpk_1f7c9207-60ef-46d6-9146-80e9482c9e9d/registry-server/0.log"
Jul 02 23:50:37.387119 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:37.386987    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rkv84_417ab045-2644-4bb5-9a80-36ac6b461385/manager/0.log"
Jul 02 23:50:37.503081 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:37.503043    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mbfm4_84d83def-bfb6-4b96-9fb8-31ac2a79bfbd/manager/0.log"
Jul 02 23:50:39.525109 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:39.525074    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vc8sr_783b74d8-7309-455b-ba60-577443250f35/node-exporter/0.log"
Jul 02 23:50:39.548426 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:39.548401    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vc8sr_783b74d8-7309-455b-ba60-577443250f35/kube-rbac-proxy/0.log"
Jul 02 23:50:39.572161 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:39.572128    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vc8sr_783b74d8-7309-455b-ba60-577443250f35/init-textfile/0.log"
Jul 02 23:50:42.176244 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.176199    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"]
Jul 02 23:50:42.181160 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.181135    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.189921 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.189895    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"]
Jul 02 23:50:42.268618 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.268579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-proc\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.268834 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.268633    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-lib-modules\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.268834 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.268737    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-sys\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.268834 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.268828    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-podres\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.269010 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.268853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vnfk\" (UniqueName: \"kubernetes.io/projected/b90a6efb-89cc-4a55-b475-1690fbe67c34-kube-api-access-4vnfk\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.369931 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.369893    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-podres\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.370151 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.370106    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-podres\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.370362 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.370173    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vnfk\" (UniqueName: \"kubernetes.io/projected/b90a6efb-89cc-4a55-b475-1690fbe67c34-kube-api-access-4vnfk\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.370455 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.370417    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-proc\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.370529 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.370465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-lib-modules\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.370529 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.370516    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-sys\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.370641 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.370556    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-proc\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.370641 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.370631    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-sys\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.370754 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.370643    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b90a6efb-89cc-4a55-b475-1690fbe67c34-lib-modules\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.380007 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.379978    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vnfk\" (UniqueName: \"kubernetes.io/projected/b90a6efb-89cc-4a55-b475-1690fbe67c34-kube-api-access-4vnfk\") pod \"perf-node-gather-daemonset-wndxx\" (UID: \"b90a6efb-89cc-4a55-b475-1690fbe67c34\") " pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.498364 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.498004    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:42.684119 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:42.683489    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"]
Jul 02 23:50:42.687262 ip-10-0-137-25 kubenswrapper[2568]: W0702 23:50:42.687215    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb90a6efb_89cc_4a55_b475_1690fbe67c34.slice/crio-b7725d80448350db909f053b9035c8e285d8ca6f6338fd0f1536dc23fe603a67 WatchSource:0}: Error finding container b7725d80448350db909f053b9035c8e285d8ca6f6338fd0f1536dc23fe603a67: Status 404 returned error can't find the container with id b7725d80448350db909f053b9035c8e285d8ca6f6338fd0f1536dc23fe603a67
Jul 02 23:50:43.027247 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:43.027204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx" event={"ID":"b90a6efb-89cc-4a55-b475-1690fbe67c34","Type":"ContainerStarted","Data":"9ac7de5951e36dc6bae82ad338586b243d3bd74dc05715469a3f396da55598c2"}
Jul 02 23:50:43.027441 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:43.027274    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx" event={"ID":"b90a6efb-89cc-4a55-b475-1690fbe67c34","Type":"ContainerStarted","Data":"b7725d80448350db909f053b9035c8e285d8ca6f6338fd0f1536dc23fe603a67"}
Jul 02 23:50:43.027441 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:43.027303    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:43.043151 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:43.043101    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx" podStartSLOduration=1.043085224 podStartE2EDuration="1.043085224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:50:43.041574954 +0000 UTC m=+2409.497831158" watchObservedRunningTime="2026-07-02 23:50:43.043085224 +0000 UTC m=+2409.499341424"
Jul 02 23:50:44.241354 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:44.241316    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pnp8l_8ec99751-e29e-4b29-85d0-207ce6456584/dns/0.log"
Jul 02 23:50:44.260244 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:44.260222    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pnp8l_8ec99751-e29e-4b29-85d0-207ce6456584/kube-rbac-proxy/0.log"
Jul 02 23:50:44.411873 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:44.411844    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wng7s_990c5d5f-0ae0-4aaf-9b9e-5a4119ea61b2/dns-node-resolver/0.log"
Jul 02 23:50:44.980355 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:44.980326    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54d8c795dc-k5xz4_ab9568e8-2e39-464c-8314-79941a9decd5/registry/0.log"
Jul 02 23:50:45.000313 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:45.000285    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fvxjh_f98f8c84-58ec-4aa4-b876-0b85ee7c203f/node-ca/0.log"
Jul 02 23:50:45.994905 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:45.994847    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zs8jq_c262ba43-0ad4-41b0-913a-63134a7555bf/istio-proxy/0.log"
Jul 02 23:50:46.127434 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:46.127381    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69478b7d6-nqzmg_45b01f44-34eb-4c7f-ac42-21230baf43df/kube-auth-proxy/0.log"
Jul 02 23:50:46.185974 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:46.185928    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zzrr2_27e191d8-835b-4e74-888c-a7cc04b7c5c4/istio-proxy/0.log"
Jul 02 23:50:46.222470 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:46.222412    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zzrr2_27e191d8-835b-4e74-888c-a7cc04b7c5c4/istio-proxy/1.log"
Jul 02 23:50:47.024092 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:47.024066    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qz5kk_5fb2c7e8-ad52-42e0-9a0c-7df33d9d983c/serve-healthcheck-canary/0.log"
Jul 02 23:50:47.544535 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:47.544511    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5t5sd_c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c/kube-rbac-proxy/0.log"
Jul 02 23:50:47.564582 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:47.564551    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5t5sd_c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c/exporter/0.log"
Jul 02 23:50:47.584969 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:47.584940    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5t5sd_c7b41dcd-24a1-4724-9d4a-5e27d8ecec2c/extractor/0.log"
Jul 02 23:50:49.044168 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:49.044137    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d4ctc/perf-node-gather-daemonset-wndxx"
Jul 02 23:50:49.808802 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:49.808753    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2mm7b_d065eb0b-fab0-4f57-a343-cda94b3fc4d4/manager/0.log"
Jul 02 23:50:49.981208 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:49.981168    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zf4dk_bcad56d5-27c5-4202-aae3-4fb1befcc556/manager/0.log"
Jul 02 23:50:50.286358 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:50.286326    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6wft9_9ccf47d2-e249-41fe-982c-751e16bd35b7/manager/0.log"
Jul 02 23:50:50.468761 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:50.468728    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc9978976-nrclr_27b545fe-74a0-4c4a-9d50-5edf5484d340/manager/0.log"
Jul 02 23:50:50.490878 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:50.490846    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc9978976-nrclr_27b545fe-74a0-4c4a-9d50-5edf5484d340/copy-manifests/0.log"
Jul 02 23:50:52.564005 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:52.563973    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zs8jq_c262ba43-0ad4-41b0-913a-63134a7555bf/istio-proxy/0.log"
Jul 02 23:50:52.678202 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:52.678128    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69478b7d6-nqzmg_45b01f44-34eb-4c7f-ac42-21230baf43df/kube-auth-proxy/0.log"
Jul 02 23:50:52.710741 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:52.710708    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zzrr2_27e191d8-835b-4e74-888c-a7cc04b7c5c4/istio-proxy/0.log"
Jul 02 23:50:52.749037 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:52.749001    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zzrr2_27e191d8-835b-4e74-888c-a7cc04b7c5c4/istio-proxy/1.log"
Jul 02 23:50:54.006305 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:54.006226    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4zs8jq_c262ba43-0ad4-41b0-913a-63134a7555bf/istio-proxy/0.log"
Jul 02 23:50:54.122181 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:54.122156    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69478b7d6-nqzmg_45b01f44-34eb-4c7f-ac42-21230baf43df/kube-auth-proxy/0.log"
Jul 02 23:50:54.162440 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:54.162415    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zzrr2_27e191d8-835b-4e74-888c-a7cc04b7c5c4/istio-proxy/0.log"
Jul 02 23:50:54.201364 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:54.201336    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zzrr2_27e191d8-835b-4e74-888c-a7cc04b7c5c4/istio-proxy/1.log"
Jul 02 23:50:57.160888 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:57.160800    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-fqx5j_9064dc2f-7a73-480f-93d5-43194ad17c77/migrator/0.log"
Jul 02 23:50:57.183847 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:57.182212    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-fqx5j_9064dc2f-7a73-480f-93d5-43194ad17c77/graceful-termination/0.log"
Jul 02 23:50:58.763152 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:58.763127    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgmhn_f22aa5c9-7486-43c8-9f4a-f8079561f43d/kube-multus-additional-cni-plugins/0.log"
Jul 02 23:50:58.784697 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:58.784661    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgmhn_f22aa5c9-7486-43c8-9f4a-f8079561f43d/egress-router-binary-copy/0.log"
Jul 02 23:50:58.805419 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:58.805394    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgmhn_f22aa5c9-7486-43c8-9f4a-f8079561f43d/cni-plugins/0.log"
Jul 02 23:50:58.826452 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:58.826425    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgmhn_f22aa5c9-7486-43c8-9f4a-f8079561f43d/bond-cni-plugin/0.log"
Jul 02 23:50:58.849528 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:58.849505    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgmhn_f22aa5c9-7486-43c8-9f4a-f8079561f43d/routeoverride-cni/0.log"
Jul 02 23:50:58.869484 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:58.869462    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgmhn_f22aa5c9-7486-43c8-9f4a-f8079561f43d/whereabouts-cni-bincopy/0.log"
Jul 02 23:50:58.890242 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:58.890219    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rgmhn_f22aa5c9-7486-43c8-9f4a-f8079561f43d/whereabouts-cni/0.log"
Jul 02 23:50:59.115721 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:59.115663    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hm7qm_5e0d9bba-ad6c-4a08-9b1f-3fdd616d3484/kube-multus/0.log"
Jul 02 23:50:59.209208 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:59.209161    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-95xd7_f9b03d41-3bec-45a0-9655-41c67a514ff4/network-metrics-daemon/0.log"
Jul 02 23:50:59.231295 ip-10-0-137-25 kubenswrapper[2568]: I0702 23:50:59.231269    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-95xd7_f9b03d41-3bec-45a0-9655-41c67a514ff4/kube-rbac-proxy/0.log"